Skip to content

Tree depth and sample fragmentation

Question

Why can a deep regression tree fit weak financial signals extremely well in training but poorly in later periods?

Short answer

Repeated splitting creates small leaves whose averages can fit sample noise and unusual observations. Future samples may not share those patterns. Constrain depth and leaf sizes, compare against simple baselines, and tune with chronological validation. Inspect the effective sample size within leaves, not just total row count. Correlated stock-date observations can make a numerically large leaf contain little independent information.

Original question and answer written by SelfMadeQuant.com.

See the hint and the full worked solution in the question bank (free account).

Open the worked solution

Lessons behind this question

Start with a free lesson: Basic Statistics and Regression is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.

Read it free