Tree depth and sample fragmentation
Question
Why can a deep regression tree fit weak financial signals extremely well in training but poorly in later periods?
Short answer
Repeated splitting creates small leaves whose averages can fit sample noise and unusual observations. Future samples may not share those patterns. Constrain depth and leaf sizes, compare against simple baselines, and tune with chronological validation. Inspect the effective sample size within leaves, not just total row count. Correlated stock-date observations can make a numerically large leaf contain little independent information.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Decision Trees: Splitting Criteria and Pruning
- Boosting: AdaBoost and Gradient Boosting
- Simple Linear Regression: OLS Estimators and Geometry
Start with a free lesson: Basic Statistics and Regression is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free