A falling out-of-sample R squared
Question
A prediction model has negative out-of-sample R squared. What does that mean, and which baseline must be specified?
Short answer
It means the model's squared error exceeds the squared error of the baseline used in the denominator. Define that baseline explicitly: a training-window mean, zero return, and a test-sample mean are different comparators. A test mean is unavailable at prediction time even if used as a descriptive statistic. Also assess uncertainty, costs and regime stability before drawing an investment conclusion.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Ridge, Lasso, and Elastic Net
- The Normal Equations: Closed-Form Least Squares
- Simple Linear Regression: OLS Estimators and Geometry
Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free