More features than observations
Question
You have 400 candidate signals and 120 training dates. Why is unrestricted least squares fragile, and what alternatives would you compare?
Short answer
The design matrix cannot have full column rank, so unrestricted coefficients are non-identifiable and may interpolate noise. Compare simple baselines, ridge, elastic net and dimension reduction using time-respecting nested validation. Select preprocessing and hyperparameters inside training folds. More rows from correlated assets do not necessarily supply equivalent independent information. Report out-of-sample performance and sensitivity to the regularisation choice.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Ridge, Lasso, and Elastic Net
- The Normal Equations: Closed-Form Least Squares
- Simple Linear Regression: OLS Estimators and Geometry
Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free