Correlated factors under ridge and lasso
Question
Two standardised factors are nearly interchangeable. How might ridge and lasso distribute their exposure, and what stability checks would you run?
Short answer
Ridge tends to distribute exposure across correlated predictors, whereas lasso may select one and suppress the other. Lasso selection can change sharply under small sample changes; exact duplicates can make lasso coefficients non-unique. Refit across chronological windows and perturbations, comparing coefficients, selected groups and predictions. Elastic net can encourage grouped retention, but validation must still establish predictive value.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Ridge, Lasso, and Elastic Net
- The Normal Equations: Closed-Form Least Squares
- Covariance and Correlation
Start with a free lesson: Expectation, Variance and Covariance is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free