OLS with duplicate signals
Question
A return model includes two identical feature columns. Are its ordinary least-squares coefficients and fitted values unique? Explain how you would fit it numerically.
Short answer
The coefficient vector is not unique because the design matrix is rank deficient: a null-space vector can be added without changing the fit. The fitted vector is the unique orthogonal projection onto the column space. Use a QR/SVD least-squares solver or remove redundant columns. A pseudoinverse selects the minimum-norm coefficient vector; it does not make the original coefficients identifiable.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Ridge, Lasso, and Elastic Net
- The Normal Equations: Closed-Form Least Squares
- Simple Linear Regression: OLS Estimators and Geometry
Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free