Skip to content

OLS with duplicate signals

Question

A return model includes two identical feature columns. Are its ordinary least-squares coefficients and fitted values unique? Explain how you would fit it numerically.

Short answer

The coefficient vector is not unique because the design matrix is rank deficient: a null-space vector can be added without changing the fit. The fitted vector is the unique orthogonal projection onto the column space. Use a QR/SVD least-squares solver or remove redundant columns. A pseudoinverse selects the minimum-norm coefficient vector; it does not make the original coefficients identifiable.

Original question and answer written by SelfMadeQuant.com.

See the hint and the full worked solution in the question bank (free account).

Open the worked solution

Lessons behind this question

Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.

Read it free