Upper limit on R squared with two weak regressors
Question
A response is regressed by OLS on alone and, separately, on alone (each with an intercept); both fits have . What is the smallest number that is guaranteed to bound from above the of the joint regression of on and together?
Short answer
. Nothing prevents a perfect fit. For example, let be an exact quadratic in whose vertex is far from the origin and let : each single regressor explains little, yet is an exact linear combination of , and , so the joint is (and individual values can be tuned to ).
Adapted from QuantQuestions.io; question and answer rewritten by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Simple Linear Regression: OLS Estimators and Geometry
- Multiple Linear Regression
- Populations, Samples, and Sampling Distributions
Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free