MSE versus MAE for noisy targets
Question
For a heavy-tailed return target, how do squared and absolute prediction losses differ in their population-optimal predictions?
Short answer
When the required expectations exist, squared loss is minimised by the conditional mean, while absolute loss is minimised by a conditional median. Squared loss emphasises large residuals more strongly. Choose the objective according to the decision being supported and compare performance under plausible tail events. A robust objective changes the estimated target functional; it is not automatically a better estimator of the conditional mean.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Ridge, Lasso, and Elastic Net
- The Normal Equations: Closed-Form Least Squares
- Simple Linear Regression: OLS Estimators and Geometry
Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free