Skip to content
Probability, Statistics and Financial Data / Linear Regression and Analysis of Variance

Residual Diagnostics and Model Checking

Every exact tt-interval, FF-test, and confidence band this topic has built rested on a specific, checkable list of assumptions: linearity, constant error variance, uncorrelated errors, and (for the exact small-sample distributions) normality. None of these were ever verified against the data — they were simply assumed so the machinery could run. This closing lesson turns the machinery around: given a fitted model, how does a practitioner check whether the assumptions that licensed it actually hold? The residuals ε^=y−y^\hat{\boldsymbol\varepsilon}=\mathbf y-\hat{\mathbf y} carry almost all the available evidence, and this note builds the standard toolkit for reading it — standardized and leverage-adjusted residuals, the residual-vs-fitted plot for non-linearity and heteroscedasticity, Cook's distance for influential points, the Durbin-Watson statistic for autocorrelation, and the QQ-plot for normality — closing the topic exactly where a working quant analysis of any regression or ANOVA model must always end: is this fit trustworthy, or does it only look that way?
Learning objectives. By the end of this note you should be able to:
  • state the Gauss-Markov theorem and identify which of its assumptions each diagnostic in this note checks;
  • compute standardized (leverage-adjusted) residuals and explain why raw residuals are not directly comparable across observations;
  • read a residual-vs-fitted plot to diagnose non-linearity and heteroscedasticity;
  • compute and interpret Cook's distance for influence, and the Durbin-Watson statistic for first-order autocorrelation;
  • use a QQ-plot of residuals to assess normality, and explain the consequence of each assumption's failure for the inference built earlier in this topic.

In this lesson

  1. What the machinery assumed
  2. Standardized residuals and leverage
  3. Reading the residual-vs-fitted plot
  4. Cook's distance: influence, not just leverage
  5. Durbin-Watson: detecting autocorrelation
  6. Checking normality: the QQ-plot

Before you start

The full lesson, with worked examples and exercise solutions, is for members.

Read the full lesson

New to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.