Skip to content
Probability, Statistics and Financial Data / Linear Regression and Analysis of Variance

Inference in Simple Linear Regression

The previous lesson produced numbers — β^0=0.146\hat\beta_0=0.146, β^1=0.818\hat\beta_1=0.818 for a hedge ratio — but numbers alone cannot answer the question a risk committee actually asks: is that slope reliably different from zero, or could five noisy days have produced this by chance? This note adds the one assumption needed to answer that — normality of the errors εi\varepsilon_i — and derives the exact sampling distributions of β^0\hat\beta_0 and β^1\hat\beta_1. The payoff is threefold: a tt-test for H0:β1=0H_0:\beta_1=0, exact confidence intervals for the slope and intercept using the pivotal-quantity method already built, and a sharp distinction — routinely blurred in practice — between a confidence interval for the mean response E[Y∣x]\mathbb{E}[Y\mid x] and a prediction interval for a single new observation at xx.
Learning objectives. By the end of this note you should be able to:
  • state the exact sampling distributions of β^0\hat\beta_0 and β^1\hat\beta_1 under normal errors, and prove them from the projection geometry of the previous lesson;
  • construct and use the tt-statistic for testing H0:β1=0H_0:\beta_1=0, and the corresponding confidence interval for β1\beta_1;
  • explain why OLS coincides with maximum likelihood under normal errors, and where the two estimators of σ2\sigma^2 diverge;
  • distinguish a confidence interval for E[Y∣x0]\mathbb{E}[Y\mid x_0] from a prediction interval for a new YY at x0x_0, and compute both.

In this lesson

  1. Adding normality
  2. Sampling distributions of β^0\hat\beta_0 and β^1\hat\beta_1
  3. Estimating σ2\sigma^2 and the tt-statistic
  4. Confidence interval vs. prediction interval

Before you start

The full lesson, with worked examples and exercise solutions, is for members.

Read the full lesson

New to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.