Skip to content
Probability, Statistics and Financial Data / Sampling Distributions and the Normal Family

Derivation — The Sampling Distribution of S² and Cochran's Theorem

The previous lesson quoted two facts without proof: that the one-sample tt-statistic T=(Xˉ−μ)/(S/n)T=(\bar X-\mu)/(S/\sqrt n) exactly follows t(n−1)t(n-1), and that a χ2\chi^2-based confidence interval for σ2\sigma^2 needs (n−1)S2/σ2∼χ2(n−1)(n-1)S^2/\sigma^2\sim\chi^2(n-1). Both rest on a single, non-obvious fact: under normality, Xˉ\bar X and S2S^2 are independent random variables — a pure coincidence of the normal distribution's algebra, not a general truth (it fails for most other population distributions). This note supplies the missing proof, in three steps: independence of Xˉ\bar X from the vector of centred deviations (X1−Xˉ,…,Xn−Xˉ)(X_1-\bar X,\ldots,X_n-\bar X), the consequent independence of Xˉ\bar X and S2S^2, and the exact chi-squared distribution of (n−1)S2/σ2(n-1)S^2/\sigma^2. It closes with Cochran's theorem, the general orthogonal-decomposition result of which this is the two-piece special case, and which reappears whenever a sum of squares is split into independent pieces — the algebraic engine underneath ANOVA and regression's sum-of-squares decompositions later in this unit.
Learning objectives. By the end of this note you should be able to:
  • reproduce the moment-generating-function argument that Xˉ\bar X and (X1−Xˉ,…,Xn−Xˉ)(X_1-\bar X,\ldots,X_n-\bar X) are independent under normality;
  • derive (n−1)S2/σ2∼χ2(n−1)(n-1)S^2/\sigma^2\sim\chi^2(n-1) from that independence and the additivity of chi-squared random variables;
  • derive the exact distribution of the one-sample tt-statistic;
  • state Cochran's theorem and identify the degrees-of-freedom accounting in a sum-of-squares decomposition.

In this lesson

  1. Setup
  2. Independence of Xˉ\bar{X} and the centred deviations
  3. The exact distribution of S2S^2
  4. The exact distribution of the one-sample tt-statistic
  5. Cochran's theorem

Before you start

The full lesson, with worked examples and exercise solutions, is for members.

Read the full lesson

New to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.