A point estimate reported without any sense of how far it might be from the truth is close to useless to a risk committee: "the fitted daily volatility is 1.8%" invites the obvious follow-up, how sure are you? Topic 3 built the estimators — method of moments, maximum likelihood — but stopped at the point estimate. This note builds the first, and best, kind of answer: an exact confidence interval, a random interval that is guaranteed, by construction and for every finite sample size, to trap the true parameter with a specified probability. The construction method is a single reusable trick — find a pivotal quantity, a function of the data and the parameter whose distribution does not depend on the parameter, then invert its distribution to isolate . The and distributions built in The Chi-Squared, , and Distributions turn out to be exactly the pivots needed for a normal mean and variance, so this note is largely a matter of putting already-built machinery to a new use — and, along the way, exposing a deep duality: every confidence interval is secretly a family of hypothesis tests in disguise, and vice versa.
Learning objectives. By the end of this note you should be able to:
- define a pivotal quantity and verify that a proposed statistic is pivotal;
- construct an exact confidence interval by pivoting a monotone CDF, and state the general theorem that guarantees the resulting set is an interval;
- derive and apply the exact -interval for a normal mean and the exact -interval for a normal variance;
- state and apply the duality between confidence intervals and hypothesis test acceptance regions;
- explain why the conventional equal-tailed split is not always the shortest interval at a given confidence level.
In this lesson
- Confidence intervals and coverage
- Pivotal quantities
- Pivoting a monotone CDF: the general construction
- The exact -interval for a normal mean
- The exact -interval for a normal variance
- The duality of confidence intervals and hypothesis tests
Before you start
- Populations, Samples, and Sampling Distributions
- The Chi-Squared, t, and F Distributions
- Derivation — The Sampling Distribution of S² and Cochran's Theorem
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.