Before a desk fits a return distribution by numerically maximising a likelihood — the subject of the next lesson — it usually wants a fast, closed-form starting guess: a rough shape and scale for a loss-severity model, an overdispersion parameter for a trade-count model, or initial values to hand to an iterative optimiser so it converges to the right root rather than wandering. The method of moments (MOM) is the oldest tool for exactly this job. It asks a deliberately simple question — for what parameter value do the distribution's theoretical moments match the moments actually observed in the sample? — and turns it into an algebraic recipe: write the low-order population moments as functions of the unknown parameters, invert those functions, and plug in the sample moments. No likelihood, no calculus of a log-density, no numerical search.
This note opens Topic 3 of the Statistics I unit by giving MOM a precise statement, working it through the Normal, Gamma, Beta, and Negative Binomial families, proving the consistency that makes MOM more than a curve-fitting trick, and flagging the pitfall — estimates that fall outside the parameter space — that MOM's simplicity buys at the price of robustness. The next lesson takes up maximum likelihood, which fixes MOM's efficiency shortfall at the cost of needing a numerical solve — for which, as the Gamma example below shows, the MOM estimate is the natural starting value.
Learning objectives. By the end of this note you should be able to:
- state the method-of-moments recipe (equate sample moments to population moments, invert, substitute) and execute it for a -parameter family;
- derive MOM estimators for the Normal, Gamma, Beta, and Negative Binomial families;
- prove that MOM estimators are consistent whenever the moment-to-parameter map is continuous, using the weak law of large numbers;
- recognise and diagnose the pitfall of a MOM estimate falling outside the parameter space.
In this lesson
- The recipe
- Worked examples
- Consistency
- When the method breaks
Before you start
- Parametric Statistical Models and the Likelihood
- The Weak Law of Large Numbers and Convergence in Probability
- Expectation, Mean, and Variance
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.