The previous lesson stated, without proof, that an irreducible recurrent chain has a stationary distribution with . This note supplies that proof via Durrett's "cycle trick" — build a candidate stationary measure by counting expected visits to each state during one excursion away from a fixed reference state, then show it is automatically balanced by the Markov property. The argument is a genuine piece of machinery (not just algebra), and it explains why the mean-return-time formula is true rather than merely asserting it.
Learning objectives. By the end of this note you should be able to:
- construct the cycle-trick measure and explain its interpretation as an expected visit count;
- prove using the Markov property;
- conclude the mean-return-time formula from the cycle-trick measure.
In this lesson
- The cycle-trick measure
- The mean-return-time formula
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or explore the curriculum.