Solving directly, as the previous lesson did, requires setting up and solving a linear system — feasible for three states, tedious for thirty. Detailed balance is a stronger, purely local condition — balance the flow between every pair of states, not just the flow into and out of each state overall — that, when it holds, both guarantees stationarity and often makes trivial to write down by hand. It also has a striking interpretive payoff: a chain satisfying detailed balance looks statistically identical whether you watch it run forwards or backwards in time.
Learning objectives. By the end of this note you should be able to:
- state the detailed balance condition and show it implies stationarity;
- solve for the stationary distribution of a birth-death chain using detailed balance;
- compute the stationary distribution of a random walk on a graph directly from vertex degrees;
- state the reversibility theorem and identify when a chain equals its own time-reversal.
In this lesson
- Detailed balance implies stationarity
- Birth-death chains
- Random walks on graphs
- Time reversibility
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or explore the curriculum.