Skip to content

Checking Optional Stopping With Bounded and Unbounded Times

Original question

Can you explain how to verify that a given process satisfies the conditions of the optional stopping theorem?
First prove that the underlying process is a martingale and that the proposed random time is a stopping time for the same filtration. Then identify a sufficient condition for the version of optional stopping you are using. Bounded stopping times are the simplest case. For an unbounded stopping time, stopping first at τ∧n\tau\wedge n and justifying a limit by bounded domination or uniform integrability is a common proof.

Stop at a finite time first, then justify the limit

In discrete time, check {τ≤n}∈Fn\{\tau\le n\}\in\mathcal F_n for every nn. For the bounded time τ∧n\tau\wedge n, write

Mτ∧n=M0+∑k=1n1{τ≥k}(Mk−Mk−1).M_{\tau\wedge n}=M_0+\sum_{k=1}^n \mathbf1_{\{\tau\ge k\}}(M_k-M_{k-1}).
The indicator is measurable at k−1k-1 because its complement is {τ≤k−1}\{\tau\le k-1\}. Each summand has expectation zero by conditioning on Fk−1\mathcal F_{k-1}. Hence E[Mτ∧n]=E[M0]E[M_{\tau\wedge n}]=E[M_0]. If τ<∞\tau<\infty almost surely, the left-hand random variable converges almost surely to MτM_\tau. To pass the equality to the limit, verify an integrable bound that holds for all nn, or another applicable condition that ensures convergence in expectation. Almost sure finiteness of τ\tau alone establishes only the pathwise convergence.
In the sum, the event {τ≥k}\{\tau\ge k\} is already decided at k−1k-1. It says that the process has not stopped by the previous observation. That predictability lets you take it outside the conditional expectation of the next martingale increment. For an unbounded stopping time, the bounded identity holds for every nn separately. The missing argument is whether expectations converge as τ∧n\tau\wedge n tends to τ\tau. Identify a sufficient condition, such as uniform integrability, or exhibit an integrable bound in the particular problem before taking that limit.

Why the two-barrier walk works and a single barrier can fail

A symmetric random walk starts at S0=2S_0=2 and moves up or down by one with equal probability. What is the probability of reaching 5 before 0? Set τ=inf⁡{n:Sn∈{0,5}}\tau=\inf\{n:S_n\in\{0,5\}\}. The walk is a martingale in its natural filtration and the first hit is a stopping time. Any block of five successive upward steps forces an exit if the walk is still inside the interval. Independent blocks each have probability 2−52^{-5} of being all upward, so the walk exits almost surely. Also, 0≤Sτ∧n≤50\le S_{\tau\wedge n}\le5 for every nn. Dominated convergence now gives E[Sτ]=2E[S_\tau]=2. Since SτS_\tau equals either 0 or 5,
P(Sτ=5)=2/5.P(S_\tau=5)=2/5.
Contrast this with the same walk started at zero and stopped only on its first hit of +1+1. In a symmetric walk, that hit occurs almost surely. For example, the probability of hitting +1+1 before −a-a is a/(a+1)a/(a+1), which approaches one. The stopped payoff at the first hit of +1+1 is always one, while the initial value is zero. The bounded domination used for the two-sided walk no longer applies.

For the two-barrier case, Sτ∧nS_{\tau\wedge n} always lies between zero and five. You can use the constant five as an integrable bound. The walk exits almost surely because from any interior state there is a uniformly positive chance of reaching a boundary within the next five steps, and repeated blocks make the chance of never exiting vanish. Now the bounded-time expectations pass to the limit. With only an upper barrier the stopped walk can make arbitrarily large negative excursions before hitting. The same bound is no longer available, even though the one-step martingale equation still holds.

Interactive example

Turn a fair random walk into a biased one

Start at zero. Each independent step adds 1 on heads and subtracts 1 on tails. Compare expected change with the variability of a single walk.

Expected change per step 0.00 · martingale
A random walk compared with its expected path-4-2008162432StepsPosition
  • One simulated walk
  • Expected walk

References and next steps