Skip to content

Can a Process Be Markov Without Being a Martingale?

Original question

What is the difference between a martingale and a Markov process, and how are they used in quantitative finance?
A martingale has its current value as the conditional mean of its future value. A Markov process has a conditional future distribution determined by its current state and time. These conditions answer different questions. Brownian motion satisfies both. Brownian motion with nonzero constant drift is Markov and fails the martingale condition.

Same mean or same distribution?

For an adapted integrable process XX and information Fs\mathcal F_s, the martingale identity is

E[Xt∣Fs]=Xs,s≤t.\mathbb E[X_t\mid\mathcal F_s]=X_s,\qquad s\le t.
A Markov identity for the natural filtration is
E[g(Xt)∣Fs]=E[g(Xt)∣Xs]\mathbb E[g(X_t)\mid\mathcal F_s]=\mathbb E[g(X_t)\mid X_s]
for every bounded measurable function gg. Testing all bounded functions captures the full conditional distribution. A single linear function captures only the mean. In a Markov model with integrable values, one can check the martingale condition by computing the conditional mean from the transition law.
For Xt=Wt+μtX_t=W_t+\mu t, we have Xt=Xs+μ(t−s)+(Wt−Ws)X_t=X_s+\mu(t-s)+(W_t-W_s). The increment of WW is independent of the past, so the conditional distribution is normal with mean Xs+μ(t−s)X_s+\mu(t-s) and variance t−st-s. Its dependence on XsX_s and elapsed time establishes the Markov property. The mean establishes the martingale property exactly when μ=0\mu=0.

A martingale can retain predictive information in its history. Let HH take values 11 and 22 with equal probability. Set M0=HM_0=H. At time 1, toss an independent fair coin and set M1=0M_1=0 or 2H2H according to its result. At time 2, set M2=M1+HεM_2=M_1+H\varepsilon, with an independent fair sign ε\varepsilon.

The conditional mean of M1M_1 given M0M_0 is HH. The conditional mean of M2M_2 given the full past is M1M_1. Hence the process is a martingale in its natural filtration. However, when M1=0M_1=0, the next value could be ±1\pm1 or ±2\pm2 depending on M0M_0. The past changes the conditional distribution, so MM is not Markov. The enlarged state (Mt,H)(M_t,H) restores the missing information.

The martingale counterexample is easiest to test on the event M1=0M_1=0. Both values of HH can get there. If the earlier value M0M_0 was 1, the next move is plus or minus 1. If it was 2, the next move is plus or minus 2. For instance, the conditional probability of ∣M2∣=2|M_2|=2 is then either zero or one depending on M0M_0. The conditional mean is zero in both cases. This is why checking only the mean cannot establish the Markov property for the proposed state variable.

Interactive example

Turn a fair random walk into a biased one

Start at zero. Each independent step adds 1 on heads and subtracts 1 on tails. Compare expected change with the variability of a single walk.

Expected change per step 0.00 · martingale
A random walk compared with its expected path-4-2008162432StepsPosition
  • One simulated walk
  • Expected walk

References and next steps