Skip to content

Constructing Convergence in Probability Without Almost-Sure Convergence

Original question

How can I prove that a sequence of random variables converges in probability but not almost surely?

Build independent events whose probabilities tend to zero but whose probabilities sum to infinity. Their indicator variables converge to zero in probability because a deviation at any one late index is unlikely. The second Borel–Cantelli lemma gives infinitely many deviations along almost every path, so almost sure convergence to zero fails.

Choose events that are rare individually and recur infinitely often

Convergence in probability to XX means that for every ϵ>0\epsilon>0,

P(∣Xn−X∣>ϵ)→0.P(|X_n-X|>\epsilon)\to 0.

Almost sure convergence means P({ω:Xn(ω)→X(ω)})=1P(\{\omega:X_n(\omega)\to X(\omega)\})=1. For a fixed ϵ\epsilon, let An={∣Xn−X∣>ϵ}A_n=\{|X_n-X|>\epsilon\}. The event that deviations of this size recur infinitely often is

lim sup⁡n→∞An=⋂m≥1⋃n≥mAn.\limsup_{n\to\infty}A_n =\bigcap_{m\ge1}\bigcup_{n\ge m}A_n.

If P(An)P(A_n) is summable for every positive rational ϵ\epsilon, the first Borel–Cantelli lemma gives almost sure convergence. It requires no independence. For a counterexample, choose independent AnA_n with P(An)→0P(A_n)\to0 and a divergent sum. Then the second Borel–Cantelli lemma gives P(An infinitely often)=1P(A_n\text{ infinitely often})=1. Taking Xn=1AnX_n=\mathbf 1_{A_n} separates the two definitions.

The subtle difference is the quantifier. Convergence in probability asks whether the chance of a large error at index nn goes to zero as you move that index out. Almost-sure convergence asks whether, for almost every complete sequence, there is some last large error. The first Borel–Cantelli lemma says summable error probabilities rule out infinitely many such errors, even without independence. For a counterexample you therefore want probabilities that tend to zero but have a divergent sum. Independence then lets the second lemma give the opposite conclusion.

Check both modes of convergence for the same sequence

Let UnU_n be independent uniform random variables on (0,1)(0,1) and set Xn=1{Un≤1/(n+1)}X_n=\mathbf 1_{\{U_n\le1/(n+1)\}}. For any 0<ϵ<10<\epsilon<1, the deviation probability from zero is 1/(n+1)→01/(n+1)\to0. For ϵ≥1\epsilon\ge1, it is zero at every nn. This proves convergence in probability.

To see why almost sure convergence fails even without quoting the lemma, calculate the probability of a run with no spikes from mm through NN. Independence gives

P(Xm=⋯=XN=0)=∏n=mN(1−1n+1)=mN+1.P(X_m=\cdots=X_N=0) =\prod_{n=m}^N\left(1-\frac1{n+1}\right) =\frac{m}{N+1}.

Letting NN grow shows the probability of no spikes from mm onward is zero. Taking the countable union over all mm shows the probability of eventually having no spikes is also zero. Since XnX_n takes only the values zero and one, convergence to zero would require exactly that eventual behaviour.

Now reuse a single uniform variable UU at every date in place of UnU_n. The marginal probabilities are identical. Along any path with U>0U>0, however, the threshold eventually falls below UU and the indicator stays at zero. This comparison isolates the role of dependence.

References and next steps