Skip to content
Probability, Statistics and Financial Data / Continuous Random Variables

The Continuous Bayes' Rule

A radar reads a noisy speed; a market observes a noisy price signal; a detector receives a noisy transmitted bit. In every case, the quantity of interest is unobserved and continuous (or discrete), and only a noisy, related observation is available — exactly the inference structure Conditional Probability, Total Probability, and Bayes' Rule built for discrete events, now needed for continuous densities. This note inverts Joint Densities, Marginals, and Conditioning's "prior ×\times likelihood →\to joint" construction to go the other way — from an observation back to a posterior belief about the unobserved quantity — covering both the fully-continuous case and the practically important mixed case of a discrete signal observed through continuous noise.
Learning objectives. By the end of this note you should be able to:
  • state and apply the continuous Bayes' rule for two jointly continuous random variables;
  • state and apply the mixed-case Bayes' rule for a discrete random variable observed through a continuous conditional density;
  • work a full discrete-signal-in-Gaussian-noise inference problem end to end;
  • recognise the "prior, likelihood, posterior" vocabulary in a continuous or mixed setting.

In this lesson

  1. The fully continuous case
  2. The mixed case: a discrete signal in continuous noise

Before you start

The full lesson, with worked examples and exercise solutions, is for members.

Read the full lesson

New to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.