A quant researcher backtesting a factor never observes the population correlation between a forecast score and next-period return — only a finite sample of paired observations, from which a sample correlation must be estimated. That estimate is the information coefficient (IC), the single number that decides whether a signal is worth trading. This note is the bivariate sibling of the previous lesson: exactly as estimated the population variance with an -corrected divisor, sample covariance and sample correlation estimate the population quantities and defined in Covariance and Correlation. It proves the sample covariance is unbiased by the identical algebraic move used for , then draws a distinction that trips up practitioners routinely: cross-sectional dispersion (how assets differ from one another at a single point in time) versus time-series volatility (how one asset varies across time) — two applications of the same formula, resting on very different independence assumptions.
Learning objectives. By the end of this note you should be able to:
- define sample covariance and sample correlation, and compute both from paired data;
- prove that sample covariance is an unbiased estimator of population covariance;
- state and use the sample-correlation bound ;
- distinguish cross-sectional dispersion from time-series volatility, and explain why the i.i.d. assumption is more often violated in the latter;
- compute and interpret the information coefficient (IC) as a sample correlation.
In this lesson
- Sample covariance
- Sample correlation
- Cross-sectional dispersion versus time-series volatility
- The information coefficient
Before you start
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Probability, Statistics and Financial Data syllabus.