Skip to content

A falling out-of-sample R squared

Question

A prediction model has negative out-of-sample R squared. What does that mean, and which baseline must be specified?

Short answer

It means the model's squared error exceeds the squared error of the baseline used in the denominator. Define that baseline explicitly: a training-window mean, zero return, and a test-sample mean are different comparators. A test mean is unavailable at prediction time even if used as a descriptive statistic. Also assess uncertainty, costs and regime stability before drawing an investment conclusion.

Original question and answer written by SelfMadeQuant.com.

See the hint and the full worked solution in the question bank (free account).

Open the worked solution

Lessons behind this question

Start with a free lesson: Normal Distribution is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.

Read it free