Skip to content

Better prediction error but worse net returns

Question

A new model lowers return-prediction MSE but produces lower net strategy returns. Design an investigation.

Short answer

Hold the evaluation sample and execution assumptions fixed. Compare improvements by trade size, horizon and decision threshold; the model may improve untraded observations while harming selected trades. Inspect turnover, spreads, impact, risk exposure and calibration at the traded tail. Separate forecast quality from portfolio construction and costs. Tune any revised decision rule only within development periods and evaluate it on an untouched outer sample.

Original question and answer written by SelfMadeQuant.com.

See the hint and the full worked solution in the question bank (free account).

Open the worked solution

Lessons behind this question

Start with a free lesson: Probability Fundamentals is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.

Read it free