Better prediction error but worse net returns
Question
A new model lowers return-prediction MSE but produces lower net strategy returns. Design an investigation.
Short answer
Hold the evaluation sample and execution assumptions fixed. Compare improvements by trade size, horizon and decision threshold; the model may improve untraded observations while harming selected trades. Inspect turnover, spreads, impact, risk exposure and calibration at the traded tail. Separate forecast quality from portfolio construction and costs. Tune any revised decision rule only within development periods and evaluate it on an untouched outer sample.
Original question and answer written by SelfMadeQuant.com.
See the hint and the full worked solution in the question bank (free account).
Open the worked solutionLessons behind this question
- Finance-aware validation
- Cross-Validation and Information Criteria
- Sample Spaces, Events, and the Probability Axioms
Start with a free lesson: Probability Fundamentals is part of a free topic. Create a free account, no card needed, to read it in full with worked solutions.
Read it free