What a simplified model buys you
Put the sensitive assumption under pressure
- State the decision and the horizon. An intraday execution decision and a one-year risk estimate depend on different information.
- Identify the sensitive assumptions. Alter one at a time. For example, vary trading costs, introduce a jump, or raise the assumed correlation during stress.
- Compare with a benchmark. Use held-out observations, quoted prices, or an independent method appropriate to the decision. Explain how input differences affect the comparison.
- Report the limits of use. Record where the model was fitted, the situations it handled well, and which scenarios produced material errors. Set a review threshold that matches the stakes of the decision.
A useful validation exercise can end with the simple model if the added complexity improves little for the decision at hand. In another application, the same exercise can expose why the simple model fails.
Under Model A, the 99th percentile of daily loss is roughly 2.33%. Under Model B, the 99th percentile is 5%. Matching the first two moments leaves a large difference in tail risk. If the model is used for a tail decision, matching daily standard deviation alone offers weak validation. A historical stress exercise or a model with heavier tails would address a feature the first fit discarded.
The example also tells you what to ask a model owner. If the decision is a rough variance budget, equal variances may be enough for the immediate job. If the decision depends on a rare one-day loss, you need evidence about the tails and how uncertain your tail estimate is. Write down which decision changes when the assumption changes. That's more informative than a blanket claim that the model is realistic, and it gives you a concrete reason to spend effort on a richer model.