With labels, weights and memory frozen, the systematic researcher still needs an honest estimate of whether the event classifier generalises. Ordinary random -fold assumes IID folds; overlapping financial labels violate that. This topic contrasts purged/embargoed validation with library -fold, then audits feature importance under the limited statements the vault actually supports.
By the end of this note you should be able to:
- draw a purged-and-embargoed split for the running fixture;
- explain why library -fold overstates skill on overlapping labels;
- run an importance audit that respects correlated substitutes without inventing MDI/MDA formulae absent from the vault.
In this lesson
- Contents
- The big picture
The full lesson is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Financial Machine Learning syllabus.