PCA finds a new orthogonal basis that best preserves variance — a purely second-order-statistics criterion. Independent component analysis (ICA) asks a genuinely different question, motivated by the "cocktail-party problem": given microphones each recording an overlapping mixture of simultaneous speakers, can the original, statistically independent speech signals be recovered from only the mixed recordings? ICA answers yes — but only under a specific, checkable condition on the sources that PCA never needs to worry about.
In this lesson
- Learning objectives
- The mixing model
- The two unavoidable ambiguities
- Densities under linear transformations
- The ICA algorithm via maximum likelihood
- Worked example
Before you start
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Financial Machine Learning syllabus.