Diagonalisation asked for an eigenvector basis of itself — impossible when isn't square, and unreliable even when it is (a defective matrix has no such basis). This note previews the fix: instead of one basis serving both the domain and codomain of , use two — an orthonormal basis for the domain and a different orthonormal basis for the codomain — chosen so that maps each domain basis vector to a scalar multiple of the matching codomain basis vector. This is the singular value decomposition, and it exists for every matrix, with no exceptions.
Learning objectives. By the end of this note you should be able to:
- state what the SVD is and what , , each represent;
- explain the geometric picture: orthogonal input directions mapping to orthogonal output directions;
- connect the singular values to the eigenvalues of ;
- recognise why the SVD removes every restriction diagonalisation required.
In this lesson
- Motivation: why diagonalisation isn't enough
- The decomposition
- Connection to the eigenvalues of
Before you start
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Linear Algebra, Optimisation and Numerical Methods syllabus.