Every iterative method in this topic — inverse iteration, and the QR algorithm that follows — requires repeatedly factoring or solving systems involving , at cost per step for a general dense matrix. This note builds a one-time preprocessing step, Hessenberg reduction, that reduces to a form with almost all entries below the first sub-diagonal already zero — after which every subsequent iteration costs only , a dramatic saving that makes large-scale eigenvalue computation practical at all.
Learning objectives. By the end of this note you should be able to:
- define Hessenberg form and explain its structural property;
- explain why Householder reflectors reduce any matrix to Hessenberg form;
- explain why the reduction is exact (not iterative) and costs only once;
- state the simplification for symmetric matrices (tridiagonal form).
In this lesson
- Hessenberg form
- The symmetric case: tridiagonal form
Before you start
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or browse the Linear Algebra, Optimisation and Numerical Methods syllabus.