Skip to content
Linear Algebra, Optimisation and Numerical Methods / Eigenvalue Computation Algorithms

Reduction to Hessenberg Form

Every iterative method in this topic — inverse iteration, and the QR algorithm that follows — requires repeatedly factoring or solving systems involving AA, at O(n3)O(n^3) cost per step for a general dense matrix. This note builds a one-time preprocessing step, Hessenberg reduction, that reduces AA to a form with almost all entries below the first sub-diagonal already zero — after which every subsequent iteration costs only O(n2)O(n^2), a dramatic saving that makes large-scale eigenvalue computation practical at all.
Learning objectives. By the end of this note you should be able to:
  • define Hessenberg form and explain its structural property;
  • explain why Householder reflectors reduce any matrix to Hessenberg form;
  • explain why the reduction is exact (not iterative) and costs only O(n3)O(n^3) once;
  • state the simplification for symmetric matrices (tridiagonal form).

In this lesson

  1. Hessenberg form
  2. The symmetric case: tridiagonal form

Before you start

The full lesson, with worked examples and exercise solutions, is for members.

Read the full lesson

New to SelfMadeQuant.com? See membership options or browse the Linear Algebra, Optimisation and Numerical Methods syllabus.