Skip to content
Linear Algebra, Optimisation and Numerical Methods / Solving Linear Systems and Matrix Algebra

Matrix Algebra: Operations, Rules, and the Transpose

The previous note treated elimination steps as matrix multiplications without pinning down the rules that make multiplication well defined. This note supplies them — addition, scalar multiplication, matrix multiplication, and the transpose — and flags the single most consequential fact a newcomer to matrix algebra must internalise: matrix multiplication does not commute. That asymmetry is not a technicality; it is the algebraic shadow of the fact that "apply hedge AA, then rebalance BB" is a genuinely different operation from "rebalance BB, then apply hedge AA." The transpose closes the note by building the object — A⊤AA^\top A — that underlies every covariance matrix in the unit.
Learning objectives. By the end of this note you should be able to:
  • add, scale, and multiply matrices of compatible sizes;
  • state which algebraic laws (associativity, distributivity) hold for matrix multiplication and which (commutativity) generally fail;
  • compute the transpose of a matrix and identify a symmetric matrix;
  • explain why A⊤AA^\top A is always well defined and symmetric, regardless of AA's shape.

In this lesson

  1. Addition and scalar multiplication
  2. Matrix multiplication
  3. The transpose

Before you start

The full lesson, with worked examples and exercise solutions, is for members.

Read the full lesson

New to SelfMadeQuant.com? See membership options or browse the Linear Algebra, Optimisation and Numerical Methods syllabus.