The claim that "the gradient points in the direction of steepest ascent" is not just a slogan — it has a clean proof using the Cauchy-Schwarz inequality. Similarly, the fact that "the gradient is perpendicular to level curves" follows from a one-line chain-rule argument. Both proofs are short but non-obvious the first time; understanding them makes the gradient intuition durable rather than memorised.
Learning objectives. By the end of this note you should be able to:
- prove that is maximised when using Cauchy-Schwarz;
- prove that is perpendicular to the level curve at any point via the chain rule;
- interpret the shadow price in Lagrange multipliers as the rate of change of the optimum with respect to the constraint — the financial interpretation of the gradient perpendicularity condition.
In this lesson
-
- Proof: The Gradient Is the Steepest Ascent Direction
-
- Proof: The Gradient Is Perpendicular to Level Curves
-
- The Lagrange Condition from Gradient Perpendicularity
-
- Directional Derivative at a Critical Point
Before you start
The full lesson, with worked examples and exercise solutions, is for members.
Read the full lessonNew to SelfMadeQuant.com? See membership options or explore the curriculum.