Linear Algebra, Live
Strang §6.1 · The characteristic equation

Finding eigenvalues: solve det(A − λI) = 0

Slide 1 tested arrows we had guessed. Now we want a recipe that finds them. Think of tuning an old radio: at most settings of the dial you hear only noise, and at a few settings a station comes in clearly. Here the dial is the number λ. For each λ, look at the matrix A − λI (I is the identity matrix). At most settings it moves the plane without squashing anything. At a few special settings it squashes a whole line of arrows flat onto zero, and that line is an eigenvector line. Lesson 6 gave us the test for "squashed flat": the determinant is zero. So we solve det(A − λI) = 0, the characteristic equation, to get the eigenvalues first. Then we find each eigenvector by elimination.

Lesson 7 · slide 2det(A − λI) = 0
det(A − λI) = 0    λ₁ + λ₂ = trace A (sum of the diagonal)    λ₁ · λ₂ = det A
Key ideas
  1. Ax = λx is the same as (A − λI)x = 0.
  2. A nonzero solution x exists only when A − λI is singular: det(A − λI) = 0. This is the characteristic equation.
  3. For 2 by 2 it is λ² − (trace)λ + det = 0, where the trace is the sum of the diagonal entries.
  4. For each λ, the eigenvectors are the nonzero vectors in the null space of A − λI.

From Ax = λx to (A − λI)x = 0

Move everything to one side. To subtract λx as a matrix times x, write λx = λIx, where I is the identity matrix (lesson 2):

Ax = λx  →  Ax − λx = 0  →  (A − λI)x = 0

A − λI is just A with λ taken off each diagonal entry. A small example with A = 4123 and λ = 5:

A − 5I = −112−2    (A − 5I)(1, 1) = −1 + 12 − 2 = 00

So 11 is sent to zero by A − 5I. That says A11 = 5·11: an eigenvector with λ = 5.

A − λI must squash a line flat

If (A − λI)x = 0 for a nonzero x, then A − λI sends a whole line to the origin. It squashes the plane flat, so its determinant is 0 (lesson 6). Watch A − 5I do exactly that:

A − 5I squashes the square flat onto one line, so its area, the determinant, is 0. The arrow x = 11 shrinks all the way to the origin.

Turning the dial

Try several values of λ and compute det(A − λI) each time. It is zero only at λ = 2 and λ = 5. Those are the eigenvalues.

The matrix A − λI as the dial λ turns. Its determinant passes through zero twice, at λ = 2 and at λ = 5.

The characteristic equation

Instead of trying values, keep λ as a letter and compute the determinant once:

A − λI = 4 − λ123 − λ
det = (4 − λ)(3 − λ) − 1·2 = 12 − 7λ + λ² − 2 = λ² − 7λ + 10
λ² − 7λ + 10 = (λ − 5)(λ − 2) = 0,   so λ = 5 or λ = 2

Check one value from the dial: at λ = 3, 9 − 21 + 10 = −2, the same as in the picture.

Then the eigenvectors

For each λ, solve (A − λI)x = 0 by elimination, like a null space in lesson 4. The matrix is singular, so one row turns into zeros:

Elimination on A − 5I. Row 2 becomes zero, so only one equation is left: −a + b = 0. Any x = aa works; we pick 11.
λ = 5:   A − 5I = −112−2. For x = ab, row 1 says −a + b = 0, so x = 11
λ = 2:   A − 2I = 2121. Row 1 says 2a + b = 0, so x = 1−2
Check: A1−2 = 4 − 22 − 6 = 2−4 = 2·1−2 ✓
The check: A times 1−2 gives 2−4, which is 2 times 1−2. So λ = 2 really goes with 1−2.

Two quick checks: trace and determinant

For A = abcd the equation is always λ² − (a + d)λ + (ad − bc) = 0. The sum a + d of the diagonal is called the trace. So the two eigenvalues add up to the trace and multiply to the determinant:

5 + 2 = 7 = 4 + 3 (the trace) ✓    5 · 2 = 10 = 4·3 − 1·2 (the determinant) ✓

Use these two checks to catch mistakes. They also give the equation fast. For 5412: trace 7, det 10 − 4 = 6, so λ² − 7λ + 6 = (λ − 6)(λ − 1) and λ = 6, 1.

Triangular matrices: read the diagonal

If A is triangular, so is A − λI, and its determinant is the product of the diagonal (lesson 6). So the eigenvalues are simply the diagonal entries:

A = 3401:   det(A − λI) = (3 − λ)(1 − λ),   so λ = 3 and λ = 1

Keep reading with the full course

Finish lesson 7 and you will be able to: tell whether a system settles down or blows up.

Still locked here:

  • The rest of this explanation
  • 4 more examples with step-by-step solutions
  • Five extra members-only problems with worked solutions

$20 once, lifetime access. Lessons 1 to 3 stay free.

Examples

Example 1 · A triangular matrix

A = 1203.

Show solutionHide solution
det(A − λI) = (1 − λ)(3 − λ) − 0
λ = 1 and λ = 3: the diagonal entries

For triangular matrices the eigenvalues sit on the diagonal.

Exercise Fix the quadratic formula so that it gives the two eigenvalues of A. Edit the code and press Run.
slide_2.py Loading Python…
1
Output · Ctrl+Enter runs
Press Run to execute this slide's code. Ctrl+Enter works too.

Questions and comments

Stuck on something, or found a mistake? Ask here and I'll answer. You sign in with GitHub.

The full course

From Ax = b to PCA, by running it

Lessons 1 to 3 are free. Finish all eight and you will be able to:

You get: all 8 lessons with Python labs · every worked example and solution · 5 extra problems per lesson · your progress tracked · answers to your questions · every future update.

$20 once · lifetime access
Continue to checkout →

Already a member? Log in to the course