Linear Algebra, Live
Recap · Reading

What you can now do.

You can now find the directions a matrix does not turn, use them to take powers, predict whether a system settles or blows up, and tell a bowl from a saddle.

Lesson 7 · slide 7Recap
Ax = λx    det(A − λI) = 0    A = XΛX⁻¹    symmetric: A = QΛQᵀ
Key ideas
  1. Eigenvectors keep their direction; λ is the stretch.
  2. Eigenvalues solve det(A − λI) = 0; they add to the trace and multiply to det.
  3. A = XΛX⁻¹ makes powers easy; |λ| decides growth or decay.
  4. Symmetric matrices have perpendicular eigenvectors; positive definite means all λ > 0.
  • §6.1 Eigenvectors. The rubber sheet: when a matrix moves the plane, most arrows turn, but a few only get longer, shorter or flipped. Those are the eigenvectors, and the stretch factor is the eigenvalue: Ax = λx. Any multiple of an eigenvector works too, so we look for lines.
  • §6.1 Finding them. The radio dial: turn λ until A − λI squashes a line flat, which means det(A − λI) = 0. Solve that for λ, then use elimination on A − λI to get each eigenvector. Check with the trace (sum of λs) and the determinant (product of λs). A triangular matrix shows its eigenvalues on its diagonal.
  • §6.2 Diagonalizing. The slanted streets: count in eigenvector steps, and A just multiplies each count by its λ. Eigenvectors go in X, eigenvalues in Λ, in the same order: A = XΛX⁻¹. Powers are easy, Aᵏ = XΛᵏX⁻¹. A shear has too few eigenvectors and can't be diagonalized.
  • §6.2 Powers and stability. The two jars and the two cities: every step multiplies each eigenvector part by its λ. Parts with |λ| < 1 die out, |λ| > 1 grow, λ = 1 stays. A Markov matrix always has λ = 1, and its eigenvector, scaled to add to 1, is the steady state as shares. For head counts, multiply by the total (the same total as u₀).
  • §6.4 Symmetric matrices. The pizza dough pulled two ways: real eigenvalues and perpendicular eigenvectors. Unit eigenvectors make an orthogonal Q, so A = QΛQᵀ, a sum of stretched projections λqqᵀ.
  • §6.5 Positive definite. The marble in a bowl: all eigenvalues positive, xᵀAx > 0 for every nonzero x, all pivots positive. One negative eigenvalue makes a saddle.

Next lesson: the singular value decomposition (Strang chapter 7)

Eigenvectors only work for square matrices, and they may not be perpendicular. The SVD fixes both: every matrix, even a rectangular one, turns a circle into an ellipse along perpendicular axes. It does for every matrix what A = QΛQᵀ does for symmetric ones, and it leads to image compression and PCA.

Read along

Keep reading with the full course

Finish lesson 7 and you will be able to: tell whether a system settles down or blows up.

Still locked here:

  • The rest of this explanation
  • 2 more examples with step-by-step solutions
  • Five extra members-only problems with worked solutions

$20 once, lifetime access. Lessons 1 to 3 stay free.

Examples

Example 1

Find the eigenvalues and eigenvectors of 6223.

Show solutionHide solution

Trace 9, det 14. λ² − 9λ + 14 = (λ − 7)(λ − 2).   λ = 7: x = 21.   λ = 2: x = 1−2. Perpendicular, as for every symmetric matrix.

Exercise Free play: try eigpic(A, v) on matrices of your own and drag v until the line turns green. Edit the code and press Run.
slide_7.py Loading Python…
1
Output · Ctrl+Enter runs
Press Run to execute this slide's code. Ctrl+Enter works too.

Questions and comments

Stuck on something, or found a mistake? Ask here and I'll answer. You sign in with GitHub.

The full course

From Ax = b to PCA, by running it

Lessons 1 to 3 are free. Finish all eight and you will be able to:

You get: all 8 lessons with Python labs · every worked example and solution · 5 extra problems per lesson · your progress tracked · answers to your questions · every future update.

$20 once · lifetime access
Continue to checkout →

Already a member? Log in to the course