Linear Algebra, Live
Strang §6.1 · Introduction to eigenvalues

Eigenvectors: the arrows a matrix only stretches

Lesson 6 began with a matrix moving the whole plane, like graph paper that stretches, slants or turns. Now draw many arrows on that paper and watch them during the move. Think of a rubber sheet pulled along one diagonal. Most arrows drawn on it turn to a new direction. But a few special arrows keep their direction: they only get longer, get shorter, or flip around. Those special arrows are the eigenvectors of the matrix. The number that says how much each one is stretched is its eigenvalue.

Lesson 7 · slide 1Eigenvectors
Ax = λx    (x ≠ 0)
Key ideas
  1. An eigenvector of A is a nonzero vector x whose direction A keeps: Ax = λx.
  2. The number λ (lambda) is its eigenvalue: the stretch factor along that direction.
  3. λ > 1 stretches, 0 < λ < 1 shrinks, λ < 0 flips the arrow, λ = 0 squashes it to 0.
  4. Any multiple of an eigenvector is again an eigenvector, with the same λ. What matters is the line.

Most arrows turn, a few don't

Take A = 2112 and watch the plane move. The two coloured landmarks, 10 and 01, both turn on their way to the columns 21 and 12. The two faint lines are different. The arrow x₁ = 11 stays on its line and grows. The arrow x₂ = 1−1 stays exactly where it is.

The landmarks turn. The arrows x₁ and x₂ stay on their faint lines: x₁ grows to 3 times its length, x₂ does not change at all.

The equation Ax = λx

"A keeps the direction of x" means Ax is a multiple of x. Call the multiple λ (the Greek letter lambda):

Ax = λx,   with x ≠ 0

The zero vector always works (A0 = 0), so it doesn't count. To test an arrow, multiply and compare:

x = 11:   Ax = 2 + 11 + 2 = 33 = 3·11.   Eigenvector, λ = 3
x = 1−1:   Ax = 2 − 11 − 2 = 1−1 = 1·1−1.   Eigenvector, λ = 1
x = 10:   Ax = 21. Not a multiple of 10: A turned it
The check by rows: A times 11 gives 33. Both entries are 3 times the entries of x, so Ax = 3x.

What the number λ tells you

The eigenvalue says what happens along that line:

  • λ = 3: the arrow gets 3 times longer.
  • λ = ½: it shrinks to half. For 300½, A01 = 0½ = ½·01.
  • λ = −1: it flips to point the other way, with the same length.
  • λ = 0: it is squashed to the zero vector. For 1000, A01 = 00 = 0·01.

A mirror shows two of these at once. The mirror across the line y = x is 0110. Arrows on the mirror line, like x₁ = 11, stay put, so λ = 1. Arrows straight across the mirror, like x₂ = 1−1, flip, so λ = −1:

A11 = 11 = 1·11    A1−1 = −11 = −1·1−1
A mirror. The F flips over. x₁ lies on the mirror and stays (λ = 1). x₂ shrinks through zero and comes out pointing the other way (λ = −1).

A whole line, not one arrow

If x is an eigenvector, so is every multiple of x, with the same λ. For our first A:

A22 = 66 = 3·22    A−1−1 = −3−3 = 3·−1−1

So we really look for eigenvector lines. We name one arrow on each line, like 11, and remember that any multiple works too.

Why the other arrows turn

Any arrow is a mix of the two eigenvectors. Each part is stretched by its own λ, and then the parts are added back. For 10:

10 = ½·11 + ½·1−1
A10 = 3·½·11 + 1·½·1−1 = 1.51.5 + 0.5−0.5 = 21 ✓

The 11 part grew 3 times, the other part didn't. So the sum tips toward 11. That is why 10 turned in the first picture.

Not every matrix has them

A quarter turn moves every arrow by 90°. No arrow stays on its own line, so there is no eigenvector made of ordinary (real) numbers. On slide 2 you will learn the test det(A − λI) = 0 (I is the identity matrix). For this turn it gives λ² + 1 = 0, which no real number solves.

A quarter turn. Every arrow and the whole F turn. No line through the origin stays where it was.

Keep reading with the full course

Finish lesson 7 and you will be able to: tell whether a system settles down or blows up.

Still locked here:

  • The rest of this explanation
  • 4 more examples with step-by-step solutions
  • Five extra members-only problems with worked solutions

$20 once, lifetime access. Lessons 1 to 3 stay free.

Examples

Example 1 · A stretch along the axes

A = 300½.

Show solutionHide solution
A10 = 30 = 3·10:   λ = 3
A01 = 0½ = ½·01:   λ = ½

For a diagonal matrix the eigenvectors are the axes and the eigenvalues are the diagonal entries.

Exercise Find a nonzero v that A only stretches: Av lands on the line through v. Edit the code and press Run.
slide_1.py Loading Python…
1
Output · Ctrl+Enter runs
Press Run to execute this slide's code. Ctrl+Enter works too.

Questions and comments

Stuck on something, or found a mistake? Ask here and I'll answer. You sign in with GitHub.

The full course

From Ax = b to PCA, by running it

Lessons 1 to 3 are free. Finish all eight and you will be able to:

You get: all 8 lessons with Python labs · every worked example and solution · 5 extra problems per lesson · your progress tracked · answers to your questions · every future update.

$20 once · lifetime access
Continue to checkout →

Already a member? Log in to the course