Linear Algebra, Live
Recap · Reading

What you can now do.

Four ideas from Strang chapter 1, all built on one operation: stretch and add.

Lesson 1 · slide 5Recap
Ax = x₁·(column 1) + x₂·(column 2)
Key ideas
  1. Linear combinations cv + dw are the basic operation.
  2. The dot product v · w multiplies matching parts and adds. It gives lengths, and v · w = 0 means a right angle.
  3. Ax by rows: each row dotted with x. Ax by columns: a combination of the columns. Same answer.
  4. The column space C(A) holds every Ax, and Ax = b is solvable exactly when b is in it.
  • §1.1 Linear combinations. Stretch, then add: steps of v plus steps of w.
  • §1.2 Length and dot product. Multiply matching parts and add. ‖v‖ = √(v · v). Zero means a right angle.
  • §1.3 Matrix times vector. Compute by rows (dot products), think by columns (a combination). The basket: each column is a food, x says how many of each, Ax is the total.
  • §1.3 Column space. Every spot your steps can reach. Ax = b is solvable exactly when b is in C(A).

Next lesson: solving Ax = b (Strang chapter 2)

First, two ways to read a system of equations: as lines that cross, or as columns that combine to b. Then solve it the way a computer does: subtract multiples of one row from another until the matrix is a triangle, and solve from the bottom up. Along the way: how to multiply two matrices, and a way to save the elimination steps so the next system with the same matrix is quick.

Read along

Professor Gilbert Strang, Introduction to Linear Algebra, 5th edition (2016), chapter 1. His MIT 18.06 lectures are free on MIT OpenCourseWare.

Examples

Example 1

A = 1326. Describe C(A). Is 24 in it?

Show solutionHide solution

Column 2 = 3·column 1, so C(A) is the line through 12. 24 = 2·12 is on it, for example x = 20.

Example 2

Find v · w and the lengths for v = 122 and w = 20−1. Are they perpendicular?

Show solutionHide solution

v · w = 2 + 0 − 2 = 0, so yes. ‖v‖ = √(1 + 4 + 4) = 3 and ‖w‖ = √(4 + 0 + 1) = √5.

Example 3

Compute Ax both ways for A = 2111 and x = 11.

Show solutionHide solution

Rows: 2·1 + 1·1 = 3 and 1·1 + 1·1 = 2. Columns: 1·21 + 1·11 = 32. Same answer, 32.

Exercise Free play: try anything, for example combo([[0, 1], [1, 0]], [2, 1]). Edit the code and press Run.
slide_5.py Loading Python…
1
Output · Ctrl+Enter runs
Press Run to execute this slide's code. Ctrl+Enter works too.

Enjoying lesson 1? Get the full course: all 8 lessons through the SVD and PCA, your progress saved lesson by lesson, every solution and 5 extra problems per lesson. $20 once, yours for life.

Questions and comments

Stuck on something, or found a mistake? Ask here and I'll answer. You sign in with GitHub.

The full course

From Ax = b to PCA, by running it

Lessons 1 to 3 are free. Finish all eight and you will be able to:

You get: all 8 lessons with Python labs · every worked example and solution · 5 extra problems per lesson · your progress tracked · answers to your questions · every future update.

$20 once · lifetime access
Continue to checkout →

Already a member? Log in to the course