Linear Algebra, Live
Strang §3.2 · The nullspace of A

The nullspace: finding the inputs that give zero

Slide 1 showed that the column space, the set of all outputs, is a subspace. Now turn to the inputs. Suppose your two kinds of steps are a short step and a double step in the same direction. Take two short steps forward and one double step back, and you are right where you started. Your feet moved, but you went nowhere. Inputs like that, with Ax = 0, are the inputs that do nothing, and all of them together form the nullspace N(A). Standing still, x = 0, is always one of them. If there are others, then two different inputs can give the same output, and whenever Ax = b has a solution, it has many.

Lesson 4 · slide 2Nullspace
N(A) = all x with Ax = 0
Key ideas
  1. N(A) = all solutions of Ax = 0. It always contains x = 0.
  2. N(A) is a subspace: if Ax = 0 and Ay = 0, then A(cx + dy) = 0.
  3. If A is invertible, N(A) contains only 0.
  4. A nonzero x in N(A) is a recipe that mixes the columns into zero, so the columns are dependent: one is a combination of the others (slide 5 says more).

An input that gives zero

Take a matrix whose second column is twice the first: A = 1224.

Try the input x = 2−1: two of column 1, minus one of column 2.

2·12 − 1·24 = 2 − 24 − 4 = 00

The two columns cancel exactly. So 2−1 is in the nullspace.

Walk 2 times column 1 out to 24, then −1 times column 2 straight back. You end at the origin: Ax = 0.

You can also check it row by row, the way lesson 1 taught Ax. Each row of A, dotted with x, must give 0:

row 1: 1·2 + 2·(−1) = 0    row 2: 2·2 + 4·(−1) = 0 ✓

The nullspace is a subspace

If Ax = 0 and Ay = 0, then A(x + y) = Ax + Ay = 0 + 0 = 0, and A(cx) = c·Ax = 0. Sums and multiples stay in. So every multiple c·2−1 also gives zero. For example, c = 3:

A6−3 = (1·6 + 2·(−3), 2·6 + 4·(−3)) = 00 ✓

Here N(A) is a whole line through the origin, and nothing else: Ax = 0 says x₁ + 2x₂ = 0 (row 2 says the same thing, times 2), which is exactly this line. Any nonzero vector on a line can name it: multiples of 2−1 and multiples of −21 are the same line. Later slides use −21.

Every point on this line is an input that does nothing: A sends each cv, with v = 2−1, to 00. This line is N(A).

Look at the row 12 of A. Its dot product with 2−1 is 0, and lesson 1 said that means a right angle. So the nullspace line is perpendicular to the row. Slide 6 shows that this always happens.

What a nullspace vector tells us

Ax = 0 says x₁·(column 1) + x₂·(column 2) = 0. So a nonzero x in N(A) is a recipe that mixes the columns into zero. That means the columns are dependent: one is a combination of the others (slide 5 says more). Here 2·12 − 1·24 = 0 tells us column 2 = 2·column 1.

When only zero gets through

If A is invertible (lesson 3), multiply Ax = 0 by A⁻¹: x = A⁻¹0 = 0. The nullspace is just the zero vector. For a 2×2 matrix, ad − bc ≠ 0 tells us that.

A = 2111:   ad − bc = 2 − 1 = 1 ≠ 0, so N(A) = {0}, the set containing only the zero vector

Then every output comes from exactly one input. A nullspace with more than 0 in it means some different inputs share an output: A40 and A21 are both 48 for our first matrix, because 40 − 21 = 2−1 is in N(A).

Keep reading with the full course

Finish lesson 4 and you will be able to: write down every solution of Ax = b, not just one.

Still locked here:

  • The rest of this explanation
  • 4 more examples with step-by-step solutions
  • Five extra members-only problems with worked solutions

$20 once, lifetime access. Lessons 1 to 3 stay free.

Examples

Example 1 · Equal columns

A = 1111.

Show solutionHide solution
Ax = 0 means x₁ + x₂ = 0
N(A) = all multiples of 1−1
Exercise Find a nonzero x with Ax = 0. Edit the code and press Run.
slide_2.py Loading Python…
1
Output · Ctrl+Enter runs
Press Run to execute this slide's code. Ctrl+Enter works too.

Questions and comments

Stuck on something, or found a mistake? Ask here and I'll answer. You sign in with GitHub.

The full course

From Ax = b to PCA, by running it

Lessons 1 to 3 are free. Finish all eight and you will be able to:

You get: all 8 lessons with Python labs · every worked example and solution · 5 extra problems per lesson · your progress tracked · answers to your questions · every future update.

$20 once · lifetime access
Continue to checkout →

Already a member? Log in to the course