An eigenvector is nonzero and is transformed into a scalar multiple of itself. Least-squares formulas require the stated matrix conditions.
Where this helps
Recognizing the forms used in linear transformations and fitting models.
Before you start
Try the examples to see what you’ll practice. Check the answer form and any stated conditions.
Explainers
An eigenvector keeps its line
Let A = [[2, 0], [0, 5]] and v = (1, 0).
Av = (2, 0) = 2v.
An eigenvector v is a nonzero vector that satisfies Av = λv for a square matrix A. The eigenvalue λ tells how A scales it. A negative λ reverses its direction, and λ = 0 sends it to zero.
Fit by making the residual perpendicular
Fit one constant x to the values 2, 3, and 7. With A = [[1], [1], [1]] and b = (2, 3, 7):
AᵀA = 3, Aᵀb = 12, so 3x̂ = 12 and x̂ = 4.
Least squares chooses x̂ to minimize the sum of squared errors. Its normal equation is AᵀAx̂ = Aᵀb. The residual b − Ax̂ is perpendicular to every column of A.
If A has m rows and n columns, b has m entries and x̂ has n. The equation still holds when AᵀA is singular, though the solution may not be unique. The symbol ᵀ means transpose.
Try a few examples
Real practice. Real progress.
Example 1 of 2
complete the eigenvector equation
v is a nonzero eigenvector of the square matrix A, with eigenvalue λ.