back to the math tutorial index back to the math tutorial index

Eigenvalues and Eigenvectors

We review here the basics of computing eigenvalues and eigenvectors. Eigenvalues and eigenvectors play a prominent role in the study of ordinary differential equations and in many applications in the physical sciences. Expect to see them come up in a variety of contexts!

Definitions

Let A be an n ×n matrix. The number l is an eigenvalue of A if there exists a non-zero vector v such that

Av = lv.
In this case, vector v is called an eigenvector of A corresponding to l. For each eigenvalue l, the set of all vectors v satisfying Av = lv is called the eigenspace of A corresponding to l.




Computing Eigenvalues and Eigenvectors

We can rewrite the condition Av = lv as
(A- lI)v = 0.
where I is the n ×n identity matrix. Now, in order for a non-zero vector v to satisfy this equation, A -lI must not be invertible.

That is, the determinant of A - lI must equal 0. We call p(l) = det(A - lI) the characteristic polynomial of A. The eigenvalues of A are simply the roots of the characteristic polynomial of A.

Otherwise, if A - lI has an inverse,
(A - lI)-1(A - lI)v
=
(A - l I)-10
v
=
0.
But we are looking for a non-zero vector v.

Example

Let A = é
ê
ê
ë
2
-4
-1
-1
ù
ú
ú
û
. Then
p(l)
=
det é
ê
ê
ë
2-l
-4
-1
-1-l
ù
ú
ú
û
=
(2-l)(-1-l)-(-4)(-1)
=
l2 -l-6
=
(l-3)(l+2).

Thus, l1 = 3 and l2 = -2 are the eigenvalues of A.

To find eigenvectors v = é
ê
ê
ê
ê
ê
ë
v1
v2
:
vn
ù
ú
ú
ú
ú
ú
û
corresponding to an eigenvalue l, we simply solve the system of linear equations given by

(A-lI) v = 0.

Example

The matrix A = é
ê
ê
ë
2
-4
-1
-1
ù
ú
ú
û
of the previous example has eigenvalues l1 = 3 and l2 = -2. Let's find the eigenvectors corresponding to l1 = 3. Let v = [ v1 v2 ]T. Then (A-3I)v = 0 gives us

é
ê
ë
2-3
-4
-1
-1-3
ù
ú
û
é
ê
ë
v1
v2
ù
ú
û
= é
ê
ë
0
0
ù
ú
û
,
from which we obtain the duplicate equations
-v1-4v2
=
0
-v1-4v2
=
0.
That is, {[ -4 1]T} is a basis of the
eigenspace corresponding to l1 = 3.
If we let v2 = t, then v1 = -4t. All eigenvectors corresponding to l1 = 3 are multiples of [ -4 1 ]T and thus the eigenspace corresponding to l1 = 3 is given by the span of [ -4 1 ]T.

Repeating this process with l2 = -2, we find that

4v1 -4V2
=
0
-v1 + v2
=
0
{[ 1 1]T} is a basis for the
eigenspace corresponding to l2 = -2.
If we let v2 = t then v1 = t as well. Thus, an eigenvector corresponding to l2 = -2 is [ 1 1 ]T and the eigenspace corresponding to l2 = -2 is given by the span of [ 1 1 ]T. {[ 1 1]T} is a basis for the eigenspace corresponding tol2 = -2.

In the following example, we see a two-dimensional eigenspace.

Example

Let A = é
ê
ê
ê
ë
5
8
16
4
1
8
-4
-4
-11
ù
ú
ú
ú
û
. Then p(l) = det é
ê
ê
ê
ë
5-l
8
16
4
1-l
8
-4
-4
-11-l
ù
ú
ú
ú
û
=
(l-1)(l+3)2 after some algebra! Thus, l1 = 1 and l2 = -3 are the eigenvalues of A.
Eigenvectors v = é
ê
ê
ê
ê
ë
v1
v2
v3
ù
ú
ú
ú
ú
û
corresponding to l1 = 1 must satisfy

4v1
+
8v2
+
16v3
=
0
4v1
+
8v3
=
0
-4v1
-
4v2
-
12v3
=
0.

[ -2 -1 1 ]T is a basis
for the eigenspace
corresponding to l1 = 1.
Letting v3 = t, we find from the second equation that v1 = -2t, and then v2 = -t. All eigenvectors corresponding to l1 = 1 are multiples of

é
ê
ê
ê
ë
-2
-1
1
ù
ú
ú
ú
û
and so the eigenspace corresponding to l1 = 1 is given by the span of é
ê
ê
ê
ë
-2
-1
1
ù
ú
ú
ú
û
.

Eigenvectors corresponding to l2 = -3 must satisfy

8v1
+
8v2
+
16v3
=
0
4v1
+
4v2
+
8v3
=
0
-4v1
-
4v2
-
8v3
=
0.

The equations here are just multiples of each other! If we let v3 = t and v2 = s, then v1 = -s -2t. Eigenvectors corresponding to l2 = -3 have the form

é
ê
ê
ê
ë
-1
1
0
ù
ú
ú
ú
û
s+ é
ê
ê
ê
ë
-2
0
1
ù
ú
ú
ú
û
t.

{[ -1 1 0]T, [ -2 0 1]T} is a basis for the
eigenspace corresponding to l2 = -3.
Thus, the eigenspace corresponding to l2 = -3 is two-dimensional and is spanned by
é
ê
ê
ê
ë
-1
1
0
ù
ú
ú
ú
û
and é
ê
ê
ê
ë
-2
0
1
ù
ú
ú
ú
û
.

Notes

  • Eigenvalues and eigenvectors can be complex-valued as well as real-valued.

  • The dimension of the eigenspace corresponding to an eigenvalue is less than or equal to the multiplicity of that eigenvalue.

  • The techniques used here are practical for 2 ×2 and 3×3 matrices. Eigenvalues and eigenvectors of larger matrices are often found using other techniques, such as iterative methods.

In the Exploration, you can enter values in a matrix and then discover the eigenvectors and eigenvalues graphically.

Exploration


Key Concepts

Let A be an n ×n matrix. The eigenvalues of A are the roots of the characteristic polynomial

p(l) = det
(A - lI).
For each eigenvalue l, we find eigenvectors v = é
ê
ê
ê
ê
ê
ë
v1
v2
:
vn
ù
ú
ú
ú
ú
ú
û
by solving the linear system
(A - lI)v = 0.
The set of all vectors v satisfying Av = lv is called the eigenspace of A corresponding to l.