|
Eigenvalues and Eigenvectors
We review here the basics of computing eigenvalues and eigenvectors.
Eigenvalues and eigenvectors play a prominent role in the study of
ordinary differential equations and in many applications in the
physical sciences. Expect to see them come up in a variety of
contexts!
Definitions
Let A be an n ×n matrix. The number l is an
eigenvalue of A if there exists a non-zero vector v such
that
In this case, vector v is called an eigenvector of A
corresponding to l. For each eigenvalue l, the set of all vectors v satisfying Av = lv is called the eigenspace of A corresponding to l.
Computing Eigenvalues and Eigenvectors
|
We can rewrite the condition Av = lv as
where I is the n ×n identity matrix. Now, in order for a
non-zero vector v to satisfy this equation, A -lI must not be invertible.
That is, the determinant of A - lI must equal 0. We call
p(l) = det(A - lI) the characteristic
polynomial of A. The eigenvalues of A are simply the roots of
the characteristic polynomial of A.
|
|
Otherwise, if A - lI has an inverse,
But we are looking for a non-zero vector v.
|
|
Example
Thus, l1 = 3 and l2 = -2 are the eigenvalues of A.
|
To find eigenvectors v = |
é ê ê
ê ê ê ë |
|
ù ú ú
ú ú ú û |
corresponding to an eigenvalue l, we
simply solve the system of linear equations given by
Example
of the previous example has eigenvalues
l1 = 3 and l2 = -2. Let's find the eigenvectors
corresponding to l1 = 3. Let v = [ v1 v2 ]T. Then (A-3I)v = 0 gives us
|
|
é ê
ë
|
|
ù ú
û
|
|
é ê
ë
|
|
ù ú
û
|
= |
é ê
ë
|
|
ù ú
û
|
, |
|
from which we obtain the duplicate equations
That is, {[ -4 1]T} is a basis of the eigenspace corresponding to l1 = 3. |
If we let v2 = t, then v1 = -4t.
All eigenvectors corresponding to
l1 = 3 are multiples of [ -4 1 ]T and thus
the eigenspace corresponding to l1 = 3 is given by the span of
[ -4 1 ]T.
Repeating this process with l2 = -2, we find that
{[ 1 1]T} is a basis for the eigenspace corresponding to l2 = -2. |
If we let v2 = t then v1 = t as well. Thus, an eigenvector
corresponding to l2 = -2 is [ 1 1 ]T and
the eigenspace corresponding to l2 = -2 is given by the span
of [ 1 1 ]T. {[ 1 1]T} is a basis for the eigenspace corresponding tol2 = -2.
In the following example, we see a two-dimensional eigenspace.
Example
|
Let A = |
é ê ê ê ë |
|
ù ú ú ú û |
. Then p(l) = det |
é ê ê ê ë |
|
ù ú ú ú û |
= |
(l-1)(l+3)2
after some algebra! Thus, l1 = 1 and l2 = -3 are the
eigenvalues of A.
| Eigenvectors v = |
é ê
ê ê ê ë |
|
ù ú
ú ú ú û |
corresponding to l1 = 1 must satisfy |
[ -2 -1 1 ]T is a basis for the eigenspace corresponding to l1 = 1. |
Letting v3 = t, we find from the second equation that v1 = -2t, and
then v2 = -t. All eigenvectors corresponding to l1 = 1 are
multiples of
| and so the eigenspace corresponding to
l1 = 1 is given by the span of |
é ê
ê ê ë |
|
ù ú
ú ú û |
. |
Eigenvectors corresponding to l2 = -3 must satisfy
The equations here are just multiples of each other!
If we let v3 = t and v2 = s, then v1 = -s -2t. Eigenvectors
corresponding to l2 = -3 have the form
|
|
é ê ê
ê ë
|
|
ù ú ú
ú û
|
s+ |
é ê ê
ê ë
|
|
ù ú ú
ú û
|
t. |
|
{[ -1 1 0]T, [ -2 0 1]T} is a basis for the eigenspace corresponding to l2 = -3. |
Thus, the eigenspace corresponding to
l2 = -3
is two-dimensional and is spanned by
é ê
ê ê ë |
|
ù ú
ú ú û |
and |
é ê
ê ê ë |
|
ù ú
ú ú û |
. |
Notes
- Eigenvalues and eigenvectors can be complex-valued as well as
real-valued.
- The dimension of the eigenspace corresponding to an eigenvalue is less than or equal to the multiplicity of that eigenvalue.
- The techniques used here are practical for 2 ×2 and 3×3 matrices. Eigenvalues and eigenvectors of larger matrices
are often found using other techniques, such as iterative methods.
In the Exploration, you can enter values in a matrix and then discover
the eigenvectors and eigenvalues graphically.
Exploration
Key Concepts
Let A be an n ×n matrix. The eigenvalues of A are the
roots of the characteristic polynomial
|
For each eigenvalue l,
we find eigenvectors v = |
é ê
ê ê ê ê ë |
|
ù ú
ú ú ú ú û |
by solving the linear system
The set of all vectors v satisfying Av = lv is called the eigenspace of A corresponding to l.
|
 |