i i “main” 2007/2/16 page 281 i i
4.6 Bases and Dimension 281
2 3 40. (a) Show that {1,x,x ,x } is linearly independent (a) If n>m, prove that {u1, u2,...,un} is linearly on every interval. dependent on V . k (b) If fk(x) = x for k = 0, 1,...,n, show that (b) If n = m, prove that {u1, u2,...,un} is linearly {f0,f1,...,fn} is linearly independent on every independent in V if and only if det[aij ] = 0. interval for all fixed n. (c) If n
4.6 Bases and Dimension
The results of the previous section show that if a minimal spanning set exists in a (nontrivial) vector space V , it cannot be linearly dependent. Therefore if we are looking for minimal spanning sets for V , we should focus our attention on spanning sets that are linearly independent. One of the results of this section establishes that every spanning set for V that is linearly independent is indeed a minimal spanning set. Such a set will be
i i
i i i i “main” 2007/2/16 page 282 i i
282 CHAPTER 4 Vector Spaces
called a basis. This is one of the most important concepts in this text and a cornerstone of linear algebra.
DEFINITION 4.6.1 4 A set of vectors {v1, v2,...,vk} in a vector space V is called a basis for V if (a) The vectors are linearly independent.
(b) The vectors span V .
Notice that if we have a finite spanning set for a vector space, then we can always, in principle, determine a basis for V by using the technique of Corollary 4.5.12. Fur- thermore, the computational aspects of determining a basis have been covered in the previous two sections, since all we are really doing is combining the two concepts of linear independence and linear span. Consequently, this section is somewhat more the- oretically oriented than the preceding ones. The reader is encouraged not to gloss over the theoretical aspects, as these really are fundamental results in linear algebra. There do exist vector spaces V for which it is impossible to find a finite set of linearly independent vectors that span V . The vector space Cn(I), n ≥ 1, is such an example (Example 4.6.19). Such vector spaces are called infinite-dimensional vector spaces. Our primary interest in this text, however, will be vector spaces that contain a finite span- ning set of linearly independent vectors. These are known as finite-dimensional vector spaces, and we will encounter numerous examples of them throughout the remainder of this section. n 2 We begin with the vector space R .InR , the most natural basis, denoted {e1, e2}, consists of the two vectors
e1 = (1, 0), e2 = (0, 1), (4.6.1)
3 and in R , the most natural basis, denoted {e1, e2, e3}, consists of the three vectors
e1 = (1, 0, 0), e2 = (0, 1, 0), e3 = (0, 0, 1). (4.6.2)
The verification that the sets (4.6.1) and (4.6.2) are indeed bases of R2 and R3, respec- tively, is straightforward and left as an exercise.5 These bases are referred to as the standard basis on R2 and R3, respectively. In the case of the standard basis for R3 given in (4.6.2), we recognize the vectors e1, e2, e3 as the familiar unit vectors i, j, k pointing along the positive x-, y-, and z-axes of the rectangular Cartesian coordinate system. n More generally, consider the set of vectors {e1, e2,...,en} in R defined by
e1 = (1, 0,...,0), e2 = (0, 1,...,0), ..., en = (0, 0,...,1).
These vectors are linearly independent by Corollary 4.5.15, since
det([e1, e2,...,en]) = det(In) = 1 = 0.
n n Furthermore, the vectors span R , since an arbitrary vector v = (x1,x2,...,xn) in R can be written as
v = x1(1, 0,...,0) + x2(0, 1,...,0) +···+xn(0, 0,...,1) = x1e1 + x2e2 +···+xnen.
4 The plural of basis is bases. 5Alternatively, the verification is a special case of that given shortly for the general case of Rn.
i i
i i i i “main” 2007/2/16 page 283 i i
4.6 Bases and Dimension 283
n Consequently, {e1, e2,...,en} is a basis for R . We refer to this basis as the standard basis for Rn. The general vector in Rn has n components, and the standard basis vectors arise as the n vectors that are obtained by sequentially setting one component to the value 1 and the other components to 0. In general, this is how we obtain standard bases in vector spaces whose vectors are determined by the specification of n independent constants. We illustrate with some examples.
Example 4.6.2 Determine the standard basis for M2(R).
Solution: The general matrix in M2(R) is ab . cd
Consequently, there are four independent parameters that give rise to four special vectors in M2(R). Sequentially setting one of these parameters to the value 1 and the others to 0 generates the following four matrices: 10 01 00 00 A = ,A= ,A= ,A= . 1 00 2 00 3 10 4 01
We see that {A1,A2,A3,A4} is a spanning set for M2(R). Furthermore,
c1A1 + c2A2 + c3A3 + c4A4 = 02
holds if and only if 10 01 00 00 00 c + c + c + c = 1 00 2 00 3 10 4 01 00
—that is, if and only if c1 = c2 = c3 = c4 = 0. Consequently, {A1,A2,A3,A4} is a linearly independent spanning set for M2(R), hence it is a basis. This is the standard basis for M2(R).
Remark More generally, consider the vector space of all m × n matrices with real entries, Mm×n(R).IfweletEij denote the m×n matrix with value 1 in the (i, j)-position and zeros elsewhere, then we can show routinely that
{Eij : 1 ≤ i ≤ m, 1 ≤ j ≤ n}
is a basis for Mm×n(R), and it is the standard basis.
Example 4.6.3 Determine the standard basis for P2. Solution: We have
2 P2 ={a0 + a1x + a2x : a0,a1,a2 ∈ R},
so that the vectors in P2 are determined by specifying values for the three parameters a0,a1, and a2. Sequentially setting one of these parameters to the value 1 and the other two to the value 0 yields the following vectors in P2:
2 p0(x) = 1,p1(x) = x, p2(x) = x .
i i
i i i i “main” 2007/2/16 page 284 i i
284 CHAPTER 4 Vector Spaces
We have shown in Example 4.4.6 that {p0,p1,p2} is a spanning set for P2. Furthermore, 1 xx2 W[p0,p1,p2](x) = 012x = 2 = 0, 00 2
6 which implies that {p0,p1,p2} is linearly independent on any interval. Consequently, {p0,p1,p2} is a basis for P2. This is the standard basis for P2.
Remark More generally, the reader can check that the standard basis for the vector space of all polynomials of degree n or less, Pn,is {1,x,x2,...,xn}.
Dimension of a Finite-Dimensional Vector Space The reader has probably realized that there can be many different bases for a given 3 vector space V . In addition to the standard basis {e1, e2, e3} on R , for example, it can be checked7 that {(1, 2, 3), (4, 5, 6), (7, 8, 8)} and {(1, 0, 0), (1, 1, 0), (1, 1, 1)} are also bases for R3. And there are countless others as well. Despite the multitude of different bases available for a vector space V , they all share one common feature: the number of vectors in each basis for V is the same. This fact will be deduced as a corollary of our next theorem, a fundamental result in the theory of vector spaces.
Theorem 4.6.4 If a finite-dimensional vector space has a basis consisting of m vectors, then any set of more than m vectors is linearly dependent.
Proof Let {v1, v2,...,vm} be a basis for V , and consider an arbitrary set of vectors in V , say, {u1, u2,...,un}, with n>m.Wewishtoprovethat{u1, u2,...,un} is necessarily linearly dependent. Since {v1, v2,...,vm} is a basis for V , it follows that each uj can be written as a linear combination of v1, v2,...,vm. Thus, there exist constants aij such that
u1 = a11v1 + a21v2 + ··· + am1vm, u2 = a12v1 + a22v2 + ··· + am2vm, . . un = a1nv1 + a2nv2 + ··· + amnvm.
To prove that {u1, u2,...,un} is linearly dependent, we must show that there exist scalars c1,c2,...,cn, not all zero, such that
c1u1 + c2u2 +···+cnun = 0. (4.6.3)
Inserting the expressions for u1, u2,...,un into Equation (4.6.3) yields
c1(a11v1 + a21v2 +···+am1vm) + c2(a12v1 + a22v2 +···+am2vm) +···+cn(a1nv1 + a2nv2 +···+amnvm) = 0.
6 Alternatively, we can start with the equation c0p0(x) + c1p1(x) + c2p2(x) = 0 for all x in R and show readily that c0 = c1 = c2 = 0. 7The reader desiring extra practice at the computational aspects of verifying a basis is encouraged to pause here to check these examples.
i i
i i i i “main” 2007/2/16 page 285 i i
4.6 Bases and Dimension 285
Rearranging terms, we have
(a11c1 + a12c2 +···+a1ncn)v1 + (a21c1 + a22c2 +···+a2ncn)v2 +···+(am1c1 + am2c2 +···+amncn)vm = 0.
Since {v1, v2,...,vm} is linearly independent, we can conclude that
a11c1 + a12c2 + ··· + a1ncn = 0, a21c1 + a22c2 + ··· + a2ncn = 0, . . am1c1 + am2c2 + ··· + amncn = 0. Thisisanm × n homogeneous system of linear equations with m Corollary 4.6.5 All bases in a finite-dimensional vector space V contain the same number of vectors. Proof Suppose {v1, v2,...,vn} and {u1, u2,...,um} are two bases for V . From The- orem 4.6.4 we know that we cannot have m>n(otherwise {u1, u2,...,um} would be a linearly dependent set and hence could not be a basis for V ). Nor can we have n>m (otherwise {v1, v2,...,vn} would be a linearly dependent set and hence could not be a basis for V ). Thus, it follows that we must have m = n. We can now prove that any basis provides a minimal spanning set for V . Corollary 4.6.6 If a finite-dimensional vector space V has a basis consisting of n vectors, then any spanning set must contain at least n vectors. Proof If the spanning set contained fewer than n vectors, then there would be a subset of less than n linearly independent vectors that spanned V ; that is, there would be a basis consisting of less than n vectors. But this would contradict the previous corollary. The number of vectors in a basis for a finite-dimensional vector space is clearly a fundamental property of the vector space, and by Corollary 4.6.5 it is independent of the particular chosen basis. We call this number the dimension of the vector space. DEFINITION 4.6.7 The dimension of a finite-dimensional vector space V , written dim[V ], is the number of vectors in any basis for V .IfV is the trivial vector space, V ={0}, then we define its dimension to be zero. Remark We say that the dimension of the world we live in is three for the very reason that the maximum number of independent directions that we can perceive is three. If a vector space has a basis containing n vectors, then from Theorem 4.6.4, the maximum number of vectors in any linearly independent set is n. Thus, we see that the terminology dimension used in an arbitrary vector space is a generalization of a familiar idea. 3 Example 4.6.8 It follows from our examples earlier in this section that dim[R ]=3, dim[M2(R)]=4, and dim[P2]=3. i i i i i i “main” 2007/2/16 page 286 i i 286 CHAPTER 4 Vector Spaces More generally, the following dimensions should be remembered: n 2 dim[R ]=n, dim[Mm×n(R)]=mn, dim[Mn(R)]=n , dim[Pn]=n + 1. These values have essentially been established previously in our discussion of standard n bases. The standard basis for R is {e1, e2,...,en}, where ei is the n-tuple with value 1intheith position and value 0 elsewhere. Thus, this basis contains n vectors. The standard basis for Mm×n(R) is the set of matrices Eij (1 ≤ i ≤ m,1≤ j ≤ n) with value1inthe(i, j) position and value 0 elsewhere. There are mn such matrices in this standard basis. The case of Mn(R) is just a special case of Mm×n(R) in which m = n. 2 n Finally, the standard basis for Pn is {1,x,x ,...,x }, a set of n + 1 vectors. Next, let us return once more to Example 1.2.16 to cast its results in terms of the basis concept. Example 4.6.9 Determine a basis for the solution space to the differential equation