Math 3A Notes
Total Page:16
File Type:pdf, Size:1020Kb
5. Orthogonality 5.1. The Scalar Product in Euclidean Space 5.1 The Scalar Product in Rn Thusfar we have restricted ourselves to vector spaces and the operations of addition and scalar multiplication: how else might we combine vectors? You should know about the scalar (dot) and cross products of vectors in R3 The scalar product extends nicely to other vector spaces, while the cross product is another story1 The basic purpose of scalar products is to define and analyze the lengths of and angles between vectors2 1But not for this class! You may see ‘wedge’ products in later classes. 2It is important to note that everything in this chapter, until mentioned, only applies to real vector spaces (where F = R) 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Euclidean Space Definition 5.1.1 Suppose x, y Rn are written with respect to the standard 2 basis e ,..., e f 1 ng 1 The scalar product of x, y is the real numbera (x, y) := xTy = x y + x y + + x y 1 1 2 2 ··· n n 2 x, y are orthogonal or perpendicular if (x, y) = 0 3 n-dimensional Euclidean Space Rn is the vector space of n 1 column vectors R × together with the scalar product aOther notations include x y and x, y · h i Euclidean Space is more than just a collection of co-ordinates vectors: it implicitly comes with notions of angle and length3 Important Fact: (y, x) = yTx = (xTy)T = xTy = (x, y) so the scalar product is symmetric 3To be seen in R2 and R3 shortly 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Angles and Lengths Definition 5.1.2 p The length of a vector x Rn is its norm x = (x, x) 2 jj jj The distance between two vectors x, y is given by y x jj − jj y (y1, y2) Theorem 5.1.3 q [0, p] y x The angle between two vectors − 2 y x, y in R2 or R3 satisfies the equation (x , x ) θ 1 2 (x, y) = x y cos q x jj jj jj jj x Definition 5.1.4 We define the angle q between x, y Rn to be the number 2 1 (x, y) q = cos− x y jj jj jj jj 1 q is the smaller of the two possible angles, since cos− has range [0, p] 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Proof of Theorem. If x, y are parallel then q = 0 or p and the Theorem is trivial Otherwise, in R2 (or in the plane 3 Span(x, y) R ), the cosine rule y ≤ (y1, y2) holds: y x − y x y 2 = x 2 + y 2 2 x y cos q jj − jj jj jj jj jj − jj jj jj jj (x , x ) θ 1 2 Applying the definition of norm and scalar product,x we obtain x 2 x y cos q = x 2 + y 2 x y 2 jj jj jj jj jj jj jj jj − jj − jj = xTx + yTy (x y)T(x y) − − − = xTx + yTy (xTx + yTy xTy yTx) − − − = xTy + yTx = 2(x, y) as required 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Basic results & inequalities Several results that you will have used without thinking in elementary geometry follow directly from the definitions Theorem 5.1.5 (Cauchy–Schwarz inequality) If x, y are vectors in Rn then (x, y) x y j j ≤ jj jj jj jj with equality iff x, y are parallel Proof. (x, y) = x y cos q = x y cos q x y j j jj jj jj jj jj jj jj jj j j ≤ jj jj jj jj Equality is satisfied precisely when cos q = 1: that is when ± q = 0, p, and so x, y are parallel 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Theorem 5.1.6 (Triangle inequality) If x, y Rn then x + y x + y 2 jj jj ≤ jj jj jj jj I.e. Any side of a triangle is shorter than the sum of the others y Proof. x + y 2 = (x + y, x + y) = (x + y)T(x + y) jj jj 2 2 = x + 2(x, y) + y y jj jj jj jj 2 2 x + 2 (x, y) + y x + y ≤ jj jj j j jj jj x 2 + 2 x y + y 2 ≤ jj jj jj jj jj jj jj jj 2 = ( x + y ) x jj jj jj jj x If (x, y) = 0, the second line in the proof of the triangle inequality immediately yields Theorem 5.1.7 (Pythagoras’) If x, y Rn are orthogonal then x + y 2 = x 2 + y 2 2 jj jj jj jj jj jj 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Example 1 3 Let x = 2 and y = −1 , then 1 3 − q x = (x, x) = p1 + 4 + 1 = p6 jj jj y = p9 + 1 + 9 = p19 jj jj (x, y) = 3 + 2 3 = 4 − − − 1 (x, y) 1 4 q = cos− = cos− − x y p6p19 jj jj jj jj 1.955 rad 112◦ ≈ ≈ 4 y x = −1 = p33 jj − jj −4 p6 + p19 ≤ 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Projections Scalar products are useful for calculating how much of one vector points in the direction of another Definition 5.1.8 Rn 1 The unit vector in the direction of v is the vector v v 2 jj jj The scalar projection of x onto v = 0 in Rn is 6 the scalar product 1 (v, x) a (x) = v, x = v v v jj jj jj jj x The orthogonal (or vector) projection of x onto v = 0 in Rn is 6 1 (v, x) v pv(x) = av(x) v = 2 v v v πv(x) jj jj jj jj Note: a (x) = p (x) : if a (x) < 0 then the projection of x v 6 jj v jj v onto v points in the opposite direction to v 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Orthogonal projection means several things: 1 p (Rn) (p is a linear map) v 2 L v n 2 pv(R ) = Span(v) (Projection onto Span(v)) 3 pv(v) = v (Identity on Span(v)) 4 ker p = v = y Rn : (y, v) = 0 (Orthogonality) v ? f 2 g 1 , 2 , 3 say that pv is a projection 4 makes the projection orthogonal: any- x thing orthogonal to v is mapped to zero ker πv n v Similarly av (R , R) 2 L πv(x) 5. Orthogonality 5.1. The Scalar Product in Euclidean Space The matrix of a projection Since pv is a linear map, it has a standard matrix representation Indeed (v, x) (v, x) vTx vvT pv(x) = v = v = v = x v 2 v 2 v 2 v 2 jj jj jj jj jj jj jj jj vvT whence the matrix of pv is the n n matrix 2 v × jj jj Example 2 x In R , orthogonal projection onto v = ( y ) has matrix 1 x 1 x2 xy A = (x y) = v x2 + y2 y x2 + y2 xy y2 1 0 Projection onto the x-axis is therefore Ai = 0 0 , while 1 1 1 projection onto the line y = x is Ai+j = 2 1 1 5. Orthogonality 5.1. The Scalar Product in Euclidean Space Planes in R3 Projections are useful for describing planes4 in R3 a Let P be the plane normal to n = b R3 and which passes c 2 x0 through the point with position vector x0 = y0 z0 The distance d of the plane from the origin is the scalar projection of any vector in the plane onto n: thus (x , n) d = a (x ) = 0 n 0 n jj jj ax + by + cz = 0 0 0 pa2 + b2 + c2 4And more general affine spaces in arbitrary dimension 5. Orthogonality 5.1. The Scalar Product in Euclidean Space The plane P is the set of points whose scalar projection onto n is d: otherwise said P = x : a (x) = d = a (x ) f n n 0 g However a (x) = a (x ) a (x x ) = 0 (x x , n) = 0 n n 0 () n − 0 () − 0 a(x x ) + b(y y ) + c(z z ) = 0 () − 0 − 0 − 0 which is an alternative description of the plane Example 7 0 If x0 = 9 , and n = 3 , then P has equation 3 1 3(y 9) + (z 3) = 0 or 3y + z = 30 − − The distance to P is (x0, n) 30 d = an(x0) = = n p10 jj jj 5. Orthogonality 5.1. The Scalar Product in Euclidean Space The distance of a vector y from P is the scalar projection of y onto the normal n with d subtracted: dist(y, P) = a (y) d n − (n, y) = a (x ) n − n 0 jj jj (n, y x ) = − 0 n jj jj Example 3 7 0 If y = 2 , x0 = 9 , and n = 3 , then 1 3 1 23 dist(y, P) = − p10 The negative sign means that y is ‘below’ P (on the opposite side of P to the direction of n) 5. Orthogonality 5.2. Orthogonal subspaces 5.2 Orthogonal subspaces Recall that x, y Rn are orthogonal if (x, y) = xTy = 0 2 Definition 5.2.1 Two subspaces U, V Rn are orthogonal, written U V, iff ≤ ? (u, v) = 0 for all u U, v V 2 2 The orthogonal complement to U in Rn is the subspace n U? := x R : (x, u) = 0, u U f 2 8 2 g E.g.