Norm and Inner Products in Cn, and Abstract Inner Product Spaces Math 130 Linear Algebra

Total Page:16

File Type:pdf, Size:1020Kb

Norm and Inner Products in Cn, and Abstract Inner Product Spaces Math 130 Linear Algebra when c is a complex number and v is a complex vector. Furthermore, the triangle inequality for complex norms holds kv − wk ≤ kvk + kwk: Norm and inner products in Cn, We'll prove it later. and abstract inner product spaces Math 130 Linear Algebra The inner product hvjwi of two complex vec- D Joyce, Fall 2015 tors. We would like to have a complex inner product that (1) extends the real product, (2) is We've seen how norms and inner products work connected to the complex norm by the equation n n in R . They can also be defined for C . There's a kvk2 = hvjvi, and (3) has nice algebraic properties wrinkle in the definition of complex inner products. such as bilinearity. In order to get property (2), we'll have to intro- The norm of a complex vector v. We'll start duce a wrinkle into the definition. We cannot de- with the norm for C which is the one-dimensional fine h(v1; : : : ; vn)j(w1; : : : ; wn)i as v1w1 +···+vnwn, 1 vector space C , and extend it to higher dimen- because then h(v1; : : : ; vn)j(v1; : : : ; vn)i would equal 2 2 2 2 sions. v1 + ··· + vn which doesn't equal jv1j + ··· + jvnj . Recall that if z = x + iy is a complex number If we throw in a complex conjugate, however, it will with real part x and imaginary part y, the complex work. That explains the following definition. conjugate of z is defined as z = x − iy, and the absolute value, also called the norm, of z is defined Definition 1. The standard complex inner prod- uct of two vectors v and w in Cn is defined by as p p 2 2 jzj = x + y = z z: hvjwi = h(v1; v2; : : : ; vn)j(w1; w2; : : : ; wn)i n n Now, if v = (v1; v2; : : : ; vn) is a vector in C X = v1w1 + v2w2 + ··· + vnwn = vkwk where each vi is a complex number, we'll define its k=1 norm kvk as It follows that for each v 2 Cn, our desired con- kvk = k(v1; v2; : : : ; vn)k dition (2) above, holds v u n kvk2 = hvjvi: p 2 2 2 uX 2 = jv1j + jv2j + ··· + jvnj = t jvkj : k=1 Also, condition (1) holds. If v and w happen to be a real vectors, then their complex inner product is Note that if the coordinates of v all happen to be the same as their real inner product. real numbers, then this definition agrees with the Most of the algebraic properties of complex inner norm for real vector spaces. products are the same as those of real inner prod- Norms on Cn enjoy many of the same properties uct. For instance, inner products distribute over that norms on Rn do. For instance, the norm of addition, any vector is nonnegative, and the only vector with norm 0 is the 0 vector. Also, norms are multiplica- hujv + wi = hujvi + hujwi; tive in the sense that and over subtraction, kcvk = jcj kvk hujv − wi = hujvi − hujwi; 1 and the inner product of any vector and the 0 vec- (d). hvjvi > 0 if v 6= 0. tor is 0 For an inner product space, the norm of a vector v hvj0i = 0: is defined as kvk = phvjvi. However, complex inner products are not com- Note that when F = R, condition (c) simply says mutative. Instead they have the property that the inner product is commutative. hujvi = hvjui: Properties (a) and (b) state that the inner prod- uct is linear in the first argument. Using those and Complex inner products are linear in their first (c), you can show that the inner product is conju- argument. If c is a complex scalar, then gate linear in the second argument. Condition (d) says that the norm kvk of a vector hcujvi = chujvi is always positive except in the one case the that v = 0. From condition (b) you can infer k0k = 0. In for the second argument, we have instead Another property of norms is that kcvk = jcj kvk. Finally, two more properties of inner products are hujcvi = chujvi: the Cauchy-Schwarz inequality jhvjwij ≤ kvk kwk, and the triangle inequality kv + wk ≤ kvk + kwk. The complex conjugate of c comes from our defini- We'll prove them later. tion where we use the complex conjugates of coor- dinates of the second vector. Examples. The standard inner products on Rn In summary, complex inner products are not bi- n linear, but they are linear in the first argument and and C are, of course, the primary examples of in- conjugate linear in the second argument. ner product spaces. Our text describes some other inner product spaces besides the standard ones Rn and Cn. One Abstract linear spaces. So far, we've looked at is a real inner product on the vector space of con- the standard real inner product on Rn and the stan- tinuous real-valued functions on [0; 1]. Another is dard complex inner product on Cn. Although we're an inner product on m × n matrices over either R primarily concerned with standard inner products, or C. We'll discuss those briefly in class. There's there are other inner products, and we should con- another example of the vector space of complex- sider the generalization of these standard inner valued functions on the unit circle we won't have products. We'll call a vector space equipped with time for. an inner product an inner product space. We can make the definitions for abstract inner Math 130 Home Page at product spaces for both the real case and the com- http://math.clarku.edu/~ma130/ plex case at the same time. In the definition, we'll take the scalar field F to be either R or C. Definition 2. An inner product space over F is a vector space V over F equipped with a function V × V ! F that assigns to vectors v and w in V a scalar denoted hvjwi, called the inner product of v and w, which satisfies the following four conditions: (a). hu + vjwi = hujwi + hujwi, (b). hcvjwi = chvjwi, (c). hvjwi = hwjvi, and 2.
Recommended publications
  • Math 651 Homework 1 - Algebras and Groups Due 2/22/2013
    Math 651 Homework 1 - Algebras and Groups Due 2/22/2013 1) Consider the Lie Group SU(2), the group of 2 × 2 complex matrices A T with A A = I and det(A) = 1. The underlying set is z −w jzj2 + jwj2 = 1 (1) w z with the standard S3 topology. The usual basis for su(2) is 0 i 0 −1 i 0 X = Y = Z = (2) i 0 1 0 0 −i (which are each i times the Pauli matrices: X = iσx, etc.). a) Show this is the algebra of purely imaginary quaternions, under the commutator bracket. b) Extend X to a left-invariant field and Y to a right-invariant field, and show by computation that the Lie bracket between them is zero. c) Extending X, Y , Z to global left-invariant vector fields, give SU(2) the metric g(X; X) = g(Y; Y ) = g(Z; Z) = 1 and all other inner products zero. Show this is a bi-invariant metric. d) Pick > 0 and set g(X; X) = 2, leaving g(Y; Y ) = g(Z; Z) = 1. Show this is left-invariant but not bi-invariant. p 2) The realification of an n × n complex matrix A + −1B is its assignment it to the 2n × 2n matrix A −B (3) BA Any n × n quaternionic matrix can be written A + Bk where A and B are complex matrices. Its complexification is the 2n × 2n complex matrix A −B (4) B A a) Show that the realification of complex matrices and complexifica- tion of quaternionic matrices are algebra homomorphisms.
    [Show full text]
  • Introduction Into Quaternions for Spacecraft Attitude Representation
    Introduction into quaternions for spacecraft attitude representation Dipl. -Ing. Karsten Groÿekatthöfer, Dr. -Ing. Zizung Yoon Technical University of Berlin Department of Astronautics and Aeronautics Berlin, Germany May 31, 2012 Abstract The purpose of this paper is to provide a straight-forward and practical introduction to quaternion operation and calculation for rigid-body attitude representation. Therefore the basic quaternion denition as well as transformation rules and conversion rules to or from other attitude representation parameters are summarized. The quaternion computation rules are supported by practical examples to make each step comprehensible. 1 Introduction Quaternions are widely used as attitude represenation parameter of rigid bodies such as space- crafts. This is due to the fact that quaternion inherently come along with some advantages such as no singularity and computationally less intense compared to other attitude parameters such as Euler angles or a direction cosine matrix. Mainly, quaternions are used to • Parameterize a spacecraft's attitude with respect to reference coordinate system, • Propagate the attitude from one moment to the next by integrating the spacecraft equa- tions of motion, • Perform a coordinate transformation: e.g. calculate a vector in body xed frame from a (by measurement) known vector in inertial frame. However, dierent references use several notations and rules to represent and handle attitude in terms of quaternions, which might be confusing for newcomers [5], [4]. Therefore this article gives a straight-forward and clearly notated introduction into the subject of quaternions for attitude representation. The attitude of a spacecraft is its rotational orientation in space relative to a dened reference coordinate system.
    [Show full text]
  • Functional Analysis 1 Winter Semester 2013-14
    Functional analysis 1 Winter semester 2013-14 1. Topological vector spaces Basic notions. Notation. (a) The symbol F stands for the set of all reals or for the set of all complex numbers. (b) Let (X; τ) be a topological space and x 2 X. An open set G containing x is called neigh- borhood of x. We denote τ(x) = fG 2 τ; x 2 Gg. Definition. Suppose that τ is a topology on a vector space X over F such that • (X; τ) is T1, i.e., fxg is a closed set for every x 2 X, and • the vector space operations are continuous with respect to τ, i.e., +: X × X ! X and ·: F × X ! X are continuous. Under these conditions, τ is said to be a vector topology on X and (X; +; ·; τ) is a topological vector space (TVS). Remark. Let X be a TVS. (a) For every a 2 X the mapping x 7! x + a is a homeomorphism of X onto X. (b) For every λ 2 F n f0g the mapping x 7! λx is a homeomorphism of X onto X. Definition. Let X be a vector space over F. We say that A ⊂ X is • balanced if for every α 2 F, jαj ≤ 1, we have αA ⊂ A, • absorbing if for every x 2 X there exists t 2 R; t > 0; such that x 2 tA, • symmetric if A = −A. Definition. Let X be a TVS and A ⊂ X. We say that A is bounded if for every V 2 τ(0) there exists s > 0 such that for every t > s we have A ⊂ tV .
    [Show full text]
  • HYPERCYCLIC SUBSPACES in FRÉCHET SPACES 1. Introduction
    PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 134, Number 7, Pages 1955–1961 S 0002-9939(05)08242-0 Article electronically published on December 16, 2005 HYPERCYCLIC SUBSPACES IN FRECHET´ SPACES L. BERNAL-GONZALEZ´ (Communicated by N. Tomczak-Jaegermann) Dedicated to the memory of Professor Miguel de Guzm´an, who died in April 2004 Abstract. In this note, we show that every infinite-dimensional separable Fr´echet space admitting a continuous norm supports an operator for which there is an infinite-dimensional closed subspace consisting, except for zero, of hypercyclic vectors. The family of such operators is even dense in the space of bounded operators when endowed with the strong operator topology. This completes the earlier work of several authors. 1. Introduction and notation Throughout this paper, the following standard notation will be used: N is the set of positive integers, R is the real line, and C is the complex plane. The symbols (mk), (nk) will stand for strictly increasing sequences in N.IfX, Y are (Hausdorff) topological vector spaces (TVSs) over the same field K = R or C,thenL(X, Y ) will denote the space of continuous linear mappings from X into Y , while L(X)isthe class of operators on X,thatis,L(X)=L(X, X). The strong operator topology (SOT) in L(X) is the one where the convergence is defined as pointwise convergence at every x ∈ X. A sequence (Tn) ⊂ L(X, Y )issaidtobeuniversal or hypercyclic provided there exists some vector x0 ∈ X—called hypercyclic for the sequence (Tn)—such that its orbit {Tnx0 : n ∈ N} under (Tn)isdenseinY .
    [Show full text]
  • Calculus Terminology
    AP Calculus BC Calculus Terminology Absolute Convergence Asymptote Continued Sum Absolute Maximum Average Rate of Change Continuous Function Absolute Minimum Average Value of a Function Continuously Differentiable Function Absolutely Convergent Axis of Rotation Converge Acceleration Boundary Value Problem Converge Absolutely Alternating Series Bounded Function Converge Conditionally Alternating Series Remainder Bounded Sequence Convergence Tests Alternating Series Test Bounds of Integration Convergent Sequence Analytic Methods Calculus Convergent Series Annulus Cartesian Form Critical Number Antiderivative of a Function Cavalieri’s Principle Critical Point Approximation by Differentials Center of Mass Formula Critical Value Arc Length of a Curve Centroid Curly d Area below a Curve Chain Rule Curve Area between Curves Comparison Test Curve Sketching Area of an Ellipse Concave Cusp Area of a Parabolic Segment Concave Down Cylindrical Shell Method Area under a Curve Concave Up Decreasing Function Area Using Parametric Equations Conditional Convergence Definite Integral Area Using Polar Coordinates Constant Term Definite Integral Rules Degenerate Divergent Series Function Operations Del Operator e Fundamental Theorem of Calculus Deleted Neighborhood Ellipsoid GLB Derivative End Behavior Global Maximum Derivative of a Power Series Essential Discontinuity Global Minimum Derivative Rules Explicit Differentiation Golden Spiral Difference Quotient Explicit Function Graphic Methods Differentiable Exponential Decay Greatest Lower Bound Differential
    [Show full text]
  • How to Enter Answers in Webwork
    Introduction to WeBWorK 1 How to Enter Answers in WeBWorK Addition + a+b gives ab Subtraction - a-b gives ab Multiplication * a*b gives ab Multiplication may also be indicated by a space or juxtaposition, such as 2x, 2 x, 2*x, or 2(x+y). Division / a a/b gives b Exponents ^ or ** a^b gives ab as does a**b Parentheses, brackets, etc (...), [...], {...} Syntax for entering expressions Be careful entering expressions just as you would be careful entering expressions in a calculator. Sometimes using the * symbol to indicate multiplication makes things easier to read. For example (1+2)*(3+4) and (1+2)(3+4) are both valid. So are 3*4 and 3 4 (3 space 4, not 34) but using an explicit multiplication symbol makes things clearer. Use parentheses (), brackets [], and curly braces {} to make your meaning clear. Do not enter 2/4+5 (which is 5 ½ ) when you really want 2/(4+5) (which is 2/9). Do not enter 2/3*4 (which is 8/3) when you really want 2/(3*4) (which is 2/12). Entering big quotients with square brackets, e.g. [1+2+3+4]/[5+6+7+8], is a good practice. Be careful when entering functions. It is always good practice to use parentheses when entering functions. Write sin(t) instead of sint or sin t. WeBWorK has been programmed to accept sin t or even sint to mean sin(t). But sin 2t is really sin(2)t, i.e. (sin(2))*t. Be careful. Be careful entering powers of trigonometric, and other, functions.
    [Show full text]
  • Calculus Formulas and Theorems
    Formulas and Theorems for Reference I. Tbigonometric Formulas l. sin2d+c,cis2d:1 sec2d l*cot20:<:sc:20 +.I sin(-d) : -sitt0 t,rs(-//) = t r1sl/ : -tallH 7. sin(A* B) :sitrAcosB*silBcosA 8. : siri A cos B - siu B <:os,;l 9. cos(A+ B) - cos,4cos B - siuA siriB 10. cos(A- B) : cosA cosB + silrA sirrB 11. 2 sirrd t:osd 12. <'os20- coS2(i - siu20 : 2<'os2o - I - 1 - 2sin20 I 13. tan d : <.rft0 (:ost/ I 14. <:ol0 : sirrd tattH 1 15. (:OS I/ 1 16. cscd - ri" 6i /F tl r(. cos[I ^ -el : sitt d \l 18. -01 : COSA 215 216 Formulas and Theorems II. Differentiation Formulas !(r") - trr:"-1 Q,:I' ]tra-fg'+gf' gJ'-,f g' - * (i) ,l' ,I - (tt(.r))9'(.,') ,i;.[tyt.rt) l'' d, \ (sttt rrJ .* ('oqI' .7, tJ, \ . ./ stll lr dr. l('os J { 1a,,,t,:r) - .,' o.t "11'2 1(<,ot.r') - (,.(,2.r' Q:T rl , (sc'c:.r'J: sPl'.r tall 11 ,7, d, - (<:s<t.r,; - (ls(].]'(rot;.r fr("'),t -.'' ,1 - fr(u") o,'ltrc ,l ,, 1 ' tlll ri - (l.t' .f d,^ --: I -iAl'CSllLl'l t!.r' J1 - rz 1(Arcsi' r) : oT Il12 Formulas and Theorems 2I7 III. Integration Formulas 1. ,f "or:artC 2. [\0,-trrlrl *(' .t "r 3. [,' ,t.,: r^x| (' ,I 4. In' a,,: lL , ,' .l 111Q 5. In., a.r: .rhr.r' .r r (' ,l f 6. sirr.r d.r' - ( os.r'-t C ./ 7. /.,,.r' dr : sitr.i'| (' .t 8. tl:r:hr sec,rl+ C or ln Jccrsrl+ C ,f'r^rr f 9.
    [Show full text]
  • Supplement 1: Toolkit Functions
    Supplement 1: Toolkit Functions What is a Function? The natural world is full of relationships between quantities that change. When we see these relationships, it is natural for us to ask “If I know one quantity, can I then determine the other?” This establishes the idea of an input quantity, or independent variable, and a corresponding output quantity, or dependent variable. From this we get the notion of a functional relationship in which the output can be determined from the input. For some quantities, like height and age, there are certainly relationships between these quantities. Given a specific person and any age, it is easy enough to determine their height, but if we tried to reverse that relationship and determine age from a given height, that would be problematic, since most people maintain the same height for many years. Function Function: A rule for a relationship between an input, or independent, quantity and an output, or dependent, quantity in which each input value uniquely determines one output value. We say “the output is a function of the input.” Function Notation The notation output = f(input) defines a function named f. This would be read “output is f of input” Graphs as Functions Oftentimes a graph of a relationship can be used to define a function. By convention, graphs are typically created with the input quantity along the horizontal axis and the output quantity along the vertical. The most common graph has y on the vertical axis and x on the horizontal axis, and we say y is a function of x, or y = f(x) when the function is named f.
    [Show full text]
  • L P and Sobolev Spaces
    NOTES ON Lp AND SOBOLEV SPACES STEVE SHKOLLER 1. Lp spaces 1.1. Definitions and basic properties. Definition 1.1. Let 0 < p < 1 and let (X; M; µ) denote a measure space. If f : X ! R is a measurable function, then we define 1 Z p p kfkLp(X) := jfj dx and kfkL1(X) := ess supx2X jf(x)j : X Note that kfkLp(X) may take the value 1. Definition 1.2. The space Lp(X) is the set p L (X) = ff : X ! R j kfkLp(X) < 1g : The space Lp(X) satisfies the following vector space properties: (1) For each α 2 R, if f 2 Lp(X) then αf 2 Lp(X); (2) If f; g 2 Lp(X), then jf + gjp ≤ 2p−1(jfjp + jgjp) ; so that f + g 2 Lp(X). (3) The triangle inequality is valid if p ≥ 1. The most interesting cases are p = 1; 2; 1, while all of the Lp arise often in nonlinear estimates. Definition 1.3. The space lp, called \little Lp", will be useful when we introduce Sobolev spaces on the torus and the Fourier series. For 1 ≤ p < 1, we set ( 1 ) p 1 X p l = fxngn=1 j jxnj < 1 : n=1 1.2. Basic inequalities. Lemma 1.4. For λ 2 (0; 1), xλ ≤ (1 − λ) + λx. Proof. Set f(x) = (1 − λ) + λx − xλ; hence, f 0(x) = λ − λxλ−1 = 0 if and only if λ(1 − xλ−1) = 0 so that x = 1 is the critical point of f. In particular, the minimum occurs at x = 1 with value f(1) = 0 ≤ (1 − λ) + λx − xλ : Lemma 1.5.
    [Show full text]
  • Section 1.4 Absolute Value
    Section 1.4 Absolute Value Geometric Definition of Absolute Value As we study the number line, we observe a very useful property called symmetry. The numbers are symmetrical with respect to the origin. That is, if we go four units to the right of 0, we come to the number 4. If we go four units to the lest of 0 we come to the opposite of 4 which is −4 The absolute value of a number a, denoted |a|, is the distance from a to 0 on the number line. Absolute value speaks to the question of "how far," and not "which way." The phrase how far implies length, and length is always a nonnegative (zero or positive) quantity. Thus, the absolute value of a number is a nonnegative number. This is shown in the following examples: Example 1 1 Algebraic Definition of Absolute Value The absolute value of a number a is aaif 0 | a | aaif 0 The algebraic definition takes into account the fact that the number a could be either positive or zero (≥0) or negative (<0) 1) If the number a is positive or zero (≥ 0), the first part of the definition applies. The first part of the definition tells us that if the number enclosed in the absolute bars is a nonnegative number, the absolute value of the number is the number itself. 2) If the number a is negative (< 0), the second part of the definition applies. The second part of the definition tells us that if the number enclosed within the absolute value bars is a negative number, the absolute value of the number is the opposite of the number.
    [Show full text]
  • Fact Sheet Functional Analysis
    Fact Sheet Functional Analysis Literature: Hackbusch, W.: Theorie und Numerik elliptischer Differentialgleichungen. Teubner, 1986. Knabner, P., Angermann, L.: Numerik partieller Differentialgleichungen. Springer, 2000. Triebel, H.: H¨ohere Analysis. Harri Deutsch, 1980. Dobrowolski, M.: Angewandte Funktionalanalysis, Springer, 2010. 1. Banach- and Hilbert spaces Let V be a real vector space. Normed space: A norm is a mapping k · k : V ! [0; 1), such that: kuk = 0 , u = 0; (definiteness) kαuk = jαj · kuk; α 2 R; u 2 V; (positive scalability) ku + vk ≤ kuk + kvk; u; v 2 V: (triangle inequality) The pairing (V; k · k) is called a normed space. Seminorm: In contrast to a norm there may be elements u 6= 0 such that kuk = 0. It still holds kuk = 0 if u = 0. Comparison of two norms: Two norms k · k1, k · k2 are called equivalent if there is a constant C such that: −1 C kuk1 ≤ kuk2 ≤ Ckuk1; u 2 V: If only one of these inequalities can be fulfilled, e.g. kuk2 ≤ Ckuk1; u 2 V; the norm k · k1 is called stronger than the norm k · k2. k · k2 is called weaker than k · k1. Topology: In every normed space a canonical topology can be defined. A subset U ⊂ V is called open if for every u 2 U there exists a " > 0 such that B"(u) = fv 2 V : ku − vk < "g ⊂ U: Convergence: A sequence vn converges to v w.r.t. the norm k · k if lim kvn − vk = 0: n!1 1 A sequence vn ⊂ V is called Cauchy sequence, if supfkvn − vmk : n; m ≥ kg ! 0 for k ! 1.
    [Show full text]
  • A Tutorial on Euler Angles and Quaternions
    A Tutorial on Euler Angles and Quaternions Moti Ben-Ari Department of Science Teaching Weizmann Institute of Science http://www.weizmann.ac.il/sci-tea/benari/ Version 2.0.1 c 2014–17 by Moti Ben-Ari. This work is licensed under the Creative Commons Attribution-ShareAlike 3.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/ by-sa/3.0/ or send a letter to Creative Commons, 444 Castro Street, Suite 900, Mountain View, California, 94041, USA. Chapter 1 Introduction You sitting in an airplane at night, watching a movie displayed on the screen attached to the seat in front of you. The airplane gently banks to the left. You may feel the slight acceleration, but you won’t see any change in the position of the movie screen. Both you and the screen are in the same frame of reference, so unless you stand up or make another move, the position and orientation of the screen relative to your position and orientation won’t change. The same is not true with respect to your position and orientation relative to the frame of reference of the earth. The airplane is moving forward at a very high speed and the bank changes your orientation with respect to the earth. The transformation of coordinates (position and orientation) from one frame of reference is a fundamental operation in several areas: flight control of aircraft and rockets, move- ment of manipulators in robotics, and computer graphics. This tutorial introduces the mathematics of rotations using two formalisms: (1) Euler angles are the angles of rotation of a three-dimensional coordinate frame.
    [Show full text]