5. 5.1. Normed spaces and linear maps. For this section, X will denote a over F = R or C.(WewillassumeF = C unless stated otherwise.) Definition 5.1.1. A on X is a : X [0, )whichis k·k ! 1 (homogeneous) x = x • (subadditive) xk+ yk | |·x k+k y • k kk k k k We call a if in addition it is k·k (definite) x =0impliesx =0. • k k Recall that given a norm on a vector space X, d(x, y):= x y is a metric which k·k k k induces the norm topology on X.Twonorms 1, 2 are called equivalent if there is a c>0suchthat k·k k·k 1 c x x c x x X. k k1 k k2  k k1 8 2 Exercise 5.1.2. Show that all norms on Fn are equivalent. Deduce that a finite dimensional subspace of a normed space is closed. Note: You may assume that the unit ball of Fn is compact in the Euclidean topology.

Exercise 5.1.3. Show that two norms 1, 2 on X are equivalent if and only if they induce the same topology. k·k k·k Definition 5.1.4. A is a which is complete in the induced metric topology. Examples 5.1.5.

(1) If X is an LCH , then C0(X)andCb(X)areBanachspaces. (2) If (X, ,µ)isameasurespace, 1(X, ,µ)isaBanachspace. 1 M L M (3) ` := (xn) F1 xn < { ⇢ | | | 1} Definition 5.1.6. SupposeP (X, )isanormedspaceand(xn) (X, )isasequence. k·k N ⇢ k·k We say x converges to x X if x x as N .Wesay x converges n 2 n ! !1 n absolutely if xn < . P k k 1 P P Proposition 5.1.7. The following are equivalent for a normed space (X, ). P k·k (1) X is Banach, and (2) Every absolutely convergent converges. Proof. (1) (2): Suppose X is Banach and x < .Let">0, and pick N>0suchthat ) k nk 1 x <".Thenforallm n>N, n>N k nk P m n m m P x x = x x x <". i i i  k ik k ik n+1 n+1 n>N X X X X X k (2) (1): Suppose (xn)isCauchy,andchoose n1 nk.Definey0 := 0 (think of this as xn0 by convention), and inductively

define yk := xnk xnk 1 for all k N.Then 2 k y x + 2 = x +1< . k kkk n1 k k n1 k 1 k 1 X X99 Hence x := lim x = y exists in X.Since(x )isCauchy,x x. nk k n n ! ⇤ Proposition 5.1.8. PSuppose X, Y are normed spaces and T : X Y is linear. The following are equivalent: ! (1) T is uniformly continuous (with respect to the norm topologies), (2) T is continuous, (3) T is continuous at 0X , and (4) T is bounded, i.e., there exists a c>0 such that Tx c x for all x X. k k k k 2 Proof. (1) (2) (3): Trivial. ) ) (3) (4): Suppose T is continuous at 0 .ThenthereisaneighborhoodU of 0 such that ) X X TU y Y y 1 .SinceU is open, there is a >0suchthat x X x U. Thus⇢{x 2 |kimpliesk }Tx 1. Then for all x =0 { 2 |k k }⇢ k k k k 6 x Tx 1 = 1= Tx x . · x  ) · x  )kk k k k k k k 1 (4) (1): Let ">0. If x x

(1) Show that for any two finite dimensional normed spaces F1 and F2,alllinearmaps T : F F are continuous. 1 ! 2 Optional: Show that for any two finite dimensional vector spaces F1 and F2 endowed with their vector space topologies from Exercise 5.1.2, all linear maps T : F1 F2 are continuous. ! (2) Let X, F be normed spaces with F finite dimensional, and let T : X F be a . Prove that the following are equivalent: ! (a) T is bounded (there is an c>0 such that T (B1(0X )) Bc(0F )), and (b) ker(T )isclosed. ✓ Hint: One way to do (b) implies (a) uses Exercise 5.1.9 part (3) and part (1) of this problem. Definition 5.1.11. Suppose X, Y are normed spaces. Let (X Y ):= bounded linear T : X Y . L ! { 100 ! } Define the on (X Y )by L ! T := sup Tx x 1 k k {k k|k k } =sup Tx x =1 {k k|k k } Tx =sup k k x =0 x k k6 ⇢ k k =inf c>0 Tx c x for all x X , { |k k k k 2 } Observe that if S (Y Z)andT (X Y ), then ST (X Z)and 2L ! 2L ! 2L ! STx S Tx S T x x X. k kk k·k kk k·k k·k k82 So ST S T . k kk k·k k Proposition 5.1.12. If Y is Banach, then so is (X Y ). L ! Proof. If (Tn)isCauchy,thensois(Tnx)forallx X.SetTx := lim Tnx for x X.One verifies that T is linear, T is bounded, and T T2. 2 n ! ⇤ Corollary 5.1.13. If X is complete, then (X):= (X X) is a (an algebra with a complete submultiplicative norm).L L ! Exercise 5.1.14 (Folland 5.1, #7). Suppose X is a Banach space and T (X). Let I (X)betheidentitymap.§ 2L 2L (1) Show that if I T < 1, then T is invertible. k k n 1 Hint: Show that n 0(I T ) converges in (X) to T . L 1 1 (2) Show that if T (X) is invertible and S T < T ,thenS is invertible. (3) Deduce that the2P setL of invertible operatorsk GL (Xk ) k (Xk)isopen. ⇢L n2 n2 c Exercise 5.1.15. Consider the measure space (Mn(C) ⇠= C , ). Show that GLn(C) n2 ⇢ Mn(C)is -null. Exercise 5.1.16 (Folland 5.2, #19). Let X be an infinite dimensional normed space. § (1) Construct a sequence (xn)suchthat xn =1foralln and xm xn 1/2forall m = n. k k k k (2) Deduce6 X is not locally compact. 5.2. Dual spaces.

Definition 5.2.1. Let X be a (normed) vector space. A linear map X F is called a ! (linear) functional. The of X is X⇤ := Hom(X F). Here, Hom means: ! linear maps if X is a vector space, and • bounded linear maps if X is a normed space. • Exercise 5.2.2. Suppose ','1,...,'n are linear functionals on a vector space X.Prove that the following are equivalent. n (1) ' = ↵k'k for some ↵1,...,↵n F. k=1 2 (2) There is an ↵>0suchthatforallx X, '(x) ↵ maxk=1,...,n 'k(x) . n P 2 | | | | (3) k=1 ker('k) ker('). ⇢ 101 T Exercise 5.2.3. Let X be a locally compact Hausdor↵space and suppose ' : C0(X) C is a linear functional such that '(f) 0wheneverf 0. Prove that ' is bounded. ! Hint: Argue by contradiction that '(f) 0 f 1 is bounded using Proposition 5.1.7. { |   } Proposition 5.2.4. Suppose X is a complex vector space. (1) If ' : X C is C-linear, then Re('):X R is R-linear, and for all x X, ! ! 2 '(x)=Re(')(x) i Re(')(ix). (2) If f : X R is R-linear, then ! '(x):=f(x) if(ix) defines a C-linear functional. (3) Suppose X is normed and ' : X C is C-linear. In Case (1), ' < implies! Re(') ' • In Case (2), k Re(k ')1< impliesk 'kkRe(k ') . Thus• ' = Re(k') . k 1 k kk k k k k k Proof. (1) Just observe Im('(x)) = Re(i'(x)) = Re(')(ix). (2) It is clear that ' is R-linear. We now check '(ix)=f(ix) if(i2x)=f(ix) if( x)=if(x)+f(ix)=i(f(x) if(ix)) = i'(x). (3, Case 1) Since Re(')(x) '(x) for all x X, Re(') ' . (3, Case 2) If '(x|) =0,then|| | 2 k kk k 6 '(x) = sgn('(x))'(x)='(sgn('(x)) x)=Re(')(sgn('(x)) x). | | · · Hence '(x) Re(') x ,whichimplies ' Re(') . | |k k·k k k kk k ⇤ Exercise 5.2.5. Consider the following sequence spaces.

1 ` := (xn) C1 xn < x 1 := xn ⇢ | | 1 k k | | n o c0 := (xn) C1 xXn 0asn x :=X sup xn { ⇢ | ! ! 1}k k1 | | c := (xn) C1 lim xn exists x := sup xn ⇢ n k k1 | | n !1 o `1 := (xn) C1 sup xn < x := sup xn { ⇢ | | | 1}k k1 | | (1) Show that every space above is a Banach space. 1 Hint: First show ` and `1 are Banach. Then show c0,c are closed in `1. 1 1 (2) Construct isometric isomorphisms c0⇤ ⇠= ` ⇠= c⇤ and (` )⇤ ⇠= `1. (3) Which of the above spaces are separable? Warning 5.2.6. If X is a normed space, constructing a non-zero bounded linear functional takes a considerable amount of work. One cannot get by simply choosing a for X as an ordinary linear space and mapping the basis to arbitrarily chosen elements of F. Definition 5.2.7. Suppose X is an R-vector space. A sublinear (Minkowski) functional on X is a function p : X R such that ! (positive homogeneous) for all x X and r 0, p(rx)=rp(x), and • (subadditive) for all x, y X, p(x2+ y) p(x)+p(y). • 2 102 Theorem 5.2.8 (Real Hahn-Banach). Let X be an R-vector space, p : X R a sublinear ! functional, Y X a subspace, and f : Y R a linear functional such that f(y) p(y) ⇢ !  for all y Y . Then there is an R-linear functional g : X R such that g Y = f and g(x) p(x2) for all x X. ! |  2 Proof. Step 1: For all x X Y ,thereisalinearg : Y Rx R such that g Y = f and g(z) p(z) 2 \ ! |  on Y Rx. Proof. Any extension g of f to Y Rx is determined by g(y + rx)=f(y)+r↵ for all r R,where↵ = g(x). We want to choose ↵ R such that 2 2 f(y)+r↵ p(y + rx) y Y and r R. (5.2.9)  8 2 8 2 Since f is R-linear and p is positive homogeneous, we need only consider the cases r = 1. Restricting to these 2 cases, (5.2.9)becomes: ± f(y) p(y x) ↵ p(z + x) f(z) y, z Y.   8 2 Now observe that p(z+x) f(z) f(y)+p(y x)=p(z+x)+p(y x) f(y+z) p(y+z) f(y+z) 0. Hence there exists an ↵ which lies in the interval [sup f(y) p(y x) y Y , inf p(z + x) f(z) z Y ]. { | 2 } { | 2 } ⇤ Step 2: Observe that Step 1 applies to any extension g of f to Y Z X such that g = f ⇢ ⇢ |Y and g p on Z. Thus any maximal extension g of f satisfying g Y = f and g p on its domain must have domain X. Note that |  Y Z X is a subspace and g : Z R (Z, g) ✓ ✓ ! such that g Y = f and g p on Z ⇢ |  is partially ordered by (Z1,g1) (Z2,g2)ifZ1 Z2 and g2 Z1 = g1.Sinceeveryascending  ✓ | chain has an upper bound, there is a maximal extension by Zorn’s Lemma. ⇤ Remark 5.2.10. Suppose p is a seminorm on X and f : X R is R-linear. Then f p if and only if f p.Indeed, !  | | f(x) = f(x)=f( x) p( x)=p(x). | | ± ±  ± Theorem 5.2.11 (Complex Hahn-Banach). Let X be an C-vector space, p : X [0, ) a ! 1 seminorm, Y X a subspace, and ' : Y R a linear functional such that '(y) p(y) ⇢ ! | | for all y Y . Then there is a C-linear functional : X C such that Y = ' and (x) p2(x) for all x X. ! | | | 2 Proof. By the Real Hahn-Banach Theorem 5.2.8 applied to Re(')whichisboundedabove by p,thereisanR-linear extension g : X R such that g Y =Re(')and g p.Define (x):=g(x) ig(ix). By Proposition 5.2.4!, = '. Finally,| for all x X,| | |Y 2 (x) = sgn (x) (x)= (sgn (x) x)=g(sgn (x) x) p(sgn (x) x)=p(x). | | · · ·  · ⇤ Facts 5.2.12. Here are some corollaries of the Hahn-Banach Theorems 5.2.8 and 5.2.11.Let X be an F-linear normed space. 103 (HB1) If x =0,thereisa' X⇤ such that '(x)= x and ' =1. 6 2 k k k k Proof. Define f : Fx F by f(x):= x ,andobservethat f . Now ! k k | |k·k apply Hahn-Banach. ⇤

(HB2) If Y X is closed and x/Y ,thereisa' X⇤ such that ' =1and ⇢ 2 2 k k '(x)= x + Y X/Y := inf x y . y Y k k 2 k k

Proof. Apply (HB1) to x + Y X/Y to get f (X/Y )⇤ such that f =1 and 2 2 k k f(x + Y )= x + Y =inf x y . y Y k k 2 k k By Exercise 5.1.9, the canonical quotient map Q : X X/Y is continuous. Since ! x + Y =inf x y x x X, y Y k k 2 k kk k82 we have Q 1. Thus ' := f Q works. k k ⇤

(HB3) X⇤ separates points of X.

Proof. If x = y,thenby(HB1),thereisa' X⇤ such that '(x y)= x y =0.6 2 k k6 ⇤

(HB4) For x X,defineevx : X⇤ F by evx('):='(x). Then ev : X X⇤⇤ is a linear isometry.2 ! !

Proof. It is easy to see that ev is linear. For all ' X⇤, 2 ev (') = '(x) ' x = ev x . k x k | |k k·k k )kx kk k Thus evx X⇤⇤.Ifx =0,by(HB1) there is a ' X⇤ such that '(x)= x and ' =1.Thus2 ev6 = x . 2 k k k k k x k k k ⇤

Exercise 5.2.13 (Banach Limits). Let `1(N, R) denote the Banach space of bounded func- tions N R.Showthatthereisa' `1(N, R)⇤ satisfying the following two conditions: ! 2 (1) Letting S : `1(N, R) `1(N, R)betheshiftoperator(Sx)n = xn+1 for x =(xn)n N, ' = ' S. ! 2 (2) For all x `1,liminfx '(x) lim sup x . 2 n   n Hint: One could proceed as follows.

(1) Consider the subspace Y =im(S I)= Sx x x `1 . Prove that for all y Y { | 2 } 2 and r R, y + r 1 r , where 1 =(1)n N `1. 2 k · k| | 2 2 (2) Show that the linear map f : Y R1 R given by f(y + r 1):=r is well-defined, ! · and f(z) z for all z Y R1. | |k k 2 (3) Use the Real Hahn-Banach Theorem 5.2.8 to extend f to a g `1(N, R)⇤ which satisfies (1) and (2). 2 104 Definition 5.2.14. For a normed space X,itscompletion is X := ev(X) X⇤⇤,whichis ⇢ always Banach. Observe that if X is Banach, then ev(X) X⇤⇤ is closed. In this case, if ⇢ ev(X)=X⇤⇤,wecallX reflexive.

Exercise 5.2.15. Show that X is reflexive if and only if X⇤ is reflexive. Hint: Instead of the converse, try proving the inverse, i.e., if X is not reflexive, then X⇤ is not reflexive. Exercise 5.2.16.

(1) (Folland 5.2, #25) Prove that if X is a Banach space such that X⇤ is separable, then X is§ separable. (2) Find a separable Banach space X such that X⇤ is not separable. 5.3. The Baire Category Theorem and its consequences. Theorem 5.3.1 (Baire Category). Suppose X is either: (1) a , or (2) an LCH space.

Suppose (Un) is a sequence of open dense subsets of X. Then Un is dense in X.

Proof. Let V0 X be non-empty and open. We will inductively construct for n N a ⇢ T 2 non-empty open set Vn Vn Un Vn 1. ⇢ ⇢ \ Case 1: Take Vn to be a ball of radius < 1/n. Case 2: Take Vn such that Vn is compact, so (Vn)arenon-emptynestedcompactsets.

Claim. K := Vn is not empty. Proof of Claim.T Case 1: Let xn be the center of Vn for all n.Then(xn)isCauchy,soitconverges.The limit lies in K by construction. Case 2: Observe (Vn)isafamilyofclosedsetswiththefiniteintersectionproperty. Since V is compact, we have K = . 1 6 ; ⇤ Now observe = K ( U ) V .Thus U is dense in X. ;6 ⇢ n \ 0 n ⇤ Corollary 5.3.2. If X isT as in the Baire CategoryT Theorem 5.3.1, then X is not meager, i.e., a countable union of nowhere dense sets. c Proof. If (Yn) is a sequence of nowhere dense sets, then (Un := Yn )isasequenceofopen dense sets. Then c c c U = Y = Y Y n n n ✓ n is dense in X,so Yn = X\. \ ⇣[ ⌘ ⇣[ ⌘ 6 ⇤ Lemma 5.3.3. Suppose X, Y are Banach spaces and T (X Y ). Let U X be an S 2L ! ⇢ open ball centered at 0X and V Y be an open ball centered at 0Y .IfV TU, then V TU. ⇢ ⇢ ⇢ Proof. Let y V .Taker (0, 1) such that y rV .Let" (0, 1) to be decided later. Observe that 2 2 2 2 y rV rTU = TrU, 2 ⇢ 105 so there is an x rU such that 0 2 y Tx "rV "rT U = T ("rU). 0 2 ⇢ Then there is an x "rU such that 1 2 y Tx Tx "2rV T ("2rU). 0 1 2 ⇢ Hence by induction, we can construct a sequence (xn)suchthat n x "nrU and y Tx "n+1rV. n 2 j 2 j=0 X j Observe that xj converges as xj <"rR (which is summable!), where R := radius(U). Moreover, k k P n n T xj =limT xj =lim Txj = y. n n !1 !1 Finally, we have X X X 1 rR x x < "jrR = , j  k jk 1 " j=0 r X X X so xj 1 " U.Thusif"<1 r,then xn U,soy TU. ⇤ 2 2 2 TheoremP 5.3.4 (Open Mapping). SupposeP X, Y are Banach spaces and T (X Y ) is surjective. Then T is an open map. 2L !

Proof. It suces to prove T maps an open neighborhood of 0X to an open neighborhood of 0Y . Note Y = TBn(0X ). By the Baire Category Theorem 5.3.1,thereisann N such n 2 that TB (0) contains a non-empty open set, say Tx + V where x TB (0 )andV is an n S 0 0 2 n X open ball in Y with center 0Y .ThenV TBn(0) Tx0 TB2n(0X ). By Lemma 5.3.3, V TB (0 ). ⇢ ⇢ ⇢ 2n X ⇤ Facts 5.3.5. Here are some corollaries of the Open Mapping Theorem 5.3.4. 1 (OMT1) Suppose X, Y are Banach spaces and T (X Y )isbijective.ThenT (Y X), and we call T an isomorphism2. L ! 2 L ! 1 Proof. When T is bijective, T is continuous if and only if T is open. ⇤

(OMT2) Suppose X is Banach under 1 and 2.Ifthereisac 0suchthat x 1 c x 2 for all x X,then andk·k arek· equivalent.k k k  k k 2 k·k1 k·k2 Proof. Apply (OMT1) to the identity map id : (X, ) (X, ). k·k2 ! k·k1 ⇤

Definition 5.3.6. Suppose X, Y are normed spaces and T : X Y is linear. The graph of T is the subspace ! (T ):= (x, y) Tx = y X Y. { | }⇢ ⇥ Here, we endow X Y with the norm ⇥ (x, y) := max x X , y Y . k k1 {k k k k } We say T is closed if (T ) X Y is a closed subspace. ⇢ ⇥ 106 Remark 5.3.7. If T (X Y ), then (T )isclosed.Indeed,(x ,Tx ) (x, y)ifand 2L ! n n ! only if xn x and Txn y.SinceT is continuous, Txn Tx.SinceY is Hausdor↵, Tx = y. ! ! ! Theorem 5.3.8 (Closed Graph). Suppose X, Y are Banach. If T : X Y is a closed linear map, then T (X Y ), i.e., T is bounded. ! 2L ! Proof. Since X, Y are Banach, so is X Y .Considerthecanonicalprojectionmaps⇡ : ⇥ X X Y X and ⇡Y : X Y Y ,whicharecontinuous.Since⇡X (T ) :(T ) X by ⇥ ! ⇥ ! 1 | ! (x, T x) x is norm decreasing and bijective, ⇡ is bounded by (OMT1). Now observe 7! X |(T ) 1 ⇡X ⇡ |(T ) Y |(T ) 1 x (x, T x) Tx = T = ⇡ ⇡ ) Y |(T ) X |(T ) which is bounded as the composite of two bounded linear maps. ⇤

Exercise 5.3.9. Suppose X, Y are Banach spaces and S : X Y and T : Y ⇤ X⇤ are linear maps such that ! !

'(Sx)=(T')(x) x X, ' Y ⇤. 8 2 8 2 Prove that S, T are bounded. Definition 5.3.10. AsubsetS of a topological space (X, )iscalled: T meager if S is a countable union of nowhere dense sets, and • residual if Sc is meager. • Exercise 5.3.11. Construct a (non-closed) infinite dimensional meager subspace of `1. Theorem 5.3.12 (Banach-Steinhaus/Uniform Boundedness Principle). Suppose X, Y are normed spaces and (X Y ). S⇢L ! (1) If supT Tx < for all x in a non-meager subset of X, then supT T < . 2S k k 1 2S k k 1 (2) If X is Banach and supT Tx < for all x X, then supT T < . 2S k k 1 2 2S k k 1 Proof. (1) Define

En := x X sup Tx n = x X Tx n 2 T k k { 2 |k k } ⇢ 2S T \2S (5.3.13) 1 = ( T ) ([0,n]), k·k T \2S cts which is closed in X.Since |En{zis a} non-meager subset of X,someEn is non-meager. Thus there is an x X, r>0, and n>0 such that B (x ) E .ThenB (0) E : 0 2 S r 0 ⇢ n r ⇢ 2n Tx T ( x x ) + Tx 2n when x r. k kk 0 k k 0k k k Br(x0) En 2 ⇢ Thus for all T and x | r{z,wehave} Tx 2n.Thisimplies 2S k k k k 2n sup T . T k k r 2S 107 (2) Define En as in (5.3.13)above.SinceX = En is Banach, the sets cannot all be meager by Corollary 5.3.2 to the Baire Category Theorem 5.3.1.Theresultnowfollowsfrom(1). ⇤ S Exercise 5.3.14. Provide examples of the following: (1) Normed spaces X, Y and a discontinuous linear map T : X Y with closed graph. ! (2) Normed spaces X, Y and a family of linear operators T ⇤ such that (Tx) ⇤ is { } 2 2 bounded for every x X,but( T ) ⇤ is not bounded. 2 k k 2 Exercise 5.3.15. Suppose X and Y are Banach spaces and T : X Y is a continuous linear map. Show that the following are equivalent. !

(1) There exists a constant c>0suchthat Tx Y c x X for all x X. (2) T is injective and has closed range. k k k k 2

Exercise 5.3.16 (Folland 5.3, #42). Let En C([0, 1]) be the space of all functions f such that there is an x [0§, 1] such that f(x) ⇢f(x ) n x x for all x [0, 1]. 0 2 | 0 | | 0| 2 (1) Prove that En is nowhere dense in C([0, 1]). (2) Show that the subset of nowhere di↵erentiable functions is residual in C([0, 1]).

Exercise 5.3.17. Suppose X, Y are Banach spaces and (Tn) (X Y )isasequenceof bounded linear maps such that (T x)convergesforallx X.⇢L ! n 2 (1) Show that Tx := lim Tnx defines a bounded linear map. (2) Does Tn T in norm? Give a proof or a counterexample. Hint: Think! about shift operators on a sequence space. 5.4. Topological vector spaces. Definition 5.4.1. An F-vector space X equipped with a topology is called a if T +:X X X ⇥ ! : F X X · ⇥ ! are continuous. AsubsetC X is called convex if if ✓ x, y C = tx +(1 t)y C t [0, 1]. 2 ) 2 8 2 Atopologicalvectorspaceiscalledlocally convex if for all x X and open neighborhoods U X of x,thereisaconvexopenneighborhoodV of x such2 that V U. ⇢ ✓ Facts 5.4.2. Suppose is a family of on the F-vector space X.Forx X, p ,and">0, defineP 2 2P U := y X p(x y) <" . x,p," { 2 | } Let be the topology generated by the sets Ux,p,",i.e.,arbitraryunionsoffiniteintersections of setsT of this form. n (LCnvx1) Suppose x1,...,xn X, p1,...,pn ,and"1,...,"n > 0andx i=1 Uxi,pi,"i . Then there is a ">20suchthat 2P 2 n n T U = y X p (x y) <" p ,...,p U . x,pi," { 2 | i 8 1 n 2P}⇢ xi,pi,"i i=1 i=1 \ 108 \ n Hence sets of the form i=1 Ux,pi," = y X pi(x y) <" p1,...,pn form a neighborhood base for at x. { 2 | 8 2P} TT

Proof. Define " := min "i pi(x xi) i =1,...,n .Thenforally n { | } 2 i=1 Ux,pi," and j =1,...,n, p (x y) p (x x)+p (x y) (" ")+" = " . T j j  j j j  j j Thus y n U ,andthus n U n U . 2 i=1 xi,pi,"i i=1 x,pi," ✓ i=1 xi,pi,"i ⇤ T T T (LCnvx2) If (x ) X is a net, x x if and only if p(x x ) 0forallp . i ⇢ i ! i ! 2P

Proof. By (LCnvx1) xi x if and only if (xi)iseventuallyinUx,p," for all ">0andp if and only! if p(x x ) 0forallp . 2P i ! 2P ⇤ (LCnvx3) is the weakest topology such that the p are continuous. T 2P Proof. Exercise. ⇤

(LCnvx4) (X, )isatopologicalvectorspace. T Proof. +cts:Suppose x x and y y.Thenforallp , i ! i ! 2P p(x + y (x + y )) p(x x )+p(y y ) 0. i i  i i ! cts: Suppose x x and ↵ ↵.Thenforallp , · i ! i ! 2P p(↵ x ↵x) p(↵ x ↵x )+p(↵x ↵x) i i  i i i i ↵ ↵ p(x ) + ↵ p(x x) . | i | · i | |· i ⇤ 0 p(x) 0 ! ! ! | {z } | {z } | {z } (LCnvx5) (X, )islocallyconvex. T

Proof. Observe that each Ux,p," is convex. Indeed, if y, z Ux,p,",thenforall t [0, 1], 2 2 p(x (ty +(1 t)z)) = p((tx +(1 t)x) (ty +(1 t)z)) = p((t(x y)+(1 t)(x z)) t p(x y)+(1 t) p(x z)  · · 0suchthatforallx V := i=1 U0,pi,",wehaveq(Tx) < 1. Fix x X.Ifpi(x)=0for all i =1,...,n,thenrx 2 V for all r>0, so 2 2 T rq(Tx)=q(Trx) < 1 r>0. 8 V 2 This implies q(Tx)=0 c n p (x)forall|{z} c>0, so we may assume p (x) > 0. Then  i=1 i 1 P " y := x V 2 n p (x) · 2 ✓ i=1 i ◆ as p (y) "/2 <"for all i =1,...,n.ThusP i  2 n 2 n q(Tx)= p (x) q(Ty) < p (x) " i " i i=1 ! i=1 X X as desired. 110 (3) (1): We must show if x x in X,thenq(Tx Tx) 0forallq .Sincex x, ) i ! i ! 2Q i ! p(x x) 0forallp . Fix q .By(3),therearep ,...,p and c>0suchthat i ! 2P 2Q 1 n 2P n q(T (x x)) c p (x x) 0 x X. i  j i ! 8 2 ⇤ j=1 X Definition 5.4.4. Let X be a normed space. Recall that X⇤ separates points of X by the Hahn-Banach Theorem 5.2.8 or 5.2.11.Considerthefamilyofseminorms

:= x '(x) ' X⇤ P { 7! | || 2 } on X, which separates points. Hence induces a locally convex Hausdor↵vector space P topology on X in which xi x if and only if '(xi) '(x)forall' X⇤ by (LCnvx2).We call this topology the weak! topology on X. ! 2 Proposition 5.4.5. If U X is weakly open then U is -open. ⇢ k·k Proof. Observe that every basic open set U = y X '(x y) <" is norm open in x,'," { 2 || | } X.Indeed,y '(x y) is norm continuous as ' X⇤ is norm continuous, the vector 7! | | 2 space operations are norm-continuous, and : C [0, ) is continuous. |·| ! 1 ⇤ Exercise 5.4.6. Let X be a normed space. Prove that the weak and norm topologies agree if and only if X is finite dimensional. Proposition 5.4.7. A linear functional ' : X F is weakly continuous (continuous with ! respect to the ) if and only if ' X⇤ (continuous with respect to the norm topology). 2 1 Proof. Suppose ' X⇤.Then' (B (0 )) = x X '(x) <" = U is weakly open. 2 " C { 2 || | } 0,"," Hence ' is continuous at 0X and thus weakly continuous by Proposition 5.4.3. 1 Now suppose ' : X C is weakly continuous. Then for all U C open, ' (U)is weakly open and thus norm! open by Proposition 5.4.5.Thus' is ⇢-continuous and thus k·k in X⇤. ⇤

Definition 5.4.8. The weak* topology on X⇤ is the locally convex Hausdro↵vector space topology induced by the separating family of seminorms = ' ev (') = '(x) x X . P { 7! | x | | || 2 } Observe that ' ' if and only if ' (x) '(x)forallx X. i ! i ! 2 Theorem 5.4.9 (Banach-Alaoglu). The norm-closed unit ball B⇤ of X⇤ is weak*-compact. Proof.

Trick. For x X,letDx = z C z x .ByTychono↵’sTheorem,D := 2 { 2 || |k k} x X Dx is compact Hausdor↵. The elements (dx) D are precisely functions f : 2 2 X C (not necessarily linear) such that f(x) x for all x X. Q ! | |k k 2

Observe B⇤ D is the subset of linear functions. The relative product topology on B⇤ is ⇢ the relative weak* topology, as both are pointwise convergence. It remains to prove B⇤ D ⇢ is closed. If (' ) B⇤ is a net with ' ' D,then i ⇢ i ! 2 '(↵x + y) = lim 'i(↵x + y)=lim↵'i(x)+'i(y)=↵'(x)+'(y). ⇤ 111 Exercise 5.4.10. Let X be a normed space. (1) Show that every weakly convergent sequence in X is norm bounded. (2) Suppose in addition that X is Banach. Show that every weak* convergent sequence in X⇤ is norm bounded. (3) Give a counterexample to (2) when X is not Banach. 1 Hint: Under , cc⇤ ⇠= ` , where cc is the space of which are eventually zero. k·k1 Exercise 5.4.11 (Goldstine’s Theorem). Let X be a normed vector space with closed unit ball B.LetB⇤⇤ be the unit ball in X⇤⇤,andleti : X X⇤⇤ be the canonical inclusion. ! Recall that the weak* topology on X⇤⇤ is the weak topology induced by X⇤. In this exercise, we will prove that i(B)isweak*denseinB⇤⇤. Note: You may use a Hahn-Banach separation theorem that we did not discuss in class to prove the result directly if you do not choose to proceed along the following steps.

(1) Show that for every x⇤⇤ B⇤⇤, ' ,...,' X⇤,and>0, there is an x (1 + )B 2 1 n 2 2 such that ' (x)=x⇤⇤(' )forall1 i n. i i   Hint: Here is a walkthrough for this first part. Fix ' ,...,' X⇤. 1 n 2 (a) Find x X such that ' (x)=x⇤⇤(' ) for all 1 i n. 2 i i   (b) Set Y := ker('i) and let >0. Show by contradiction that (x+Y ) (1+)B = . (This part uses the Hahn-Banach Theorem.) \ 6 ; T (2) Suppose U is a basic open neighborhood of x⇤⇤ B⇤⇤.Deducethatforevery>0, 2 (1 + )i(B) U = .Thatis,thereisanx (1 + )B such that i(x) U. \ 6 ; 1 2 2 (3) By part (2), (1 + ) x B.Showthatfor suciently small (which can be 2 1 expressed in terms of the basic open neighborhood U), (1 + ) i(x ) i(B) U. 2 \ Exercise 5.4.12. Suppose X is a Banach space. Prove that X is reflexive if and only if the unit ball of X is weakly compact. Hint: Use the Banach-Alaoglu Theorem 5.4.9 and Exercise 5.4.11. Exercise 5.4.13. Suppose X, Y are Banach spaces and T : X Y is a linear transforma- tion. ! (1) Show that if T (X, Y ), then T is weak-weak continuous. That is, if x x in 2L ! the weak topology on X induced by X⇤,thenTx Tx in the weak topology on Y ! induced by Y ⇤. (2) Show that if T is norm-weak continuous, then T (X, Y ). (3) Show that if T is weak-norm continuous, then T2hasL finite rank, i.e., TX is finite dimensional. Hint: For part (3), one could proceed as follows. (1) First, reduce to the case that T is injective by replacing X with Z = X/ ker(T ) and T with S : Z Y given by x +ker(T ) Tx. (You must show S is weak-norm continuous on !Z.) 7! 1 (2) Take a basic open set = z Z 'i(z) <"for all i =1,...,n S B1(0Y ). Use U { 2 ||n | }⇢ that S is injective to prove that i=1 ker('i)=(0). (3) Use Exercise 5.2.2 to deduce that Z⇤ is finite dimensional, and thus that Z and TX = SZ are finite dimensional.T Exercise 5.4.14. Suppose X is a Banach space. Prove the following are equivalent: 112 (1) X is separable. (2) The relative weak* topology on the closed unit ball of X⇤ is metrizable.

Deduce that if X is separable, the closed unit ball of X⇤ is weak* sequentially compact. Hint: For (1) (2), you could adapt either the proof of (LCnvx7) or the trick in the proof of the Banach-Alaoglu) Theorem 5.4.9 using a countable dense subset. For (2) (1), there a ) countable neighborhood base (Un) B⇤ at 0X such that Un = 0 . For each n N, there ⇢ { } 2 is a finite set Dn X and an "n > 0 such that ⇢ T U ' X⇤ '(x) <" for all x D . n ◆{ 2 || | n 2 n}

Setting D = Dn, show that span(D) is dense in X. Deduce that X is separable. Exercise 5.4.15.S Suppose X is a Banach space. Prove the following are equivalent:

(1) X⇤ is separable. (2) The relative weak topology on the closed unit ball of X is metrizable. Exercise 5.4.16. How do you reconcile Exercises 5.4.12, 5.4.14,and5.4.15?Thatis,how do you reconcile the fact that there exist separable Banach spaces which are not reflexive? Exercise 5.4.17.

(1) Prove that the norm closed unit ball of `1 is weak* sequentially compact. (2) Prove that the norm closed unit ball of `1 is not weakly sequentially compact. Hint: One could proceed as follows. 1 (a) Prove that the weak* topology on `1 ⇠= (` )⇤ is contained in the weak topology, i.e., if x x weakly, then x x weak*. i ! i ! (b) Consider the sequence (x ) c `1 given by n ⇢ ⇢ 0 if n

Show that x 0 weak* in `1. n ! (c) Show that (xn) does not converge weakly in `1 by extending lim : c C to `1. ! (d) Deduce no subsequence of (xn) converges weakly in `1. Remark 5.4.18. The Eberlein-Smulianˇ Theorem (which we will not prove here) states that if X is a Banach space and S X,thefollowingareequivalent. ⇢ (1) S is weakly precompact,i.e.,theweakclosureofS is weakly compact. (2) Every sequence of S has a weakly convergent subsequence (whose weak limit need not be in S). (3) Every sequence of S has a weak cluster point. Exercise 5.4.19. Let X be a compact Hausdor↵topological space. For x X,define 2 evx : C(X) F by evx(f)=f(x). ! (1) Prove that ev C(X)⇤,andfind ev . x 2 k x k (2) Show that the map ev : X C(X)⇤ given by x evx is a homeomorphism onto its image, where the image has! the relative weak* topology.7! 113 5.5. Hilbert spaces. Definition 5.5.1. A on an F-vector space H is a function , : H H h· ·i ⇥ ! F which is linear in the first variable: ↵x + y, z = ↵ x, z + y, z for all ↵ F and x, y, z H, • and h i h i h i 2 2 conjugate linear in the second variable: x, ↵y + z = ↵ x, y + x, z for all ↵ F • and x, y, z H. h i h i h i 2 2 We call , : h· ·i self-adjoint if x, y = y, x for all x, y H, • non-degenerateh if ix, yh =0foralli y H2 implies x =0 • positive if x, x h 0foralli x H.Apositivesesquilinearformiscalled2 definite if • moreover hx, x i=0impliesx =0.2 h i Aself-adjointpositivedefinitesesquilinearformiscalledaninner product. Exercise 5.5.2. Suppose , is a self-adjoint sesquilinear form on the R-vector space H. Show that: h· ·i (R-polarization) 4 x, y = x + y, x + y x y, x y for all x, y H. • h i h ih i 2 Now suppose , is a sesquilinear form on the C-vector space H.Provethefollowing. h· ·i 3 (1) (C-polarization) 4 x, y = ik x + iky, x + iky for all x, y H. h i k=0 h i 2 (2) , is self-adjoint if and only if x, x R for all x H. (3) hPositive· ·i implies self-adjoint.P h i2 2 Definition 5.5.3. Suppose that , is positive and self-adjoint (so (H, , )isapre- ). Define h· ·i h· ·i x := x, x 1/2. k k h i Observe that is homogeneous: ↵x = ↵ x for all ↵ F and x H. We say thatkx·kand y are orthogonalk ,denotedk | |·xk k y,if x, y2=0. 2 ? h i Facts 5.5.4. We have the following facts about pre-Hilbert spaces: (H1) (Pythagorean Theorem) x y implies x + y 2 = x 2 + y 2. ? k k k k k k Proof. x + y 2 = x 2 +2Re x, y + y 2 = x 2 + y 2. k k k k h i k k k k k k ⇤ (H2) x y if and only if x 2 x + ↵y 2 for all ↵ F. ? k k k k 2 Proof. : x + ↵y 2 = x 2 + ↵ 2 y 2 x 2 for all ↵ F. ) k k (H1) k k | | k k k k 2 : Suppose ( x 2 +2Re(↵ x, y )+ ↵ 2 y 2 = x + ↵y 2 x 2 ↵ F. k k h i | | k k k k k k 8 2 Then for all ↵ F, 2 0 2Re(↵ x, y )+ ↵ 2 y 2.  h i | | k k Taking ↵ F suciently close to 0 ,theterm2Re(↵ x, y )dominates,and 2 F h i this can only be non-negative for all ↵ F if x, y =0. 2 h i ⇤

114 (H3) The properties of being definite and non-degenerate are equivalent.

Proof. : Trivial; just take y = x in the definition of non-degeneracy. ) : If x 2 =0,thenforall↵ F and y H, x 2 =0 x + ↵y 2 (by positivity.k k Hence x y for2 all y H by2 (H2)k.Thusk x k=0bynon-k ? 2 degeneracy. ⇤

(H4) (Cauchy-Schwarz Inequality) For all x, y H, x, y x y . 2 |h i| k k·k k Proof. For all r R, 2 0 x ry 2 = x 2 2r Re x, y + r2 y 2, k k k k h i k k which is a non-negative quadratic in r.Thereforeitsdiscriminant 4(Re x, y )2 4 x 2 y 2 0, h i ·k k ·k k  which implies Re x, y x y . | h i| k k·k k Trick. x, y = ↵ x, y for some ↵ U(1) = z C z =1 . |h i| h i 2 { 2 || | } Then x, y = ↵ x, y = ↵x, y ↵x y = x y . |h i| h i h ik k·k k k k·k k ⇤ (H5) (Cauchy-Schwarz Definiteness) If , is definite, then x, y = x y implies x, y is linearly dependent. h· ·i |h i| k k·k k { } Proof. We may assume y =0.Set 6 x, y ↵ := |h i|sgn( x, y ). y 2 h i k k Then we calculate x ↵y 2 = x 2 2Re(↵ x, y )+ ↵ 2 y 2 k k k k h i | | ·k k x, y 2 x, y 2 = x 2 2|h i| + |h i| y 2 k k y 2 y 4 k k k k k k x, y 2 = x 2 |h i| k k y 2 k k x 2 y 2 = x 2 k k ·k k k k y 2 k k =0. This implies x = ↵y by definiteness. (The essential idea here was to minimize a quadratic in ↵.) ⇤

(H6) : H [0, )isaseminorm.Itisanormexactlywhen , is definite, i.e., an innerk·k product.! 1 h· ·i 115 Proof. It remains to prove subadditivity of ,whichfollowsbytheCauchy- Schwarz Inequality (H4): k·k x + y 2 = x + y, x + y k k h i = x 2 +2Re x, y + y 2 k k h i k k x 2 +2 x, y + y 2 k k |h i| k k x 2 +2 x y + y 2 (H4) k k k k·k k k k =( x + y )2. k k k k Now take square roots. The final claim follows immediately. ⇤

Proposition 5.5.5. A norm on a C-vector space comes from an inner product if and only if it satisfies the parallelogramk·k identity:

y x y x+y x + y 2 + x y 2 =2( x 2 + y 2) k k k k k k k k x Proof. : If comes from an inner product, then add together ) k·k x y 2 = x 2 2Re x, y + y 2. k ± k k k ± h i k k : If the parallelogram identity holds, just define ( 1 3 x, y := ik x + iky 2 h i 4 k k Xk=0 by polarization. One checks this works. ⇤ Definition 5.5.6. A Hilbert space is an inner product space whose induced norm is complete, i.e., Banach. Exercise 5.5.7. Verify the follows spaces are Hilbert spaces. 2 2 (1) ` := (xn) C1 xn < with x, y := xnyn. (2) Suppose{ (X,2 ,µ|)isameasurespace.Define| | 1} h i M P P measurable f : X C f 2 dµ < 2(X, µ):= ! | | 1 L equality a.e.R with f,g := fgdµ. h i Exercise 5.5.8. SupposeR H is a Hilbert space and S, T : H H are linear operators such that for all x, y H, Sx,y = x, T y .ProvethatS and T are! bounded. 2 h i h i From this point forward, H will denote a Hilbert space. Theorem 5.5.9. Suppose C H is a non-empty convex closed subset and z/C. There is a unique x C such that ⇢ 2 2 x z =inf y z . y C k k 2 k k 116 Proof. By translation, we may assume z =0/ C.Suppose(x ) C such that x r := 2 n ⇢ k nk! infy C y .Thenbytheparallelogramidentity, 2 k k x x 2 x + x 2 x 2 x 2 m n + m n =2 m + n 2 2 2 2 ✓ ◆ Rearranging, we have x + x 2 x x 2 =2 x 2 +2 x 2 4 m n k m nk k mk k nk 2 r2 r2 ! ! r2 | {z } | {z } where the last inequality follows since (x + x )/2 C by| convexity.{z } This means that m n 2 2 2 2 2 lim sup xm xn 2r +2r 4r =0, m,n k k  and thus (xn)isCauchy.SinceH is complete, there is an x H such that xn x,and x = r.SinceC is closed, x C. 2 ! k k 2 For uniqueness, observe that if x0 C satisfies x0 = r,then(x, x0,x,x0,...)isCauchy 2 k k by the above argument, and thus converges. We conclude that x = x0. ⇤ Definition 5.5.10. For S H,definetheorthogonal complement ⇢

S? := x H x, s =0 , s S . { 2 |h i 8 2 }

Observe that S? is a closed subspace.

Facts 5.5.11. We have the following facts about orthogonal complements.

( 1) If S T ,thenT ? S?. ? ⇢ ⇢

Proof. Observe x T ? if and only if x, t =0forallt T S. Hence 2 h i 2 ◆ x S?. 2 ⇤

( 2) S S?? and S? = S???. ? ⇢

Proof. If s S,then s, x = x, s =0forallx S?.Thuss S??.Since 2 h i h i 2 2 S?? is closed, S S??. ⇢ Now replacing S with S?,wegetS? S???.ButsinceS S??,by( 1), ⇢ ✓ ? we have S??? S?. ✓ ⇤

( 3) S S? = 0 . ? \ { }

Proof. If x S S?,then x, x =0,sox =0. 2 \ h i ⇤

( 4) If K H is a subspace, then H = K K?. ? ⇢ 117 Proof. By ( 2) and ( 3), ? ? 0 K K? K?? K? = 0 , { }✓ \ ✓ \ { } so equality holds everywhere. Let x H.SinceK is closed and convex, there is a unique y K minimizing 2 2 the distance to x,i.e., x y infk K x k .Weclaimthatx y K?, k k 2 k k 2 so that x = y +(x y), and H = K + K?.Indeed,forallk K and ↵ C, 2 2 x y 2 x (y ↵k) 2 = (x y)+↵k 2 ↵ C. k k k k k k 8 2 By (H2),wehave(x y) k for all k K,i.e.,x y K? as claimed. ? 2 2 ⇤

( 5) If K H is a subspace, then K = K??. ? ⇢

Proof. Let x K??.By( 4),thereareuniquey K and z K? such that x = y + z.Then2 ? 2 2 0= x, z = y + z,z = y, z + z,z . h i h i h i h i =0 by ( 2) ? Hence z =0,andx = y K. | {z } 2 ⇤

Notation 5.5.12 (Dirac bra-ket). Let (H, , ) be a Hilbert space, where , is linear h· ·i h· ·i on the left and conjugate linear on the right. Define : H H F by h·|·i ⇥ ! x y := y, x . h | i h i That is, is the ‘same’ inner product, but linear on the right and conjugate linear on the left. h·|·i We may further denote a vector x H by the ket x .Forx H,wedenotethelinear 2 | i 2 map H F by y x y by the bra x .Observethatthebra x applied to the ket y gives the! bracket x7!y h. | i h | h | | i h | i Theorem 5.5.13 (Riesz Representation). Let H be a Hilbert space.

(1) For all y H, y H⇤ and y = y . 2 h |2 kh |k k k (2) For ' H⇤, there is a unique y H such that ' = y . (3) The map2 y y is a conjugate-linear2 isometric isomorphism.h | 7! h | Proof. (1) Clearly y is linear. By Cauchy-Schwarz, y x x y ,so y y .Taking x = y, we haveh | y y = y 2,so y = y . |h | i| k k·k k kh |k  k k |h | i| k k kh |k k k (2) If y = y0 ,then h | h | 2 y y0 = y y0 y y0 = y y y0 y0 y y0 =0, k k h | i h | ih | i and thus y = y0. Suppose now ' H⇤.Wemayassume' =0.Thenker(') H is a closed 2 6 ⇢ proper subspace. Pick z ker(')? with '(z) = 1. Now for all x H, x '(x)z ker('), so 2 2 2 z x = z x '(x)z + '(x)z = z x '(x)z + z '(x)z = z '(x)z = '(x) z 2. h | i h | i h | i h | i h | i k k ker(')? ker(') 2 2 118 |{z} | {z } z We conclude that ' = z 2 . k k (3) y y is isometricD by (1) and onto by (2). Conjugate linearity is straightforward. 7! h | ⇤ Exercise 5.5.14. Suppose H is a Hilbert space. Show that the dual space H⇤ with x , y := y, x hh | h |iH⇤ h iH is a Hilbert space whose induced norm is equal to the operator norm on H⇤. Definition 5.5.15. AsubsetE H is called orthonormal if e, f E implies e, f = . ⇢ 2 h i e=f Observe that e f = p2foralle = f in E.ThusifH is separable, any orthonormal set is countable. k k 6 Exercise 5.5.16. Suppose H is a Hilbert space, E H is an orthonormal set, and ⇢ e1,...,en E.Provethefollowingassertions. { }⇢ n (1) If x = i=1 ciei,thencj = x, ej for all j =1,...,n. (2) The set E is linearly independent.h i P n (3) For every x H, i=1 x, ei ei is the unique element of span e1,...,en minimizing the distance2 to x. h i { } (4) (Bessel’s Inequality)P For every x H, x 2 n x, e 2. 2 k k i=1 |h ii| Theorem 5.5.17. For an orthonormal set E H, the following are equivalent: ⇢ P (1) E is maximal, (2) span(E), the set of finite linear combinations of elements of E, is dense in H. (3) x, e =0for all e E implies x =0. h i 2 (4) For all x H, x = e E x, e e, where the sum on the right: has at2 most countably2 h manyi non-zero terms, and • converges in theP norm topology regardless of ordering. • 2 2 (5) For all x H, x = e E x, e . 2 k k 2 |h i| If E satisfies the above properties, we call E an orthonormal basis for H. P Proof. (1) (2): If span(E)isnotdense,thereisane span(E)? with e =1.ThenE ( E e , ) 2 k k [{ } which is orthonormal. (2) (3): Suppose e, x =0foralle E.Thenx =0onspan(E). Since span(E)is ) h i 2 h | dense in H and x is continuous, x =0onH,andthusx =0bytheRieszRepresentation Theorem 5.5.13.h | h | (3) (1): (3) is equivalent to E? = 0. This means there is no strictly larger orthonormal set ) containing E. 2 n 2 (3) (4): For all e1,...,en E,byBessel’sInequality, x x, ei .Soforall ) 2 2 2 k k |h i| countable subsets F E, x f F x, f . Hence e E x, e =0 is countable. ⇢ k k 2 |h i| { 2 |hP i6 } Let (e ) be an enumeration of this set. Then i P n 2 n 2 m,n x, ei ei = x, ei !1 0. h i |h i| ! m m X X So x, ei ei converges asH is complete. Obsere that for all e E, h i 2 P x x, ei ei,e =0, h i D X 119 E so x = x, e e by (3). h ii i (4) (5): Let x H and let ei be an enumeration of e E x, e =0 .Then ) P 2 { } { 2 |h i6 } n n 2 2 2 n x x, ei = x x, ei ei !1 0. k k |h i| h i ! X X (Indeed, expand the term on the right into 4 terms to see you get the term on the left.) (5) (3): Immediate as is definite. ) k·k ⇤ Exercise 5.5.18. Suppose H is a Hilbert space. Prove the following assertions. (1) Every orthonormal set E can be extended to an orthonormal basis. (2) H is separable if and only if it has a countable orthonormal basis. (3) Two Hilbert spaces are isomorphic (there is an invertible U (H K)suchthat 2L ! Ux,Uy K = x, y for all x, y H)ifandonlyifH and K have orthonormal bases whichh arei theh samei size. 2 (4) If E is an orthonormal basis, the map H `2(E)givenbyx ( x, : E C) is a unitary isomorphism of Hilbert spaces.! Here, `2(E)denotessquareintegrable7! h ·i ! functions E C with respect to counting measure. ! Exercise 5.5.19. Consider the space L2(T):=L2(R/Z)ofZ-periodic functions R C such that f 2 < .Define ! [0,1] | | 1 R f,g := fg. h i Z[0,1] (1) Prove that L2(T) is a Hilbert space. (2) Show that the subspace C(T) L2(T)ofcontinuousZ-periodic functions is dense. ⇢ 2 (3) Prove that en(x):=exp(2⇡inx) n Z is an orthonormal basis for L (T). Hint: Orthonormality{ is easy. Use| 2 (2)} and the Stone-Weierstrass Theorem to show the is dense. 2 2 1 (4) Define : L (T) ` (Z)by (f)n := f,en L2( ) = f(x)exp( 2⇡inx) dx.Show F ! F h i T 0 that if f L2(T)and (f) `1(Z), then f C(T), i.e., f is a.e. equal to a continuous2 function. F 2 2 R

5.6. The dual of C0(X). Let X be an LCH space. In this section, we prove the Reisz Representation Theorem which characterizes the dual of C0(X)intermsofRadonmeasures on X. Definition 5.6.1. A Radon measure on X is a Borel measure which is finite on compact subsets of X, • outer regular on all Borel subsets of X,and • inner regular on all open subsets of X. • Facts 5.6.2. Recall the following facts about Radon measures on an LCH space X. (R1) If µ is a Radon measure on X and E X is -finite, then µ is -finite on E by Exercise 2.5.24(1). Hence every -finite⇢ Radon measure is regular. (R2) If X is -compact, every Radon measure is -finite and thus regular. (R3) Finite Radon measures on X are exactly finite regular Borel measures on X. 120 Exercise 5.6.3. Suppose X is LCH and µ is a Radon measure on X.ProveCc(X)isdense in 1(µ). L Notation 5.6.4. Recall that the support of f : X C is supp(f):= f =0 .Wesayf has ! { 6 } compact support if supp(f):= f =0 is compact, and we denote the (possibly non-unital) algebra of all continuous functions{ 6 of} compact support by C (X). For an open set U X, c ⇢ we write f U to denote 0 f 1andsupp(f) U.Observethatiff U,thenf U , but the converse need not be true. ⇢ 

Definition 5.6.5. A Radon integral on X is a positive linear functional ' : Cc(X) C, i.e., '(f) 0forallf C (X)suchthatf 0. ! 2 c Lemma 5.6.6. Radon integrals are bounded on compact subsets. That is, if K X is ⇢ compact, there is a cK > 0 such that for all f Cc(X) with supp(f) K, '(f) cK f . 2 ⇢ | | ·k k1 Proof. Let K X be compact. Choose g Cc(X)suchthatg =1onK by the LCH Urysohn Lemma⇢ (Exercise 1.2.11(2)). 2 Step 1: If f Cc(X, R) with supp(f) K,then f f g on X.So f g f 0, 2 ⇢ | |k k1 · k k1 · | | and f g f 0. Thus f '(g) '(f) 0. Hence k k1 · ± k k1 · ± '(f) '(g) f f Cc(X, R)withsupp(f) K. | | ·k k1 8 2 ⇢ Taking cK := '(g)worksforallf Cc(X, R). Step 2: Taking real and imaginary parts,2 we see c := 2'(g)worksforallf C (X). Indeed, K 2 c '(f) '(Re(f)) + '(Im(f)) '(g) Re(f) + '(g) Im(f) 2'(g) f | || | | | k k1 k k1  k k1 for all f C (X)withsupp(f) K. 2 c ⇢ ⇤ Theorem 5.6.7 (Riesz Representation). If ' is a Radon integral on X, there is a unique Radon measure µ' on X such that

'(f)= fdµ f C (X). ' 8 2 c Z Moreover, µ' satisfies:

(µ'1) For all open U X, µ'(U)=sup '(f) f Cc(X) with f U , and (µ 2) For all compact⇢K X, µ (K) ={ inf '|(f)2f C (X) with } f . ' ⇢ ' { | 2 c K  } Proof. Uniqueness: Suppose µ is a Radon measure such that '(f)= fdµfor all f C (X). If 2 c U X is open, then '(f) µ(U)forallf C (X)withf U.IfK U is compact, then ⇢  2 c R ⇢ by the LCH Urysohn Lemma (Exercise 1.2.11(2)), there is an f Cc(X)suchthatf U and f =1,and 2 |K µ(K) fdµ= '(f) µ(U).   Z But µ is inner regular on U as it is Radon, and thus µ(U)=sup µ(K) U K is compact sup '(f) f C (X)withf U µ(U). { | } { | 2 c } Hence µ satisfies (µ'1),soµ is determined on open sets. But since µ is outer regular, µ is determined on all Borel sets. 121 Existence: For U X open, define µ(U) := sup '(f) f C (X)withf U and ⇢ { | 2 c } µ⇤(E):=inf µ(U) U is open and E U E X. { | ⇢ } ⇢ Step 1: µ is monotone on inclusions of open sets, i.e., U V both open implies µ(U) µ(V ). ⇢  Hence µ⇤(U)=µ(U)forallopenU.

Proof. Just observe that if U V are open, then f Cc(X)withf U implies f V .Henceµ(U) µ✓(V )arewearetakingsupoverasuperset.2  ⇤

Step 2: µ⇤ is an outer measure on X.

Proof. It suces to prove that if (Un)isasequenceofopensets,then µ ( U ) µ(U ). This shows that n  n S µ⇤P(E) = inf µ(Un) the Un are open and E Un , ⇢ n o which we know is an outerX measure by Proposition 2.3.3. Suppose[ f Cc(X) N 2 with f Un.Sincesupp(f) is compact, supp(f) Un for some N N. ⇢ n=1 2

Trick.SBy Exercise 1.2.17,thereareg1,...,gN CSc(X)suchthatgn N 2 Un and n=1 gn =1onsupp(f).

P N Then f = f g and fg U for each n,so n=1 n n n N N N P '(f)= '(fg ) '( )= µ(U ) µ(U ). n  Un n  n n=1 n=1 n=1 X X X X Since f U was arbitrary, µ U =sup '(f) f C (X)withf U µ(U ). n 2 c n  n ⇤ ⇣ ⌘ n o [ [ X Step 3: Every open set is µ⇤-measurable, and thus ⇤,theµ⇤-measurable sets. Hence BX ⇢M µ' := µ⇤ is a Borel measure which is by definition outer regular and satisfies |BX (µ'1).

Proof. Suppose U X is open. We must prove that for every E X such ⇢ ⇢ that µ⇤(E) < , µ⇤(E) µ⇤(E U)+µ⇤(E U). 1 \ \ Case 1: If E is open, then E U is open. Given ">0, there is a f Cc(X) with f E U such that\ '(f) >µ(E U) "/2. Since E supp(2 f)is open, there is\ a g E supp(f)suchthat\ '(g) >µ(E supp(\ f)) "/2. Then f + g E,so \ \ µ(E) '(f)+'(g) >µ(E U)+µ(E supp(f)) " \ \ µ⇤(E U)+µ⇤(E U) ". \ \ Since ">0wasarbitrary,theresultfollows.

122 Case 2: For a general E, given ">0, there is an open V E such that ◆ µ(V ) <µ⇤(E)+".Thus

µ⇤(E)+">µ(V )

µ⇤(V U)+µ⇤(V U) \ \ µ⇤(E U)+µ⇤(E U). \ \ Again, as ">0wasarbitrary,theresultfollows. ⇤

Step 4: µ' satisfies (µ'2) and is thus finite on compact sets.

Proof. Suppose K X is compact and f C (X)with f.Let">0, ⇢ 2 c K  and set U" := 1 "0wasarbitrary,weconcludethatµ'(K) '(f). Now, for all open U K, by the LCH Urysohn Lemma (Exercise 1.2.11(2)), there is an f U such that f (f = 1), and by definition, '(f) K  |K  µ'(U). Since µ' is outer regular on K by definition, µ (K)=inf µ (U) K U open =inf '(f) f . ' { ' | ⇢ } { | K } ⇤

Step 5: µ' is inner regular on open sets and thus Radon.

Proof. If U X is open and 0 ↵<µ(U), choose f C (X)suchthat ⇢  2 c f U and '(f) >↵.Forallg Cc(X)withsupp(f) g,wehaveg f 0, so↵<'(f) '(g). Since (µ 22) holds, ↵<µ(supp(f)) µ(U). Hence µ is  '  inner regular on U. ⇤

Step 6: For all f C (X), '(f)= fdµ . 2 c ' R Proof. We may assume f Cc(X, [0, 1]) as this set spans Cc(X). Fix N N, and set K := f j/N 2for j =1,...,N +1andK := supp(f)sothat2 j { } 0 = K K K K =supp(f). ; N+1 ⇢ N ⇢···⇢ 1 ⇢ 0 for j =1,...,N,define j 1 1 f := f 0 j N _ ^ N ✓✓ ◆ ◆ which is equivalent to

0ifx/Kj 1 j 1 2 fj(x)= f(x) if x Kj 1 Kj 8 N 1 2 \ <>N if x Kj. 2 Observe that this implies: :> 123 Kj Kj 1 f for all j =1,...,N,and • N  j  N N f = f, • j=1 j which gives us the inequalities P 1 1 µ'(Kj) fj dµ' µ'(Kj 1). (5.6.8) N   N Z Now for all open U Kj 1, Nfj U,soN'(fj) µ'(U). By (µ'2) and  outer regularity of µ',wehavetheinequalities 1 1 µ'(Kj) '(fj) µ'(Kj 1). (5.6.9) N   N Now summing over j =1,...N for both (5.6.8)and(5.6.9), we have the inequalities N N 1 1 1 µ (K ) fdµ µ (K ) N ' j  '  N ' j j=1 j=0 X Z X N N 1 1 1 µ (K ) '(f) µ (K ). N ' j   N ' j j=1 j=0 X X This implies that

µ'(K0) µ'(KN ) µ'(supp(f)) N '(f) fdµ !1 0 '  N  N ! Z as µ'(supp( f)) < and N N was arbitrary. ⇤ 1 2

This completes the proof. ⇤ The following corollary is the upgrade of Proposition 2.5.22 promised in Remark 2.5.26. Corollary 5.6.10. Suppose X is LCH and every open subset of X is -compact (e.g., if X is second countable). Then every Borel measure on X which is finite on compact sets is Radon. Proof. Suppose µ is such a Borel measure. Since C (X) L1(µ), '(f):= fdµis a positive c ⇢ linear functional on Cc(X). By the Riesz Representation Theorem 5.6.7, there is a unique R Radon measure ⌫ on C such that '(f)= fd⌫for all Cc(X). It remains to prove µ = ⌫. For an open U X,writeU = Kj with Kj compact for all j.Wemayinductivelyfind ⇢ R n n 1 f C (X)suchthatf U and f =1onthecompactset K supp(f ). Then n 2 c n Sn j [ j fn U pointwise, so by the MCT 3.3.9, % S S µ(U) = lim fn dµ =lim'(fn)=lim fn d⌫ = ⌫(U). Z Z Now suppose E X is arbitrary. By (R2), ⌫ is a regular Borel measure, so by Exercise 2.5.23,given">20,B there are F E U with F closed, U open, and ⌫(U F ) <".But since U F is open, ⇢ ⇢ \ \ µ(U F )=⌫(U F ) <", \ \ and thus µ(U) " µ(E) µ(U). Hence µ is outer regular, and thus µ = ⌫. ⇤   124 Lemma 5.6.11. Suppose X is LCH and µ is a Radon measure on X. Define '(f):= fdµ on Cc(X). The following are equivalent: R (1) ' extends continuously to C0(X). (2) ' is bounded with respect to . (3) µ(X) is finite. k·k1 Proof. (1) (2): This follows as Cc(X) C0(X)isdensewithrespectto by the LCH Urysohn , ⇢ k·k1 Lemma (Exercise 1.2.11(2)). (2) (3): This follows as µ(X)=sup '(f)= fdµf C (X)with0 f 1 . , 2 c   ⇤ R Corollary 5.6.12. A positive linear functional in C0(X)⇤ is of the form dµ for some finite Radon measure µ. · R Proposition 5.6.13. If ' C0(X, R)⇤, there are positive ' C0(X, R)⇤ such that ' = 2 ± 2 '+ ' . Hence there are finite Radon measures µ1,µ2 on X such that

'(f)= fdµ1 fdµ2 = fd(µ1 µ2) f C0(X, R). 8 2 Z Z Z Proof. For f C0(X, [0 )), define '+(f):=sup '(g) 0 g f .Forf C0(X, R), 2 1 { |   } 2 define '+(f):='+(f+) '+(f )asf C0(X, [0, )). Step 1: For all f ,f C(X, [0, )) and± 2c 0, ' (cf1 + f )=c' (f )+' (f ). 1 2 2 0 1 + 1 2 + 1 + 2 Proof. It suces to show additivity. Whenever 0 g f and 0 g f ,  1  1  2  2 0 g1 + g2 f1 + f2.Thisimplies'+(f1 + f2) '+(f1)+'+(f2). Now if 0 g f + f ,setg := g f and g := g g .Then0 g f and   1 2 1 ^ 1 2 1  1  1 0 g2 f2,so   '(g)='(g )+'(g ) ' (f )+' (f ). 1 2  + 1 + 2 Taking sup over such g gives ' (f + f ) ' (f )+' (f ). + 1 2  + 1 + 2 ⇤

Step 2: If f C0(X, R)withf = g h where g, h 0, then '+(f)='+(g) '+(h). 2

Proof. Observe that g + f = h + f+ 0, so '+(g)+'(f )='+(h)+'+(f+)byStep 1. Rearranging gives the result. ⇤

Step 3: '+ is linear on C0(X, R).

Proof. Suppose c R and f,g C0(X, R). If c 0, then cf +g = cf+ +g+ (cf +g ) where cf + g 20. Then 2 ± ± '+(cf + g)='+(cf+ + g+) '+(cf + g )(Step2) = c'+(f+)+'+(g+) c'+(f ) ' (g )(Step1) = c('+(f+) '+(f )) + ('+(g+) '+(g )) = c'+(f)+'+(g) (Step 2). ⇤

125 Step 4: '+ C0(X, R)⇤ is positive with '+ ' . 2 k kk k Proof. First suppose f C (X, [0, )). Since 2 0 1 '(g) ' g ' f 0 g f, | |k k·k k1 k k·k k1 8   we have that

0='(0) '+(f) ' f f C0(X, [0, )).  k k·k k1 8 2 1 Now if f C0(X, R)isarbitrary, 2 '+(f) max '+(f+),'+(f ) ' max f+ , f ' f . | | { }k k· {k k1 k k1}k k·k k1 Hence ' ' . k +kk k ⇤

Step 5: Finally, the linear functional ' := '+ ' C0(X, R)⇤ is also positive as '+(f) 2 '(f)forallf C (X, [0, )) by definition of ' . 2 0 1 + ⇤ Exercise 5.6.14. For ' C0(X)⇤,therearefiniteRadonmeasuresµ0,µ1,µ2,µ3 on X such that 2 3 3 k k '(f)= i fdµk = fd i µk f C0(X). ! 8 2 Xk=0 Z Z Xk=0 Definition 5.6.15. Let X be an LCH space. AsignedBorelmeasure⌫ on X is called a signed Radon measure if ⌫ are Radon, • ± where ⌫ = ⌫+ ⌫ is the Jordan decomposition of ⌫.WedenotebyRM(X, R) ⇢ M(X, R)thesubsetoffinitesignedRadonmeasures. AcomplexBorelmeasure⌫ on X is called a complex Radon measure if Re(⌫), Im(⌫) • are Radon. We denote by RM(X, C) M(X, C)thesubsetofcomplexRadonmea- sures. ⇢ Exercise 5.6.16 (Lusin’s Theorem). Suppose X is LCH and µ is a Radon measure on X. If f : X C is measurable and vanishes outside a set of finite measure, then for all ">0, there is an! E with µ(Ec) <"and a g C (X) such that g = f on E.Moreover: 2BX 2 c If f < ,wecanarrangethat g f . • k k1 1 k k1 k k1 If im(f) R,wecanarrangethatim(g) R. • ⇢ ⇢ Theorem 5.6.17 (Real Riesz Representation). Suppose X is LCH. Define :RM(X, R) ! C0(X, R)⇤ by ⌫ '⌫ where '⌫(f):= fd⌫. Then is an isometric linear isomorphism. 7! Proof. Clearly is linear. By PropositionR 5.6.13,is surjective. It remains to prove is isometric, which also implies injectivity. Fix ⌫ RM. 2 '⌫ ⌫ : For all f C0(X, R), k kk k 2

'⌫(f) = fd⌫ = fd⌫+ fd⌫ fd⌫+ + fd⌫ | |  Z Z Z Z Z f d⌫+ + f d⌫ = f d⌫ f ⌫ RM.  | | | | | | | |k k1 ·k k Z Z Z Hence '⌫ ⌫ . k kk k 126 d⌫ '⌫ ⌫ : Since ⌫ is finite, by Exercise 4.2.11, d ⌫ =1onX ⌫ -a.e. Let ">0. Since ⌫ k kk k | | | | | | is finite, by Lusin’s Theorem (Exercise 5.6.16), there is an f Cc(X, R) such that f =1 2 k k1 d⌫ c and f = d ⌫ on E X where ⌫ (E ) <"/2. Then | | 2B | | d⌫ 2 d⌫ d⌫ d⌫ ⌫ = d ⌫ = d ⌫ = d ⌫ = d⌫ k k | | d ⌫ | | d ⌫ · d ⌫ | | (Ex. 4.2.11) d ⌫ Z Z Z Z | | | | | | | | d⌫ d⌫ fd⌫ + f d⌫ '⌫ f + f d ⌫  d ⌫ k k·k k1 d ⌫ | | Z Z Z | | =1 | | ' +2 ⌫ (Ec) ' +". k ⌫k | | k ⌫k | {z } Since ">0wasarbitrary, ⌫ ' . k kk ⌫k ⇤ Exercise 5.6.18 (Complex Riesz Representation). Suppose X is LCH. Define : RM(X, C) ! C0(X, C)⇤ by ⌫ '⌫ where '⌫(f):= fd⌫.Showthatisanisometriclinearisomor- phism. 7! R

127