• Completeness • the Space !!L2 (A,B) • the Closest Point Property

Total Page:16

File Type:pdf, Size:1020Kb

• Completeness • the Space !!L2 (A,B) • the Closest Point Property HILBERT AND BANACH SPACES • Completeness • The Space L (a,b) ! 2 • The Closest Point Property • Banach Fixed Point Theorem EL3370 Hilbert and Banach Spaces - 1 COMPLETENESS A property that many important metric spaces share is completeness: a sequence that seems to converge, actually does. This, however, does not always hold (recall the l ! 0 example from last lecture). This property is what distinguishes from ! Definition {x } is a Cauchy sequence in a metric space (X ,d) if, for every ε > 0, there is an N ∈ such ! n ! ! ! that for all n,m > N , d(x ,x )< ε ! ! n m !(X ,d) is a complete metric space if every Cauchy sequence in !X is convergent Observation Every convergent sequence in a metric space is a Cauchy sequence (exercise!) EL3370 Hilbert and Banach Spaces - 2 COMPLETENESS (CONT.) Example 1 and are complete, while is not: take x = 1+1 1!+1 2!++1 n!; {x } is a Cauchy ! n ! n sequence in , since it is convergent in (and hence Cauchy in ), but its limit in is !e , which is not rational (see bonus slides for proof) Example 2 1 Consider C[0,1], with inner product (x, y)= x(t)y(t)dt ! ! ∫0 This space is not complete: consider the sequence {x } in ! n the figure. This sequence is Cauchy, since d(x ,x )< ε when ! n m n,m >1 ε . However, {x } is not convergent: for every x ∈X , ! ! n ! 1 2 2 1 2+1 n 2 1 2 d2(x ,x)= x(t) dt + x (t)− x(t) dt + 1− x(t) dt ! n ∫0 ∫1 2 n ∫1 2+1 n d(x ,x)→ 0 means that x(t)= 0 for t <1 2 and x(t)= 1 for ! n ! ! ! !t >1 2, but then !x cannot be continuous! EL3370 Hilbert and Banach Spaces - 3 COMPLETENESS (CONT.) Theorem n ! and l are complete metric spaces ! 2 Proof (for l2 ). Most completeness proofs follow these steps: ! n 1) Take a Cauchy sequence {x } 2) Postulate a candidate limit !x 3) Show that !x belongs to the metric space 4) Show that x n → x Steps: n n n n 1) Pick a Cauchy sequence {x } in l , where x = {x ,x ,…} ! ! 2 ! 1 2 n 2) Consider a fixed index !k . Since !{x } is Cauchy, for a given !ε > 0 there is an !N > 0 such 2 n m ∞ n m n m n that x − x ≤ x − x = d(x ,x )< ε when n,m > N . Hence, {x } is Cauchy in , ! k k ∑i=0 i i ! ! k n so it converges to, say, x . Therefore, consider the candidate limit x = {x ,x ,…} ! k ! 1 2 EL3370 Hilbert and Banach Spaces - 4 COMPLETENESS (CONT.) Proof (cont.) n n n n 3) We will show that x − x ∈l2 for some !n. As x ∈l2, this implies that x = x −(x − x)∈l2 ! ! ! n n m Since !{x } is Cauchy, given !ε > 0 there is an !N > 0 such that !d(x ,x )< ε for !n,m > N . Fix !M ∈ . Then, for !n,m > N , M 2 ∞ 2 x n − x m ≤ x n − x m = d2(x n ,x m )< ε 2 !∑i=1 i i ∑i=1 i i M 2 Taking the limit !m→ ∞, we get x n − x ≤ ε 2 , and taking !M → ∞ we finally obtain !∑i=1 i i 2 ∞ 2 x n x x n x 2 , hence x n x , and x − = i 1 i − i ≤ ε − ∈l2 ∈l2 ! ∑ = ! ! n n 4) We have shown in Step 3 that there is an !N > 0 such that ! x − x ≤ ε for !n > N , so !x → x We have proven that every Cauchy sequence in l is convergent. This means that l is ! 2 ! 2 complete ■ EL3370 Hilbert and Banach Spaces - 5 COMPLETENESS (CONT.) Definition Hilbert Space: Inner product space which is complete (as a metric space) Banach Space: Normed space which is complete (as a metric space) Every Hilbert space is a Banach space, but not conversely. E.g., l is a Banach space, but ∞ not a Hilbert space, since the l -norm does not satisfy the parallelogram law (exercise!) ∞ Examples 1. The l space (for 1≤ p ≤ ∞) are Banach spaces. Of them, only l is a Hilbert space ! p ! ! 2 2. Every finite-dimensional normed space is Banach (prove it! [this follows from Exercise Set n 2]). In particular, ! is a Banach space for every !p-norm (!1≤ p ≤ ∞) EL3370 Hilbert and Banach Spaces - 6 THE SPACE L (a,b) ! 2 1 We have seen that C[0,1] with inner product (x, y)= x(t)y(t)dt is not complete. The ! ! ∫0 problem lies in requiring that the elements of !C[0,1] should be continuous functions Removing this requirement leads to Definition Let −∞ ≤ a < b ≤ ∞. L (a,b) is the vector space of Lebesgue measurable functions ! ! 2 b 2 b f :(a,b)→ such that f (t) dt < ∞, with inner product (x, y)= x(t)y(t)dt ! !∫a ! ∫a Subtlety b 2 b 2 (x,x)= x(t) dt = 0 for some !x ≠ 0! (e.g., x(t) dt = 0 if x(t)≠ 0 only for finite # of !t ’s) ! ∫a !∫a ! b 2 To solve this, define an equivalence relation on L (a,b): x y iff x(t)− y(t) dt = 0 ! 2 ! !∫a This relation is compatible with the operations in L (a,b) (i.e., if x x and y y , then ! 2 ! 1 2 ! 1 2 x + y x + y , λx λx and (x , y )= (x , y )) ! 1 1 2 2 ! 1 2 ! 1 1 2 2 EL3370 Hilbert and Banach Spaces - 7 THE SPACE L (a,b) (CONT.) ! 2 Digression (Density and separability) Let X be a metric space, and D ⊆ X . D is dense in X if D = X , i.e., if every point in X can be approximated arbitrarily well by points in D. E.g., the set of real-valued polynomials in [a,b] is dense in C[a,b] (this will be proven in Lecture 5) A metric space is separable if it contains a countable subset which is dense in it. Many proofs in functional analysis can be simplified if the underlying space is separable Examples 1. ! is separable: a countable dense set in ! is {x + iy : x, y ∈!}. Thus, ! is separable too 2. l is not separable: Let A ⊆ l be the set of sequences x = {x ,x ,…} where x ∈{0,1}. ∞ ∞ 1 2 k Each x ∈A can be mapped to a number xˆ = x /2+ x /22 + x /23 +!∈[0,1]. The mapping 1 2 3 is bijective (except for the countable set of numbers with finite binary expansion), and [0,1] is uncountable, so A is uncountable. If x, y ∈A and x ≠ y , then x − y = 1, hence ∞ every dense set in l must be uncountable (why?) ∞ 3. (1 p ) is separable: The set M of sequences of the form x {x , ,x ,0,0, } for lp ≤ < ∞ = 1 … n … some n∈!, and x ∈!, is countable and dense in l (exercise!) k p EL3370 Hilbert and Banach Spaces - 8 THE SPACE L (a,b) (CONT.) ! 2 It can be proven that L (a,b) is a Hilbert space, and that C[a,b] is a dense subspace of ! 2 ! L (a,b) (i.e., C[a,b]⊂ L (a,b), and the closure of C[a,b] is L (a,b)) ! 2 ! 2 ! ! 2 Similarly, we can define the Banach spaces L (a,b) (1≤ p ≤ ∞) of Lebesgue measurable ! p ! b p functions f :(a,b)→ such that f (t) dt < ∞ (for p < ∞) or esssup f (t) < ∞ (for ! !∫a ! ! t∈[a,b] !p = ∞ ), with norm 1 p ⎧ b p ⎪ x(t) dt , 1≤ p < ∞ x p := ⎨ ()∫a ⎪ esssup x(t) , p = ∞ ! ⎩ t∈[a,b] EL3370 Hilbert and Banach Spaces - 9 THE CLOSEST POINT PROPERTY Remember the “projection theorem”? (shortest distance from a point to a plane is achieved n by the perpendicular) This result is fundamental in ! , and it also holds in Hilbert spaces! Definition A subset !A of a vector space is convex if, for all !x, y ∈A and !0≤ λ ≤1, !λx +(1− λ)y ∈A. Definition In an inner product space !V , !x, y ∈V are orthogonal, !x ⊥ y , if !(x, y)= 0. !x is orthogonal to a subset !S ⊆ V , !x ⊥ S , if !x ⊥ s for all !s ∈S Lemma (Pythagorean theorem) 2 2 2 If !x, y are orthogonal in an inner product space, then ! x + y = x + y (Exercise!) EL3370 Hilbert and Banach Spaces - 10 THE CLOSEST POINT PROPERTY (CONT.) x Theorem (Closest point property) Let !M be a non-empty closed convex set in a Hilbert space !V . δ For every !x ∈V there is a unique point !y ∈M which is closer to !x than any other point of !M (i.e., x − y = inf x − m ) y ! m∈M M Why closed and convex? x x x δ δ δ δ δ M M M (No y) (A unique y) (Infinitely may y’s) In a Banach space there may be infinitely many closest points, or none at all EL3370 Hilbert and Banach Spaces - 11 THE CLOSEST POINT PROPERTY (CONT.) Proof 1) Existence: Let δ = inf x − m , which is finite (because M ≠ ∅). Then, for each n∈ ! m∈M ! ! 2 there is a y ∈M such that x − y ≤δ 2 + n−1 . We will show that { y } is Cauchy: For n,m, ! n ! n ! n ! 2 2 2 2 (x − yn )−(x − ym ) + (x − yn )+(x − ym ) = 2 x − yn +2 x − ym (parallelogram!law) 2 ⎛ 1 1 ⎞ < 4δ +2⎜ + ⎟ ! ⎝ n m⎠ 2 2 2 ⎛ 1 1 ⎞ or!! y − y < 4δ +2⎜ + ⎟ − 4 x −( y + y )/2 n m ⎝ n m⎠ n m 2 ⎛ 1 1 ⎞ 2 < 4δ +2⎜ + ⎟ − 4δ (because!M!is!convex,!so!(y + y ) 2∈M) ⎝ n m⎠ n m ⎛ 1 1 ⎞ < 2⎜ + ⎟ ! ⎝ n m⎠ so { y } is Cauchy, and it converges, say, to y ∈M (since M is closed).
Recommended publications
  • FUNCTIONAL ANALYSIS 1. Metric and Topological Spaces A
    FUNCTIONAL ANALYSIS CHRISTIAN REMLING 1. Metric and topological spaces A metric space is a set on which we can measure distances. More precisely, we proceed as follows: let X 6= ; be a set, and let d : X×X ! [0; 1) be a map. Definition 1.1. (X; d) is called a metric space if d has the following properties, for arbitrary x; y; z 2 X: (1) d(x; y) = 0 () x = y (2) d(x; y) = d(y; x) (3) d(x; y) ≤ d(x; z) + d(z; y) Property 3 is called the triangle inequality. It says that a detour via z will not give a shortcut when going from x to y. The notion of a metric space is very flexible and general, and there are many different examples. We now compile a preliminary list of metric spaces. Example 1.1. If X 6= ; is an arbitrary set, then ( 0 x = y d(x; y) = 1 x 6= y defines a metric on X. Exercise 1.1. Check this. This example does not look particularly interesting, but it does sat- isfy the requirements from Definition 1.1. Example 1.2. X = C with the metric d(x; y) = jx−yj is a metric space. X can also be an arbitrary non-empty subset of C, for example X = R. In fact, this works in complete generality: If (X; d) is a metric space and Y ⊆ X, then Y with the same metric is a metric space also. Example 1.3. Let X = Cn or X = Rn. For each p ≥ 1, n !1=p X p dp(x; y) = jxj − yjj j=1 1 2 CHRISTIAN REMLING defines a metric on X.
    [Show full text]
  • Course 221: Michaelmas Term 2006 Section 3: Complete Metric Spaces, Normed Vector Spaces and Banach Spaces
    Course 221: Michaelmas Term 2006 Section 3: Complete Metric Spaces, Normed Vector Spaces and Banach Spaces David R. Wilkins Copyright c David R. Wilkins 1997–2006 Contents 3 Complete Metric Spaces, Normed Vector Spaces and Banach Spaces 2 3.1 The Least Upper Bound Principle . 2 3.2 Monotonic Sequences of Real Numbers . 2 3.3 Upper and Lower Limits of Bounded Sequences of Real Numbers 3 3.4 Convergence of Sequences in Euclidean Space . 5 3.5 Cauchy’s Criterion for Convergence . 5 3.6 The Bolzano-Weierstrass Theorem . 7 3.7 Complete Metric Spaces . 9 3.8 Normed Vector Spaces . 11 3.9 Bounded Linear Transformations . 15 3.10 Spaces of Bounded Continuous Functions on a Metric Space . 19 3.11 The Contraction Mapping Theorem and Picard’s Theorem . 20 3.12 The Completion of a Metric Space . 23 1 3 Complete Metric Spaces, Normed Vector Spaces and Banach Spaces 3.1 The Least Upper Bound Principle A set S of real numbers is said to be bounded above if there exists some real number B such x ≤ B for all x ∈ S. Similarly a set S of real numbers is said to be bounded below if there exists some real number A such that x ≥ A for all x ∈ S. A set S of real numbers is said to be bounded if it is bounded above and below. Thus a set S of real numbers is bounded if and only if there exist real numbers A and B such that A ≤ x ≤ B for all x ∈ S.
    [Show full text]
  • General Topology
    General Topology Tom Leinster 2014{15 Contents A Topological spaces2 A1 Review of metric spaces.......................2 A2 The definition of topological space.................8 A3 Metrics versus topologies....................... 13 A4 Continuous maps........................... 17 A5 When are two spaces homeomorphic?................ 22 A6 Topological properties........................ 26 A7 Bases................................. 28 A8 Closure and interior......................... 31 A9 Subspaces (new spaces from old, 1)................. 35 A10 Products (new spaces from old, 2)................. 39 A11 Quotients (new spaces from old, 3)................. 43 A12 Review of ChapterA......................... 48 B Compactness 51 B1 The definition of compactness.................... 51 B2 Closed bounded intervals are compact............... 55 B3 Compactness and subspaces..................... 56 B4 Compactness and products..................... 58 B5 The compact subsets of Rn ..................... 59 B6 Compactness and quotients (and images)............. 61 B7 Compact metric spaces........................ 64 C Connectedness 68 C1 The definition of connectedness................... 68 C2 Connected subsets of the real line.................. 72 C3 Path-connectedness.......................... 76 C4 Connected-components and path-components........... 80 1 Chapter A Topological spaces A1 Review of metric spaces For the lecture of Thursday, 18 September 2014 Almost everything in this section should have been covered in Honours Analysis, with the possible exception of some of the examples. For that reason, this lecture is longer than usual. Definition A1.1 Let X be a set. A metric on X is a function d: X × X ! [0; 1) with the following three properties: • d(x; y) = 0 () x = y, for x; y 2 X; • d(x; y) + d(y; z) ≥ d(x; z) for all x; y; z 2 X (triangle inequality); • d(x; y) = d(y; x) for all x; y 2 X (symmetry).
    [Show full text]
  • Be a Metric Space
    2 The University of Sydney show that Z is closed in R. The complement of Z in R is the union of all the Pure Mathematics 3901 open intervals (n, n + 1), where n runs through all of Z, and this is open since every union of open sets is open. So Z is closed. Metric Spaces 2000 Alternatively, let (an) be a Cauchy sequence in Z. Choose an integer N such that d(xn, xm) < 1 for all n ≥ N. Put x = xN . Then for all n ≥ N we have Tutorial 5 |xn − x| = d(xn, xN ) < 1. But xn, x ∈ Z, and since two distinct integers always differ by at least 1 it follows that xn = x. This holds for all n > N. 1. Let X = (X, d) be a metric space. Let (xn) and (yn) be two sequences in X So xn → x as n → ∞ (since for all ε > 0 we have 0 = d(xn, x) < ε for all such that (yn) is a Cauchy sequence and d(xn, yn) → 0 as n → ∞. Prove that n > N). (i)(xn) is a Cauchy sequence in X, and 4. (i) Show that if D is a metric on the set X and f: Y → X is an injective (ii)(xn) converges to a limit x if and only if (yn) also converges to x. function then the formula d(a, b) = D(f(a), f(b)) defines a metric d on Y , and use this to show that d(m, n) = |m−1 − n−1| defines a metric Solution.
    [Show full text]
  • DEFINITIONS and THEOREMS in GENERAL TOPOLOGY 1. Basic
    DEFINITIONS AND THEOREMS IN GENERAL TOPOLOGY 1. Basic definitions. A topology on a set X is defined by a family O of subsets of X, the open sets of the topology, satisfying the axioms: (i) ; and X are in O; (ii) the intersection of finitely many sets in O is in O; (iii) arbitrary unions of sets in O are in O. Alternatively, a topology may be defined by the neighborhoods U(p) of an arbitrary point p 2 X, where p 2 U(p) and, in addition: (i) If U1;U2 are neighborhoods of p, there exists U3 neighborhood of p, such that U3 ⊂ U1 \ U2; (ii) If U is a neighborhood of p and q 2 U, there exists a neighborhood V of q so that V ⊂ U. A topology is Hausdorff if any distinct points p 6= q admit disjoint neigh- borhoods. This is almost always assumed. A set C ⊂ X is closed if its complement is open. The closure A¯ of a set A ⊂ X is the intersection of all closed sets containing X. A subset A ⊂ X is dense in X if A¯ = X. A point x 2 X is a cluster point of a subset A ⊂ X if any neighborhood of x contains a point of A distinct from x. If A0 denotes the set of cluster points, then A¯ = A [ A0: A map f : X ! Y of topological spaces is continuous at p 2 X if for any open neighborhood V ⊂ Y of f(p), there exists an open neighborhood U ⊂ X of p so that f(U) ⊂ V .
    [Show full text]
  • Chapter 7. Complete Metric Spaces and Function Spaces
    43. Complete Metric Spaces 1 Chapter 7. Complete Metric Spaces and Function Spaces Note. Recall from your Analysis 1 (MATH 4217/5217) class that the real numbers R are a “complete ordered field” (in fact, up to isomorphism there is only one such structure; see my online notes at http://faculty.etsu.edu/gardnerr/4217/ notes/1-3.pdf). The Axiom of Completeness in this setting requires that ev- ery set of real numbers with an upper bound have a least upper bound. But this idea (which dates from the mid 19th century and the work of Richard Dedekind) depends on the ordering of R (as evidenced by the use of the terms “upper” and “least”). In a metric space, there is no such ordering and so the completeness idea (which is fundamental to all of analysis) must be dealt with in an alternate way. Munkres makes a nice comment on page 263 declaring that“completeness is a metric property rather than a topological one.” Section 43. Complete Metric Spaces Note. In this section, we define Cauchy sequences and use them to define complete- ness. The motivation for these ideas comes from the fact that a sequence of real numbers is Cauchy if and only if it is convergent (see my online notes for Analysis 1 [MATH 4217/5217] http://faculty.etsu.edu/gardnerr/4217/notes/2-3.pdf; notice Exercise 2.3.13). 43. Complete Metric Spaces 2 Definition. Let (X, d) be a metric space. A sequence (xn) of points of X is a Cauchy sequence on (X, d) if for all ε > 0 there is N N such that if m, n N ∈ ≥ then d(xn, xm) < ε.
    [Show full text]
  • Chapter 2 Metric Spaces and Topology
    2.1. METRIC SPACES 29 Definition 2.1.29. The function f is called uniformly continuous if it is continu- ous and, for all > 0, the δ > 0 can be chosen independently of x0. In precise mathematical notation, one has ( > 0)( δ > 0)( x X) ∀ ∃ ∀ 0 ∈ ( x x0 X d (x , x0) < δ ), d (f(x ), f(x)) < . ∀ ∈ { ∈ | X 0 } Y 0 Definition 2.1.30. A function f : X Y is called Lipschitz continuous on A X → ⊆ if there is a constant L R such that dY (f(x), f(y)) LdX (x, y) for all x, y A. ∈ ≤ ∈ Let fA denote the restriction of f to A X defined by fA : A Y with ⊆ → f (x) = f(x) for all x A. It is easy to verify that, if f is Lipschitz continuous on A ∈ A, then fA is uniformly continuous. Problem 2.1.31. Let (X, d) be a metric space and define f : X R by f(x) = → d(x, x ) for some fixed x X. Show that f is Lipschitz continuous with L = 1. 0 0 ∈ 2.1.3 Completeness Suppose (X, d) is a metric space. From Definition 2.1.8, we know that a sequence x , x ,... of points in X converges to x X if, for every δ > 0, there exists an 1 2 ∈ integer N such that d(x , x) < δ for all i N. i ≥ 1 n = 2 n = 4 0.8 n = 8 ) 0.6 t ( n f 0.4 0.2 0 1 0.5 0 0.5 1 − − t Figure 2.1: The sequence of continuous functions in Example 2.1.32 satisfies the Cauchy criterion.
    [Show full text]
  • 3 Limits of Sequences and Filters
    3 Limits of Sequences and Filters The Axiom of Choice is obviously true, the well-ordering theorem is obviously false; and who can tell about Zorn’s Lemma? —Jerry Bona (Schechter, 1996) Introduction. Chapter 2 featured various properties of topological spaces and explored their interactions with a few categorical constructions. In this chapter we’ll again discuss some topological properties, this time with an eye toward more fine-grained ideas. As introduced early in a study of analysis, properties of nice topological spaces X can be detected by sequences of points in X. We’ll be interested in some of these properties and the extent to which sequences suffice to detect them. But take note of the adjective “nice” here. What if X is any topological space, not just a nice one? Unfortunately, sequences are not well suited for characterizing properties in arbitrary spaces. But all is not lost. A sequence can be replaced with a more general construction—a filter—which is much better suited for the task. In this chapter we introduce filters and highlight some of their strengths. Our goal is to spend a little time inside of spaces to discuss ideas that may be familiar from analysis. For this reason, this chapter contains less category theory than others. On the other hand, we’ll see in section 3.3 that filters are a bit like functors and hence like generalizations of points. This perspective thus gives us a coarse-grained approach to investigating fine-grained ideas. We’ll go through some of these basic ideas—closure, limit points, sequences, and more—rather quickly in sections 3.1 and 3.2.
    [Show full text]
  • Metric Spaces
    Chapter 1. Metric Spaces Definitions. A metric on a set M is a function d : M M R × → such that for all x, y, z M, Metric Spaces ∈ d(x, y) 0; and d(x, y)=0 if and only if x = y (d is positive) MA222 • ≥ d(x, y)=d(y, x) (d is symmetric) • d(x, z) d(x, y)+d(y, z) (d satisfies the triangle inequality) • ≤ David Preiss The pair (M, d) is called a metric space. [email protected] If there is no danger of confusion we speak about the metric space M and, if necessary, denote the distance by, for example, dM . The open ball centred at a M with radius r is the set Warwick University, Spring 2008/2009 ∈ B(a, r)= x M : d(x, a) < r { ∈ } the closed ball centred at a M with radius r is ∈ x M : d(x, a) r . { ∈ ≤ } A subset S of a metric space M is bounded if there are a M and ∈ r (0, ) so that S B(a, r). ∈ ∞ ⊂ MA222 – 2008/2009 – page 1.1 Normed linear spaces Examples Definition. A norm on a linear (vector) space V (over real or Example (Euclidean n spaces). Rn (or Cn) with the norm complex numbers) is a function : V R such that for all · → n n , x y V , x = x 2 so with metric d(x, y)= x y 2 ∈ | i | | i − i | x 0; and x = 0 if and only if x = 0(positive) i=1 i=1 • ≥ cx = c x for every c R (or c C)(homogeneous) • | | ∈ ∈ n n x + y x + y (satisfies the triangle inequality) Example (n spaces with p norm, p 1).
    [Show full text]
  • Metric Spaces
    Empirical Processes: Lecture 06 Spring, 2010 Introduction to Empirical Processes and Semiparametric Inference Lecture 06: Metric Spaces Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research University of North Carolina-Chapel Hill 1 Empirical Processes: Lecture 06 Spring, 2010 §Introduction to Part II ¤ ¦ ¥ The goal of Part II is to provide an in depth coverage of the basics of empirical process techniques which are useful in statistics: Chapter 6: mathematical background, metric spaces, outer • expectation, linear operators and functional differentiation. Chapter 7: stochastic convergence, weak convergence, other modes • of convergence. Chapter 8: empirical process techniques, maximal inequalities, • symmetrization, Glivenk-Canteli results, Donsker results. Chapter 9: entropy calculations, VC classes, Glivenk-Canteli and • Donsker preservation. Chapter 10: empirical process bootstrap. • 2 Empirical Processes: Lecture 06 Spring, 2010 Chapter 11: additional empirical process results. • Chapter 12: the functional delta method. • Chapter 13: Z-estimators. • Chapter 14: M-estimators. • Chapter 15: Case-studies II. • 3 Empirical Processes: Lecture 06 Spring, 2010 §Topological Spaces ¤ ¦ ¥ A collection of subsets of a set X is a topology in X if: O (i) and X , where is the empty set; ; 2 O 2 O ; (ii) If U for j = 1; : : : ; m, then U ; j 2 O j=1;:::;m j 2 O (iii) If U is an arbitrary collection of Tmembers of (finite, countable or f αg O uncountable), then U . α α 2 O S When is a topology in X, then X (or the pair (X; )) is a topological O O space, and the members of are called the open sets in X.
    [Show full text]
  • Banach and Fréchet Spaces of Functions 1. Function Spaces C K[A, B]
    (March 15, 2014) Banach and Fr´echetspaces of functions Paul Garrett [email protected] http:=/www.math.umn.edu/egarrett/ [This document is http://www.math.umn.edu/~garrett/m/fun/notes 2012-13/02 spaces fcns.pdf] Many familiar and useful spaces of continuous or differentiable functions, such as Ck[a; b], have natural metric structures, and are complete. Often, the metric d(; ) comes from a norm jj· jj, on the functions, meaning that d(f; g) = jjf − gjj where the norm itself has 8 jjfjj ≥ 0; with jjfjj = 0 only for f = 0 (positivity) > <> jjf + gjj ≤ jjfjj + jjgjj (triangle inequality) > :> jjα · fjj = jαj · jjfjj for α 2 C (homogeneity) A vector space with complete metric coming from a norm is a Banach space. Natural Banach spaces of functions are many of the most natural function spaces. Other natural function spaces, such as C1[a; b] and Co(R), are not Banach, but still have a metric topology and are complete: these are Fr´echetspaces, appearing as limits [1] of Banach spaces. These lack some of the conveniences of Banach spaces, but their expressions as limits of Banach spaces is often sufficient. o Other important spaces, such as compactly-supported continuous functions Cc (R) on R, or compactly- 1 supported smooth functions Cc (R) on R, are not reasonably metrizable at all. Some of these important spaces are expressible as colimits [2] of Banach or Fr´echet spaces, and such descriptions suffice for many applications. First, we look at some naturally occurring Banach and Fr´echet spaces. Our main point will be to prove completeness with the natural metrics.
    [Show full text]
  • Metric, Normed, and Topological Spaces
    Chapter 13 Metric, Normed, and Topological Spaces A metric space is a set X that has a notion of the distance d(x; y) between every pair of points x; y 2 X. A fundamental example is R with the absolute-value metric d(x; y) = jx − yj, and nearly all of the concepts we discuss below for metric spaces are natural generalizations of the corresponding concepts for R. A special type of metric space that is particularly important in analysis is a normed space, which is a vector space whose metric is derived from a norm. On the other hand, every metric space is a special type of topological space, which is a set with the notion of an open set but not necessarily a distance. The concepts of metric, normed, and topological spaces clarify our previous discussion of the analysis of real functions, and they provide the foundation for wide-ranging developments in analysis. The aim of this chapter is to introduce these spaces and give some examples, but their theory is too extensive to describe here in any detail. 13.1. Metric spaces A metric on a set is a function that satisfies the minimal properties we might expect of a distance. Definition 13.1. A metric d on a set X is a function d : X × X ! R such that for all x; y; z 2 X: (1) d(x; y) ≥ 0 and d(x; y) = 0 if and only if x = y (positivity); (2) d(x; y) = d(y; x) (symmetry); (3) d(x; y) ≤ d(x; z) + d(z; y) (triangle inequality).
    [Show full text]