On the Approximability of Injective Tensor Norm Vijay Bhattiprolu

Total Page:16

File Type:pdf, Size:1020Kb

On the Approximability of Injective Tensor Norm Vijay Bhattiprolu On the Approximability of Injective Tensor Norm Vijay Bhattiprolu CMU-CS-19-115 June 28, 2019 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Thesis Committee: Venkatesan Guruswami, Chair Anupam Gupta David Woodruff Madhur Tulsiani, TTIC Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy. Copyright c 2019 Vijay Bhattiprolu This research was sponsored by the National Science Foundation under award CCF-1526092, and by the National Science Foundation under award 1422045. The views and conclusions contained in this document are those of the author and should not be interpreted as representing the official policies, either expressed or implied, of any sponsoring institution, the U.S. government or any other entity. Keywords: Injective Tensor Norm, Operator Norm, Hypercontractive Norms, Sum of Squares Hierarchy, Convex Programming, Continuous Optimization, Optimization over the Sphere, Approximation Algorithms, Hardness of Approximation Abstract The theory of approximation algorithms has had great success with combinatorial opti- mization, where it is known that for a variety of problems, algorithms based on semidef- inite programming are optimal under the unique games conjecture. In contrast, the ap- proximability of most continuous optimization problems remains unresolved. In this thesis we aim to extend the theory of approximation algorithms to a wide class of continuous optimization problems captured by the injective tensor norm framework. Given an order-d tensor T, and symmetric convex sets C1,... Cd, the injective tensor norm of T is defined as sup hT , x1 ⊗ · · · ⊗ xdi, i x 2Ci Injective tensor norm has manifestations across several branches of computer science, optimization and analysis. To list some examples, it has connections to maximum singu- lar value, max-cut, Grothendieck’s inequality, non-commutative Grothendieck inequality, quantum information theory, k-XOR, refuting random constraint satisfaction problems, tensor PCA, densest-k-subgraph, and small set expansion. So a general theory of its ap- proximability promises to be of broad scope and applicability. We study various important special cases of the problem (through the lens of convex optimization and the sum of squares (SoS) hierarchy) and obtain the following results: - We obtain the first NP-hardness of approximation results for hypercontractive norms. Specifically, we prove inapproximability results for computing the p ! q operator norm (which is a special case of injective norm involving two convex sets) when p ≤ q and 2 62 [p, q]. Towards the goal of obtaining strong inapproximability results for 2 ! q norm when q > 2, we give random label cover (for which polynomial level SoS gaps are available) based hardness results for mixed norms, i.e., 2 ! `q(`q0 ) for some 2 < q, q0 < ¥. - We obtain improved approximation algorithms for computing the p ! q operator norm when p ≥ 2 ≥ q. - We introduce the technique of weak decoupling inequalities and use it to analyze the integrality gap of the SoS hierarchy for the maxima of various classes of polyno- mials over the sphere, namely arbitrary polynomials, polynomials with non-negative coefficients and sparse polynomials. We believe this technique is broadly applicable and could find use beyond optimization over the sphere. We also study how well higher levels of SoS approximate the maximum of a random polynomial over the sphere ([RRS16] concurrently obtained a similar result). Acknowledgements First and foremost I would like to thank my parents and sister for their undying support and patience. I owe a great deal to both of my grandfathers for encouraging me on my path and teaching me in my early years. I am most fortunate to have been advised by Venkat Guruswami. As all of his students would confirm, he adapts to the needs of his students and I can’t think of anything I wish he did differ- ently. He has been an excellent collaborator: he had troves of questions relevant to my background and interests and would constantly make prescient comments about my research directions. Any confidence I have in being able to survive outside the nest, I owe to Venkat’s style of advisory. I spent two wonderful summers (and more) at TTI chicago hosted by Madhur Tulsiani. Mad- hur has always been incredibly generous with his time and knowledge, and has been virtually a second advisor to me. Thanks Madhur! I greatly enjoyed my collaboration and friendship with Euiwoong and Mrinal. I’ve learned so much from both of them and I look forward to our collaborations for years to come. I am very grateful to Assaf Naor, Prasad Raghavendra and Pravesh Kothari for their insightful and influential comments on my research directions. Special thanks to Prasad for hosting me at Berkeley for a few months. I’d like to thank my committee (Venkat, Madhur, David Woodruff and Anupam Gupta) for taking the time and giving me valuable comments. My gratitude to Anupam, Danny and David for helping with Ph.D. program requirements. Ryan and Anupam have given several talks that I found inspiring and they are both amongst my go-to references on pedagogical issues. Special thanks to Anupam for going out of his way many times to tell me how I can improve. Thanks are due to Boris, Tom, Po and Ravi for teaching fun courses. I am grateful to Gary for sparking my interest in spectral theory. My five years at CMU have been the most enjoyable in my lifetime so far. A big part of this is due to the wonderful group of peers I had. While it would be impossible to list them all, some memories that stand out are: ploughing through coursework with David Wajc and Arash; working at coffee shops with Nic, Naama and Nika; working nights at GHC with Yu, Daniel and Lei; ping pong with David Wajc, John, Ainesh, Anish, Goran, Angela, Pedro, Sahil, Sai and David Kurokawa; climbing with Colin, Roie, Aria, Greg, Anson, Andrei, Ellis, and Woneui; classical music concerts with John, Yu and Ellen; board games with Sol, Ameya and many others; fun conversations with Amir, Ilqar, Laxman, Guru, Jakub, Alex, Sidhanth and David Witmer. Last but not least I would like to thank Deb Cavlovich without whom I imagine SCS would cease functioning. i Contents I Preamble1 1 Introduction2 1.1 Convex Programming Relaxations........................5 1.2 Sum of Squares Hierarchy.............................5 1.3 Brief Summary of Contributions.........................6 1.4 Chapter Credits...................................7 1.5 Organization.....................................7 2 Detailed Results8 2.1 `p ! `q Operator Norms..............................8 2.1.1 Hypercontractive norms, Small-Set Expansion, and Hardness.....9 2.1.2 The non-hypercontractive case....................... 11 2.2 Polynomial Optimization over the Sphere.................... 15 II Degree-2 (Operator Norms) 18 3 Preliminaries (Normed Spaces) 19 3.1 Vectors........................................ 19 3.2 Norms........................................ 19 3.3 `p Norms....................................... 20 3.4 Operator Norm................................... 20 3.5 Type and Cotype.................................. 21 3.6 p-convexity and q-concavity............................ 23 3.7 Convex Relaxation for Operator Norm...................... 23 3.8 Factorization of Linear Operators......................... 25 4 Hardness results for p!q norm 27 4.1 Proof Overview................................... 28 4.2 Preliminaries and Notation............................ 29 ii 4.2.1 Fourier Analysis.............................. 30 4.2.2 Smooth Label Cover............................ 31 4.3 Hardness of 2!r norm with r < 2........................ 31 4.3.1 Reduction and Completeness....................... 32 4.3.2 Soundness.................................. 33 4.4 Hardness of p!q norm............................... 35 4.4.1 Hardness for p ≥ 2 ≥ q .......................... 36 4.4.2 Reduction from p!2 norm via Approximate Isometries....... 36 4.4.3 Derandomized Reduction......................... 38 4.4.4 Hypercontractive Norms Productivize.................. 40 4.4.5 A Simple Proof of Hardness for the Case 22 / [q, p] ........... 41 4.5 Dictatorship Test.................................. 45 5 Algorithmic results for p!q norm 48 5.1 Proof overview................................... 48 5.2 Relation to Factorization Theory......................... 50 5.3 Approximability and Factorizability....................... 51 5.4 Notation....................................... 51 5.5 Analyzing the Approximation Ratio via Rounding............... 52 5.5.1 Krivine’s Rounding Procedure...................... 52 5.5.2 Generalizing Random Hyperplane Rounding – Hölder Dual Round- ing...................................... 53 5.5.3 Generalized Krivine Transformation and the Full Rounding Proce- dure..................................... 54 5.5.4 Auxiliary Functions............................ 55 5.5.5 Bound on Approximation Factor..................... 55 5.6 Hypergeometric Representation.......................... 57 5.6.1 Hermite Preliminaries........................... 57 5.6.2 Hermite Coefficients via Parabolic Cylinder Functions........ 59 5.6.3 Taylor Coefficients of f........................... 62 5.7 Bound on Defect................................... 64 5.7.1 Behavior of The Coefficients of The Inverse Function......... 64 5.7.2 Bounding Inverse Coefficients...................... 66 5.8 Factorization of Linear Operators......................... 75 5.8.1 Integrality Gap Implies Factorization Upper Bound.......... 75 5.8.2
Recommended publications
  • Surjective Isometries on Grassmann Spaces 11
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Repository of the Academy's Library SURJECTIVE ISOMETRIES ON GRASSMANN SPACES FERNANDA BOTELHO, JAMES JAMISON, AND LAJOS MOLNAR´ Abstract. Let H be a complex Hilbert space, n a given positive integer and let Pn(H) be the set of all projections on H with rank n. Under the condition dim H ≥ 4n, we describe the surjective isometries of Pn(H) with respect to the gap metric (the metric induced by the operator norm). 1. Introduction The study of isometries of function spaces or operator algebras is an important research area in functional analysis with history dating back to the 1930's. The most classical results in the area are the Banach-Stone theorem describing the surjective linear isometries between Banach spaces of complex- valued continuous functions on compact Hausdorff spaces and its noncommutative extension for general C∗-algebras due to Kadison. This has the surprising and remarkable consequence that the surjective linear isometries between C∗-algebras are closely related to algebra isomorphisms. More precisely, every such surjective linear isometry is a Jordan *-isomorphism followed by multiplication by a fixed unitary element. We point out that in the aforementioned fundamental results the underlying structures are algebras and the isometries are assumed to be linear. However, descriptions of isometries of non-linear structures also play important roles in several areas. We only mention one example which is closely related with the subject matter of this paper. This is the famous Wigner's theorem that describes the structure of quantum mechanical symmetry transformations and plays a fundamental role in the probabilistic aspects of quantum theory.
    [Show full text]
  • 1 Lecture 09
    Notes for Functional Analysis Wang Zuoqin (typed by Xiyu Zhai) September 29, 2015 1 Lecture 09 1.1 Equicontinuity First let's recall the conception of \equicontinuity" for family of functions that we learned in classical analysis: A family of continuous functions defined on a region Ω, Λ = ffαg ⊂ C(Ω); is called an equicontinuous family if 8 > 0; 9δ > 0 such that for any x1; x2 2 Ω with jx1 − x2j < δ; and for any fα 2 Λ, we have jfα(x1) − fα(x2)j < . This conception of equicontinuity can be easily generalized to maps between topological vector spaces. For simplicity we only consider linear maps between topological vector space , in which case the continuity (and in fact the uniform continuity) at an arbitrary point is reduced to the continuity at 0. Definition 1.1. Let X; Y be topological vector spaces, and Λ be a family of continuous linear operators. We say Λ is an equicontinuous family if for any neighborhood V of 0 in Y , there is a neighborhood U of 0 in X, such that L(U) ⊂ V for all L 2 Λ. Remark 1.2. Equivalently, this means if x1; x2 2 X and x1 − x2 2 U, then L(x1) − L(x2) 2 V for all L 2 Λ. Remark 1.3. If Λ = fLg contains only one continuous linear operator, then it is always equicontinuous. 1 If Λ is an equicontinuous family, then each L 2 Λ is continuous and thus bounded. In fact, this boundedness is uniform: Proposition 1.4. Let X,Y be topological vector spaces, and Λ be an equicontinuous family of linear operators from X to Y .
    [Show full text]
  • The Banach-Alaoglu Theorem for Topological Vector Spaces
    The Banach-Alaoglu theorem for topological vector spaces Christiaan van den Brink a thesis submitted to the Department of Mathematics at Utrecht University in partial fulfillment of the requirements for the degree of Bachelor in Mathematics Supervisor: Fabian Ziltener date of submission 06-06-2019 Abstract In this thesis we generalize the Banach-Alaoglu theorem to topological vector spaces. the theorem then states that the polar, which lies in the dual space, of a neighbourhood around zero is weak* compact. We give motivation for the non-triviality of this theorem in this more general case. Later on, we show that the polar is sequentially compact if the space is separable. If our space is normed, then we show that the polar of the unit ball is the closed unit ball in the dual space. Finally, we introduce the notion of nets and we use these to prove the main theorem. i ii Acknowledgments A huge thanks goes out to my supervisor Fabian Ziltener for guiding me through the process of writing a bachelor thesis. I would also like to thank my girlfriend, family and my pet who have supported me all the way. iii iv Contents 1 Introduction 1 1.1 Motivation and main result . .1 1.2 Remarks and related works . .2 1.3 Organization of this thesis . .2 2 Introduction to Topological vector spaces 4 2.1 Topological vector spaces . .4 2.1.1 Definition of topological vector space . .4 2.1.2 The topology of a TVS . .6 2.2 Dual spaces . .9 2.2.1 Continuous functionals .
    [Show full text]
  • Bounded Operator - Wikipedia, the Free Encyclopedia
    Bounded operator - Wikipedia, the free encyclopedia http://en.wikipedia.org/wiki/Bounded_operator Bounded operator From Wikipedia, the free encyclopedia In functional analysis, a branch of mathematics, a bounded linear operator is a linear transformation L between normed vector spaces X and Y for which the ratio of the norm of L(v) to that of v is bounded by the same number, over all non-zero vectors v in X. In other words, there exists some M > 0 such that for all v in X The smallest such M is called the operator norm of L. A bounded linear operator is generally not a bounded function; the latter would require that the norm of L(v) be bounded for all v, which is not possible unless Y is the zero vector space. Rather, a bounded linear operator is a locally bounded function. A linear operator on a metrizable vector space is bounded if and only if it is continuous. Contents 1 Examples 2 Equivalence of boundedness and continuity 3 Linearity and boundedness 4 Further properties 5 Properties of the space of bounded linear operators 6 Topological vector spaces 7 See also 8 References Examples Any linear operator between two finite-dimensional normed spaces is bounded, and such an operator may be viewed as multiplication by some fixed matrix. Many integral transforms are bounded linear operators. For instance, if is a continuous function, then the operator defined on the space of continuous functions on endowed with the uniform norm and with values in the space with given by the formula is bounded.
    [Show full text]
  • Chapter 6 Linear Transformations and Operators
    Chapter 6 Linear Transformations and Operators 6.1 The Algebra of Linear Transformations Theorem 6.1.1. Let V and W be vector spaces over the field F . Let T and U be two linear transformations from V into W . The function (T + U) defined pointwise by (T + U)(v) = T v + Uv is a linear transformation from V into W . Furthermore, if s F , the function (sT ) ∈ defined by (sT )(v) = s (T v) is also a linear transformation from V into W . The set of all linear transformation from V into W , together with the addition and scalar multiplication defined above, is a vector space over the field F . Proof. Suppose that T and U are linear transformation from V into W . For (T +U) defined above, we have (T + U)(sv + w) = T (sv + w) + U (sv + w) = s (T v) + T w + s (Uv) + Uw = s (T v + Uv) + (T w + Uw) = s(T + U)v + (T + U)w, 127 128 CHAPTER 6. LINEAR TRANSFORMATIONS AND OPERATORS which shows that (T + U) is a linear transformation. Similarly, we have (rT )(sv + w) = r (T (sv + w)) = r (s (T v) + (T w)) = rs (T v) + r (T w) = s (r (T v)) + rT (w) = s ((rT ) v) + (rT ) w which shows that (rT ) is a linear transformation. To verify that the set of linear transformations from V into W together with the operations defined above is a vector space, one must directly check the conditions of Definition 3.3.1. These are straightforward to verify, and we leave this exercise to the reader.
    [Show full text]
  • Linear Algebra Review
    1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic facts about real and complex numbers. In particular, both R and C are fields; they satisfy the field axioms. For p z = x + iy 2 C, the modulus, i.e. jzj = x2 + y2 ≥ 0, represents the distance from z to the origin in the complex plane. (As such, it coincides with the absolute value for real z.) For z = x + iy 2 C, complex conjugation, i.e. z = x − iy, represents reflection about the x-axis in the complex plane. It will also be important that both R and C are complete, as metric spaces, when equipped with the metric d(z; w) = jz − wj. 1.1. Vector Spaces. One of the most important notions in this course is that of a vector space. Although vector spaces can be defined over any field, we will (by and large) restrict our attention to fields F 2 fR; Cg. The following definition is fundamental. Definition 1.1. Let F be a field. A vector space V over F is a non-empty set V (the elements of V are called vectors) over a field F (the elements of F are called scalars) equipped with two operations: i) To each pair u; v 2 V , there exists a unique element u + v 2 V . This operation is called vector addition. ii) To each u 2 V and α 2 F, there exists a unique element αu 2 V .
    [Show full text]
  • U(T)\\ for All S, Te CD(H) (See [8, P. 197])
    proceedings of the american mathematical society Volume 110, Number 3, November 1990 ON SOME EQUIVALENT METRICS FOR BOUNDED OPERATORS ON HILBERT SPACE FUAD KITTANEH (Communicated by Palle E. T. Jorgensen) Abstract. Several operator norm inequalities concerning the equivalence of some metrics for bounded linear operators on Hilbert space are given. In addi- tion, some related inequalities for the Hilbert-Schmidt norm are presented. 1. Introduction Let H be a complex Hilbert space and let CD(H) denote the family of closed, densely defined linear operators on H, and B(H) the bounded members of CD(H). For each T G CD(H), let 11(F) denote the orthogonal projection of H @ H onto the graph of F, and let a(T) denote the pure contraction defined by a(T) = T(l + T*T)~ ' . The gap metric on CD(H) is defined by d(S, T) = \\U(S) - U(T)\\ for all S, Te CD(H) (see [8, p. 197]). In [11], W. E. Kaufman introduced a metric ô on CD(H) defined by ô(S, T) = \\a(S)-a(T)\\ for all S, TeCD(H) and he showed that this metric is stronger than the gap metric d and not equivalent to it. He also stated that on B(H) the gap metric d is equivalent to the metric generated by the usual operator norm and he proved that the metric ô has this property. The purpose of this paper is to present quantitative estimates to this effect. In §2, we present several operator norm inequalities to compare the metric ô, the gap metric d, and the usual operator norm metric.
    [Show full text]
  • Functional Analysis (Under Construction)
    Functional Analysis (under construction) Gustav Holzegel∗ March 21, 2015 Contents 1 Motivation and Literature 2 2 Metric Spaces 3 2.1 Examples . .3 2.2 Topological refresher . .5 2.3 Completeness . .6 2.4 Completion of metric spaces . .8 3 Normed Spaces and Banach Spaces 8 3.1 Linear Algebra refresher . .8 3.2 Definition and elementary properties . .9 3.3 Finite vs the Infinite dimensional normed spaces . 11 4 Linear Operators 16 4.1 Bounded Linear Operators . 16 4.2 Restriction and Extension of operators . 18 4.3 Linear functionals . 19 4.4 Normed Spaces of Operators . 20 5 The dual space and the Hahn-Banach theorem 21 5.1 The proof . 25 5.2 Examples: The dual of `1 ...................... 28 5.3 The dual of C [a; b].......................... 29 5.4 A further application . 31 5.5 The adjoint operator . 32 6 The Uniform Boundedness Principle 34 6.1 Application 1: Space of Polynomials . 36 6.2 Application 2: Fourier Series . 37 6.3 Final Remarks . 38 6.4 Strong and Weak convergence . 39 ∗Imperial College London, Department of Mathematics, South Kensington Campus, Lon- don SW7 2AZ, United Kingdom. 1 7 The open mapping and closed graph theorem 44 7.1 The closed graph theorem . 46 8 Hilbert Spaces 48 8.1 Basic definitions . 48 8.2 Closed subspaces and distance . 50 8.3 Orthonormal sets and sequences [lecture by I.K.] . 52 8.4 Total Orthonormal Sets and Sequences . 53 8.5 Riesz Representation Theorem . 55 8.6 Applications of Riesz' theorem & the Hilbert-adjoint . 56 8.7 Self-adjoint and unitary operators .
    [Show full text]
  • Operators on Indefinite Inner Product Spaces
    OPERATORS ON INDEFINITE INNER PRODUCT SPACES Michael A Dritschel and James Rovnyak Department of Mathematics University of Virginia Charlottesville Virginia U S A Mathematics Subject Classication Primary B A Secondary C E A A A Contents Preface Intro duction Preliminaries and Notation A Prerequisites B Inner pro duct spaces C Kren spaces and fundamental decomp ositions D Example E Bo oks and exp ositions Lecture Kren Spaces and Op erators Lecture Julia Op erators and Contractions Addendum Adjoints of contractions Lecture Extension and Completion Problems Lecture The Schur Algorithm Lecture Repro ducing Kernel Pontryagin Spaces and Colligations Lecture Invariant Subspaces A The commutant of a selfadjoint op erator B Dual pairs of invariant subspaces for denitizable op erators C Compact p erturbations of denitizable op erators Addendum Nondenitizable op erators Bibliography Index 1 2 M A Dritschel and J Rovnyak Preface Kren space op erator theory has long b een a principal area of research in eastern mathematics and it is now enjoying a surge of interest in western countries as well The present lectures survey some recent metho ds and results which center around factorization prop erties of op erators Topics include the geometry of Kren spaces Pontryagin spaces isometric op erators contractions dilation and extension problems repro ducing kernel spaces op erator colligations denitizable op erators and invariant subspaces Factorization ideas lead to notions of defect and Julia
    [Show full text]
  • Lecture Notes on Matrix Analysis
    Lecture notes on matrix analysis Mark W. Meckes April 27, 2019 Contents 1 Linear algebra background 3 1.1 Fundamentals . .3 1.2 Matrices and linear maps . .4 1.3 Rank and eigenvalues . .6 2 Matrix factorizations 7 2.1 SVD: The fundamental theorem of matrix analysis . .7 2.2 A first application: the Moore{Penrose inverse . .9 2.3 The spectral theorems and polar decomposition . 10 2.4 Factorizations involving triangular matrices . 14 2.5 Simultaneous factorizations . 18 3 Eigenvalues of Hermitian matrices 20 3.1 Variational formulas . 20 3.2 Inequalities for eigenvalues of two Hermitian matrices . 22 3.3 Majorization . 26 4 Norms 31 4.1 Vector norms . 31 4.2 Special classes of norms . 33 4.3 Duality . 35 4.4 Matrix norms . 37 4.5 The spectral radius . 40 4.6 Unitarily invariant norms . 43 4.7 Duality for matrix norms . 48 5 Some topics in solving linear systems 50 5.1 Condition numbers . 50 5.2 Sparse signal recovery . 52 6 Positive (semi)definite matrices 55 6.1 Characterizations . 55 6.2 Kronecker and Hadamard products . 57 6.3 Inequalities for positive (semi)definite matrices . 58 1 7 Locations and perturbations of eigenvalues 60 7.1 The Gerˇsgorincircle theorem . 60 7.2 Eigenvalue perturbations for non-Hermitian matrices . 61 8 Nonnegative matrices 64 8.1 Inequalities for the spectral radius . 64 8.2 Perron's theorem . 67 8.3 Irreducible nonnegative matrices . 71 8.4 Stochastic matrices and Markov chains . 73 8.5 Reversible Markov chains . 76 8.6 Convergence rates for Markov chains .
    [Show full text]
  • 208 C*-Algebras
    208 C*-algebras Marc Rieffel Notes by Qiaochu Yuan Spring 2013 Office hours: M 9:30-10:45, W 1:15-2:)0, F 9-10, 811 Evans Recommended text: Davidson, C*-algebras 1 Introduction The seeds of this subject go back to von Neumann, Heisenberg, and Schrodinger in the 1920s; observables in quantum mechanics should correspond to self-adjoint operators on Hilbert spaces, and the abstract context for understanding self-adjoint operators is C*-algebras. In the 1930s, von Neumann wrote about what are now called von Neumann algebras, namely subalgebras of the algebra of operators on a Hilbert space closed under adjoints and in the strong operator topology. This subject is sometimes called noncommutative measure theory because a commutative von Neumann algebra is isomorphic to L1(X) for some measure space X. In 1943, Gelfand and Naimark introduced the notion of a C*-algebra, namely a Banach algebra with an involution ∗ satisfying ka∗k = kak and ka∗ak = kak2. They showed that if such an algebra A is commutative, then it is isomorphic to the C*-algebra C(X) of continuous complex-valued functions on a compact Hausdorff space X. This space X is obtained as the Gelfand spectrum of unital C*-algebra homomorphisms A ! C. Noncommutative examples include the algebra B(H) of bounded operators on a Hilbert space. Gelfand and Naimark also showed that any C*-algebra is *-isomorphic to a *-algebra of operators on a Hilbert space. This subject is sometimes called noncommutative topology (as C*-algebras behave like the algebra of functions on a compact Hausdorff space).
    [Show full text]
  • 1 Banach Vs. Hilbert Spaces
    36-771 Fall 2018 Martingales 1 : Concentration inequalities Martingale inequalities in Banach spaces Lecturer : Aaditya Ramdas 1 Banach vs. Hilbert spaces A Banach space B is a complete normed vector space. In terms of generality, it lies somewhere in between a metric space M (that has a metric, but no norm) and a Hilbert space H (that has an inner-product, and hence a norm, that in turn induces a metric). More formally, if a space is endowed with an inner-product h·; ·i, then it induces a norm k · k as kxk = phx; xi, and if a space is endowed with a norm, then it induces a metric d(x; y) = kx − yk. By \complete" normed vector space, one usually means that every Cauchy sequence (with respect to the norm) converges to a point that lies in the space. A metric space is called \separable" if it has a dense subset that is countable. A Hilbert space is separable iff it has a countable orthonormal basis. n n When the underlying space is simply C or R , any choice of norm k·kp for 1 ≤ p ≤ 1 yields a Banach space, while only the choice k:k2 leads to a Hilbert space. Similarly, if (X ; Ω; µ) is a probability space, then the following space is a Banach space Z p p L (X ; Ω; µ) := ff : X! C such that f is Ω-measurable and jf(x)j dµ(x) < 1g R p 1=p with norm kfkp := ( jf(x)j dµ(x)) (with f = g meaning that they are equal µ-a.e.).
    [Show full text]