The Spectra of Large Toeplitz Band Matrices with A

Total Page:16

File Type:pdf, Size:1020Kb

The Spectra of Large Toeplitz Band Matrices with A MATHEMATICS OF COMPUTATION Volume 72, Number 243, Pages 1329{1348 S 0025-5718(03)01505-9 Article electronically published on February 3, 2003 THESPECTRAOFLARGETOEPLITZBANDMATRICES WITH A RANDOMLY PERTURBED ENTRY A. BOTTCHER,¨ M. EMBREE, AND V. I. SOKOLOV Abstract. (j;k) This paper is concerned with the union spΩ Tn(a) of all possible spectra that may emerge when perturbing a large n n Toeplitz band matrix × Tn(a)inthe(j; k) site by a number randomly chosen from some set Ω. The main results give descriptive bounds and, in several interesting situations, even (j;k) provide complete identifications of the limit of sp Tn(a)asn .Also Ω !1 discussed are the cases of small and large sets Ω as well as the \discontinuity of (j;k) the infinite volume case", which means that in general spΩ Tn(a)doesnot converge to something close to sp(j;k) T (a)asn ,whereT (a)isthecor- Ω !1 responding infinite Toeplitz matrix. Illustrations are provided for tridiagonal Toeplitz matrices, a notable special case. 1. Introduction and main results For a complex-valued continuous function a on the complex unit circle T,the infinite Toeplitz matrix T (a) and the finite Toeplitz matrices Tn(a) are defined by n T (a)=(aj k)j;k1 =1 and Tn(a)=(aj k)j;k=1; − − where a` is the `th Fourier coefficient of a, 2π 1 iθ i`θ a` = a(e )e− dθ; ` Z: 2π 2 Z0 Here, we restrict our attention to the case where a is a trigonometric polynomial, a , implying that at most a finite number of the Fourier coefficients are nonzero; equivalently,2P T (a) is a banded matrix. The matrix T (a) induces a bounded operator 2 n 2 on ` (N), and we think of Tn(a) as a bounded operator on C with the ` norm. Let A stand for T (a)orTn(a). The spectrum sp A is defined as usual, that is, as the set of all λ C for which A λI is not invertible. Given a complex number !, 2 − we denote by !ejek∗ the matrix that is zero everywhere except in the (j; k)entry, which is !. For a subset Ω of C, we put (j;k) spΩ A = sp(A + !ejek∗): ! Ω [2 Received by the editor August 3, 2001. 2000 Mathematics Subject Classification. Primary 47B35, 65F15; Secondary 15A18, 47B80, 82B44. Key words and phrases. Toeplitz operator, pseudospectrum, random perturbation. The work of the second author was supported by UK Engineering and Physical Sciences Re- search Council Grant GR/M12414. c 2003 American Mathematical Society 1329 License or copyright restrictions may apply to redistribution; see https://www.ams.org/journal-terms-of-use 1330 A. BOTTCHER,¨ M. EMBREE, AND V. I. SOKOLOV (j;k) Thus, spΩ A is the union of all possible spectra that may emerge as the result of a perturbation of A in the (j; k) site by a number randomly chosen in Ω. The (j;k) purpose of this paper is to study spΩ Tn(a)forfixedj, k,andΩasn . Gohberg identified the spectrum of T (a) in 1952 [12], proving that !1 (1.1) sp T (a)=a(T) λ C a(T) : wind(a; λ) =0 ; [f 2 n 6 g where wind(a; λ) is the winding number of a (on the counterclockwise oriented unit circle) about λ.EverypointinspT (a) a(T) is an eigenvalue of finite multiplicity of T (a) or the transpose of T (a); a pointn on a(T) may be an eigenvalue or not. The spectra of the large finite Toeplitz matrices Tn(a) were studied in 1960 by Schmidt and Spitzer [26], who observed that the sets sp Tn(a)convergeinthe Hausdorff metric to a limiting set Λ(a), (1.2) lim sp Tn(a)=Λ(a): n !1 The set Λ(a) is either a singleton or the union of at most finitely many analytic arcs, each pair of which has at most endpoints in common; it can be described as k follows. We can write a(t)= k akt (t T), the sum being finite. For % (0; ), k k 2 2 1 define a% by a%(t)= ak% t (t T). Then 2P kP 2 (1.3)P Λ(a)= sp T (a%): %>0 \ From (1.1), (1.2), and (1.3) we see that in general sp Tn(a) does not converge to sp T (a). Surprisingly, pseudospectra of Toeplitz matrices behave differently. For ">0, the "-pseudospectrum sp" A is defined by sp" A = sp(A + K); K " k [k≤ with the union taken over all matrices K (of the same size as A) which induce an operator of norm at most " (see, e.g., [7], [27], [28]). Landau [20] and Reichel and Trefethen [24] (also see [2] and [7]) showed that for each ">0, (1.4) lim sp" Tn(a)=sp" T (a): n !1 It is the abyss between (1.2) and (1.4) that makes the question of the limit of (j;k) spΩ Tn(a) intriguing. To state precise results, we need some more preliminaries. For a sequence Mn 1 of nonempty sets Mn C, consider the limiting sets f gn=1 ⊂ lim inf Mn := λ C : λ is the limit of some n f 2 !1 sequence λn 1 with λn Mn ; f gn=1 2 g lim sup Mn := λ C : λ is a partial limit of some n f 2 !1 sequence λn 1 with λn Mn : f gn=1 2 g Notice that if all the sets involved are compact, then the two equalities lim inf Mn = lim sup Mn = M n n !1 !1 are equivalent to saying that Mn converges to M in the Hausdorff metric (see [14, Sections 3.1.1 and 3.1.2] or [16, Section 28]), in which case we simply write lim Mn = M; n !1 as in (1.2) and (1.4). License or copyright restrictions may apply to redistribution; see https://www.ams.org/journal-terms-of-use LARGE TOEPLITZ BAND MATRICES WITH A RANDOMLY PERTURBED ENTRY 1331 If λ C Λ(a), then, by (1.3), there is a %>0 such that T (a% λ) is invertible. We show2 inn Lemma 3.1 that − 1 j k (1.5) T − (a% λ)= % − djk(λ) 1 − j;k=1 with analytic functions djk : C Λ(a) C that do not depend on %.(Hereandin 1 n ! 1 what follows, we write T − ( )for(T ( ))− .) For a set M C, we define 1=M by · · ⊂ − 1=M = γ C :1+µγ =0 forsome µ M : − f 2 2 g It is well known and easily seen that if 0 Ω, then 2 (j;k) 1 (1.6) sp A =spA λ/sp A :[(A λI)− ]kj 1=Ω ; Ω [f 2 − ∈− g 1 1 where [(A λI)− ]kj is the (k; j) entry of the resolvent (A λI)− .Consequently, letting − − jk (1.7) H (a)= λ C Λ(a):dkj(λ) 1=Ω ; Ω f 2 n ∈− g we obtain (1.8) sp(j;k) T (a)=spT (a) Hjk(a): Ω [ Ω (Note that for λ outside sp T (a)wecantake(1.5)with% =1.)Formula(1.8) disposes of the \infinite volume case". In the \finite volume case" we have the following theorem, which is the main result of this paper. Theorem 1.1. Let a and let Ω be a compact subset of C that contains the 2P origin. If dkj : C Λ(a) C is identically zero or nowhere locally constant or assumes a constantn value c!that does not belong to 1=Ω,then − (j;k) jk (1.9) lim sp Tn(a)=Λ(a) H (a): n Ω Ω !1 [ We conjecture that for every a and every (j; k) the function dkj is either identically zero or nowhere locally constant,2P and hence that (1.9) is always true, but we have not been able to prove this. The results of [6] imply at least the following. Theorem 1.2. Let a be of the form 2Pq k (1.10) a(t)= akt ;p 0;q 0;apaq =0; ≥ ≥ − 6 k= p X− and let G be a bounded component of C sp T (a). The function d11 is always n nowhere locally constant in G.Ifk 1 or j 1, then the function dkj is either identically zero in G or nowhere locally≥ constant≥ in G, provided one of the following conditions is satisfied: (a) C Λ(a) is connected; (b) p orn q equals 1; (c) p + q is a prime number and p or q equals 2; (d) p + q =4or p + q =7. We remark that C Λ(a) is in particular connected if T (a) is tridiagonal (which means that p + q = 2)n or triangular (p =0orq = 0) or Hermitian. Condition (b) is equivalent to saying that T (a) is a Hessenberg matrix. Notice that we may also without loss of generality assume that p q (otherwise we may pass to the adjoint operator). The case p + q =3iscoveredby(a)for≤ p =0andby(b)forp =1, while the case p + q = 5 is contained in (a) for p =0,in(b)forp =1,andin(c) for p = 2. We have no result in the case p + q = 6 (unless p =0orp =1). License or copyright restrictions may apply to redistribution; see https://www.ams.org/journal-terms-of-use 1332 A. BOTTCHER,¨ M. EMBREE, AND V. I. SOKOLOV Since sp T (a) is in general much larger than Λ(a), we see from (1.8) and (1.9) that (j;k) spΩ generically behaves discontinuously when passing from large finite Toeplitz matrices to infinite Toeplitz matrices.
Recommended publications
  • Periodic Staircase Matrices and Generalized Cluster Structures
    PERIODIC STAIRCASE MATRICES AND GENERALIZED CLUSTER STRUCTURES MISHA GEKHTMAN, MICHAEL SHAPIRO, AND ALEK VAINSHTEIN Abstract. As is well-known, cluster transformations in cluster structures of geometric type are often modeled on determinant identities, such as short Pl¨ucker relations, Desnanot–Jacobi identities and their generalizations. We present a construction that plays a similar role in a description of general- ized cluster transformations and discuss its applications to generalized clus- ter structures in GLn compatible with a certain subclass of Belavin–Drinfeld Poisson–Lie brackets, in the Drinfeld double of GLn, and in spaces of periodic difference operators. 1. Introduction Since the discovery of cluster algebras in [4], many important algebraic varieties were shown to support a cluster structure in a sense that the coordinate rings of such variety is isomorphic to a cluster algebra or an upper cluster algebra. Lie theory and representation theory turned out to be a particularly rich source of varieties of this sort including but in no way limited to such examples as Grassmannians [5, 18], double Bruhat cells [1] and strata in flag varieties [15]. In all these examples, cluster transformations that connect distinguished coordinate charts within a ring of regular functions are modeled on three-term relations such as short Pl¨ucker relations, Desnanot–Jacobi identities and their Lie-theoretic generalizations of the kind considered in [3]. This remains true even in the case of exotic cluster structures on GLn considered in [8, 10] where cluster transformations can be obtained by applying Desnanot–Jacobi type identities to certain structured matrices of a size far exceeding n.
    [Show full text]
  • Arxiv:Math/0010243V1
    FOUR SHORT STORIES ABOUT TOEPLITZ MATRIX CALCULATIONS THOMAS STROHMER∗ Abstract. The stories told in this paper are dealing with the solution of finite, infinite, and biinfinite Toeplitz-type systems. A crucial role plays the off-diagonal decay behavior of Toeplitz matrices and their inverses. Classical results of Gelfand et al. on commutative Banach algebras yield a general characterization of this decay behavior. We then derive estimates for the approximate solution of (bi)infinite Toeplitz systems by the finite section method, showing that the approximation rate depends only on the decay of the entries of the Toeplitz matrix and its condition number. Furthermore, we give error estimates for the solution of doubly infinite convolution systems by finite circulant systems. Finally, some quantitative results on the construction of preconditioners via circulant embedding are derived, which allow to provide a theoretical explanation for numerical observations made by some researchers in connection with deconvolution problems. Key words. Toeplitz matrix, Laurent operator, decay of inverse matrix, preconditioner, circu- lant matrix, finite section method. AMS subject classifications. 65T10, 42A10, 65D10, 65F10 0. Introduction. Toeplitz-type equations arise in many applications in mathe- matics, signal processing, communications engineering, and statistics. The excellent surveys [4, 17] describe a number of applications and contain a vast list of references. The stories told in this paper are dealing with the (approximate) solution of biinfinite, infinite, and finite hermitian positive definite Toeplitz-type systems. We pay special attention to Toeplitz-type systems with certain decay properties in the sense that the entries of the matrix enjoy a certain decay rate off the diagonal.
    [Show full text]
  • THREE STEPS on an OPEN ROAD Gilbert Strang This Note Describes
    Inverse Problems and Imaging doi:10.3934/ipi.2013.7.961 Volume 7, No. 3, 2013, 961{966 THREE STEPS ON AN OPEN ROAD Gilbert Strang Massachusetts Institute of Technology Cambridge, MA 02139, USA Abstract. This note describes three recent factorizations of banded invertible infinite matrices 1. If A has a banded inverse : A=BC with block{diagonal factors B and C. 2. Permutations factor into a shift times N < 2w tridiagonal permutations. 3. A = LP U with lower triangular L, permutation P , upper triangular U. We include examples and references and outlines of proofs. This note describes three small steps in the factorization of banded matrices. It is written to encourage others to go further in this direction (and related directions). At some point the problems will become deeper and more difficult, especially for doubly infinite matrices. Our main point is that matrices need not be Toeplitz or block Toeplitz for progress to be possible. An important theory is already established [2, 9, 10, 13-16] for non-Toeplitz \band-dominated operators". The Fredholm index plays a key role, and the second small step below (taken jointly with Marko Lindner) computes that index in the special case of permutation matrices. Recall that banded Toeplitz matrices lead to Laurent polynomials. If the scalars or matrices a−w; : : : ; a0; : : : ; aw lie along the diagonals, the polynomial is A(z) = P k akz and the bandwidth is w. The required index is in this case a winding number of det A(z). Factorization into A+(z)A−(z) is a classical problem solved by Plemelj [12] and Gohberg [6-7].
    [Show full text]
  • Arxiv:2004.05118V1 [Math.RT]
    GENERALIZED CLUSTER STRUCTURES RELATED TO THE DRINFELD DOUBLE OF GLn MISHA GEKHTMAN, MICHAEL SHAPIRO, AND ALEK VAINSHTEIN Abstract. We prove that the regular generalized cluster structure on the Drinfeld double of GLn constructed in [9] is complete and compatible with the standard Poisson–Lie structure on the double. Moreover, we show that for n = 4 this structure is distinct from a previously known regular generalized cluster structure on the Drinfeld double, even though they have the same compatible Poisson structure and the same collection of frozen variables. Further, we prove that the regular generalized cluster structure on band periodic matrices constructed in [9] possesses similar compatibility and completeness properties. 1. Introduction In [6, 8] we constructed an initial seed Σn for a complete generalized cluster D structure GCn in the ring of regular functions on the Drinfeld double D(GLn) and proved that this structure is compatible with the standard Poisson–Lie structure on D(GLn). In [9, Section 4] we constructed a different seed Σ¯ n for a regular D D generalized cluster structure GCn on D(GLn). In this note we prove that GCn D shares all the properties of GCn : it is complete and compatible with the standard Poisson–Lie structure on D(GLn). Moreover, we prove that the seeds Σ¯ 4(X, Y ) and T T Σ4(Y ,X ) are not mutationally equivalent. In this way we provide an explicit example of two different regular complete generalized cluster structures on the same variety with the same compatible Poisson structure and the same collection of frozen D variables.
    [Show full text]
  • Conversion of Sparse Matrix to Band Matrix Using an Fpga For
    CONVERSION OF SPARSE MATRIX TO BAND MATRIX USING AN FPGA FOR HIGH-PERFORMANCE COMPUTING by Anjani Chaudhary, M.S. A thesis submitted to the Graduate Council of Texas State University in partial fulfillment of the requirements for the degree of Master of Science with a Major in Engineering December 2020 Committee Members: Semih Aslan, Chair Shuying Sun William A Stapleton COPYRIGHT by Anjani Chaudhary 2020 FAIR USE AND AUTHOR’S PERMISSION STATEMENT Fair Use This work is protected by the Copyright Laws of the United States (Public Law 94-553, section 107). Consistent with fair use as defined in the Copyright Laws, brief quotations from this material are allowed with proper acknowledgement. Use of this material for financial gain without the author’s express written permission is not allowed. Duplication Permission As the copyright holder of this work, I, Anjani Chaudhary, authorize duplication of this work, in whole or in part, for educational or scholarly purposes only. ACKNOWLEDGEMENTS Throughout my research and report writing process, I am grateful to receive support and suggestions from the following people. I would like to thank my supervisor and chair, Dr. Semih Aslan, Associate Professor, Ingram School of Engineering, for his time, support, encouragement, and patience, without which I would not have made it. My committee members Dr. Bill Stapleton, Associate Professor, Ingram School of Engineering, and Dr. Shuying Sun, Associate Professor, Department of Mathematics, for their essential guidance throughout the research and my graduate advisor, Dr. Vishu Viswanathan, for providing the opportunity and valuable suggestions which helped me to come one more step closer to my goal.
    [Show full text]
  • Copyrighted Material
    JWST600-IND JWST600-Penney September 28, 2015 7:40 Printer Name: Trim: 6.125in × 9.25in INDEX Additive property of determinants, 244 Cofactor expansion, 240 Argument of a complex number, 297 Column space, 76 Column vector, 2 Band matrix, 407 Complementary vector, 319 Band width, 407 Complex eigenvalue, 302 Basis Complex eigenvector, 302 chain, 438 Complex linear transformation, 304 coordinate matrix for a basis, 217 Complex matrices, 301 coordinate transformation, 223 Complex number definition, 104 argument, 297 normalization, 315 conjugate, 302 ordered, 216 Complex vector space, 303 orthonormal, 315 Conjugate of a complex number, 302 point transformation, 223 Consumption matrix, 198 standard Coordinate matrix, 217 M(m,n), 119 Coordinates n, 119 coordinate vector, 216 Rn, 118 coordinate matrix for a basis, 217 COPYRIGHTEDcoordinate MATERIAL vector, 216 Cn, 302 point matrix, 217 Chain basis, 438 point transformation, 223 Characteristic polynomial, 275 Cramer’s rule, 265 Coefficient matrix, 75 Current, 41 Linear Algebra: Ideas and Applications, Fourth Edition. Richard C. Penney. © 2016 John Wiley & Sons, Inc. Published 2016 by John Wiley & Sons, Inc. Companion website: www.wiley.com/go/penney/linearalgebra 487 JWST600-IND JWST600-Penney September 28, 2015 7:40 Printer Name: Trim: 6.125in × 9.25in 488 INDEX Data compression, 349 Haar function, 346 Determinant Hermitian additive property, 244 adjoint, 412 cofactor expansion, 240 symmetric, 414 Cramer’s rule, 265 Hermitian, orthogonal, 413 inverse matrix, 267 Homogeneous system, 80 Laplace
    [Show full text]
  • NAG Library Chapter Contents F16 – NAG Interface to BLAS F16 Chapter Introduction
    F16 – NAG Interface to BLAS Contents – F16 NAG Library Chapter Contents f16 – NAG Interface to BLAS f16 Chapter Introduction Function Mark of Name Introduction Purpose f16dbc 7 nag_iload Broadcast scalar into integer vector f16dlc 9 nag_isum Sum elements of integer vector f16dnc 9 nag_imax_val Maximum value and location, integer vector f16dpc 9 nag_imin_val Minimum value and location, integer vector f16dqc 9 nag_iamax_val Maximum absolute value and location, integer vector f16drc 9 nag_iamin_val Minimum absolute value and location, integer vector f16eac 24 nag_ddot Dot product of two vectors, allows scaling and accumulation. f16ecc 7 nag_daxpby Real weighted vector addition f16ehc 9 nag_dwaxpby Real weighted vector addition preserving input f16elc 9 nag_dsum Sum elements of real vector f16fbc 7 nag_dload Broadcast scalar into real vector f16gcc 24 nag_zaxpby Complex weighted vector addition f16ghc 9 nag_zwaxpby Complex weighted vector addition preserving input f16glc 9 nag_zsum Sum elements of complex vector f16hbc 7 nag_zload Broadcast scalar into complex vector f16jnc 9 nag_dmax_val Maximum value and location, real vector f16jpc 9 nag_dmin_val Minimum value and location, real vector f16jqc 9 nag_damax_val Maximum absolute value and location, real vector f16jrc 9 nag_damin_val Minimum absolute value and location, real vector f16jsc 9 nag_zamax_val Maximum absolute value and location, complex vector f16jtc 9 nag_zamin_val Minimum absolute value and location, complex vector f16pac 8 nag_dgemv Matrix-vector product, real rectangular matrix
    [Show full text]
  • THE EFFECTIVE POTENTIAL of an M-MATRIX Marcel Filoche, Svitlana Mayboroda, Terence Tao
    THE EFFECTIVE POTENTIAL OF AN M-MATRIX Marcel Filoche, Svitlana Mayboroda, Terence Tao To cite this version: Marcel Filoche, Svitlana Mayboroda, Terence Tao. THE EFFECTIVE POTENTIAL OF AN M- MATRIX. 2021. hal-03189307 HAL Id: hal-03189307 https://hal.archives-ouvertes.fr/hal-03189307 Preprint submitted on 3 Apr 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THE EFFECTIVE POTENTIAL OF AN M-MATRIX MARCEL FILOCHE, SVITLANA MAYBORODA, AND TERENCE TAO Abstract. In the presence of a confining potential V, the eigenfunctions of a con- tinuous Schrodinger¨ operator −∆ + V decay exponentially with the rate governed by the part of V which is above the corresponding eigenvalue; this can be quan- tified by a method of Agmon. Analogous localization properties can also be es- tablished for the eigenvectors of a discrete Schrodinger¨ matrix. This note shows, perhaps surprisingly, that one can replace a discrete Schrodinger¨ matrix by any real symmetric Z-matrix and still obtain eigenvector localization estimates. In the case of a real symmetric non-singular M-matrix A (which is a situation that arises in several contexts, including random matrix theory and statistical physics), the landscape function u = A−11 plays the role of an effective potential of localiza- tion.
    [Show full text]
  • Matrix Theory
    Matrix Theory Xingzhi Zhan +VEHYEXI7XYHMIW MR1EXLIQEXMGW :SPYQI %QIVMGER1EXLIQEXMGEP7SGMIX] Matrix Theory https://doi.org/10.1090//gsm/147 Matrix Theory Xingzhi Zhan Graduate Studies in Mathematics Volume 147 American Mathematical Society Providence, Rhode Island EDITORIAL COMMITTEE David Cox (Chair) Daniel S. Freed Rafe Mazzeo Gigliola Staffilani 2010 Mathematics Subject Classification. Primary 15-01, 15A18, 15A21, 15A60, 15A83, 15A99, 15B35, 05B20, 47A63. For additional information and updates on this book, visit www.ams.org/bookpages/gsm-147 Library of Congress Cataloging-in-Publication Data Zhan, Xingzhi, 1965– Matrix theory / Xingzhi Zhan. pages cm — (Graduate studies in mathematics ; volume 147) Includes bibliographical references and index. ISBN 978-0-8218-9491-0 (alk. paper) 1. Matrices. 2. Algebras, Linear. I. Title. QA188.Z43 2013 512.9434—dc23 2013001353 Copying and reprinting. Individual readers of this publication, and nonprofit libraries acting for them, are permitted to make fair use of the material, such as to copy a chapter for use in teaching or research. Permission is granted to quote brief passages from this publication in reviews, provided the customary acknowledgment of the source is given. Republication, systematic copying, or multiple reproduction of any material in this publication is permitted only under license from the American Mathematical Society. Requests for such permission should be addressed to the Acquisitions Department, American Mathematical Society, 201 Charles Street, Providence, Rhode Island 02904-2294 USA. Requests can also be made by e-mail to [email protected]. c 2013 by the American Mathematical Society. All rights reserved. The American Mathematical Society retains all rights except those granted to the United States Government.
    [Show full text]
  • Localization in Matrix Computations: Theory and Applications
    Localization in Matrix Computations: Theory and Applications Michele Benzi Department of Mathematics and Computer Science, Emory University, Atlanta, GA 30322, USA. Email: [email protected] Summary. Many important problems in mathematics and physics lead to (non- sparse) functions, vectors, or matrices in which the fraction of nonnegligible entries is vanishingly small compared the total number of entries as the size of the system tends to infinity. In other words, the nonnegligible entries tend to be localized, or concentrated, around a small region within the computational domain, with rapid decay away from this region (uniformly as the system size grows). When present, localization opens up the possibility of developing fast approximation algorithms, the complexity of which scales linearly in the size of the problem. While localization already plays an important role in various areas of quantum physics and chemistry, it has received until recently relatively little attention by researchers in numerical linear algebra. In this chapter we survey localization phenomena arising in various fields, and we provide unified theoretical explanations for such phenomena using general results on the decay behavior of matrix functions. We also discuss compu- tational implications for a range of applications. 1 Introduction In numerical linear algebra, it is common to distinguish between sparse and dense matrix computations. An n ˆ n sparse matrix A is one in which the number of nonzero entries is much smaller than n2 for n large. It is generally understood that a matrix is dense if it is not sparse.1 These are not, of course, formal definitions. A more precise definition of a sparse n ˆ n matrix, used by some authors, requires that the number of nonzeros in A is Opnq as n Ñ 8.
    [Show full text]
  • An Optimal Block Iterative Method and Preconditioner for Banded Matrices with Applications to Pdes on Irregular Domains∗
    SIAM J. MATRIX ANAL. APPL. c 2012 Society for Industrial and Applied Mathematics Vol. 33, No. 2, pp. 653–680 AN OPTIMAL BLOCK ITERATIVE METHOD AND PRECONDITIONER FOR BANDED MATRICES WITH APPLICATIONS TO PDES ON IRREGULAR DOMAINS∗ MARTIN J. GANDER†,SEBASTIEN´ LOISEL‡ , AND DANIEL B. SZYLD§ Abstract. Classical Schwarz methods and preconditioners subdivide the domain of a PDE into subdomains and use Dirichlet transmission conditions at the artificial interfaces. Optimized Schwarz methods use Robin (or higher order) transmission conditions instead, and the Robin parameter can be optimized so that the resulting iterative method has an optimized convergence factor. The usual technique used to find the optimal parameter is Fourier analysis; but this is applicable only to certain regular domains, for example, a rectangle, and with constant coefficients. In this paper, we present a completely algebraic version of the optimized Schwarz method, including an algebraic approach to finding the optimal operator or a sparse approximation thereof. This approach allows us to apply this method to any banded or block banded linear system of equations, and in particular to discretizations of PDEs in two and three dimensions on irregular domains. With the computable optimal operator, we prove that the optimized Schwarz method converges in no more than two iterations, even for the case of many subdomains (which means that this optimal operator communicates globally). Similarly, we prove that when we use an optimized Schwarz preconditioner with this optimal operator, the underlying minimal residual Krylov subspace method (e.g., GMRES) converges in no more than two iterations. Very fast convergence is attained even when the optimal transmission operator is approximated by a sparse matrix.
    [Show full text]
  • Toeplitz Matrices Are Unitarily Similar to Symmetric Matrices by Jianzhen
    Toeplitz Matrices are Unitarily Similar to Symmetric Matrices by Jianzhen Liu A dissertation submitted to the Graduate Faculty of Auburn University in partial fulfillment of the requirements for the Degree of Doctor of Philosophy Auburn, Alabama August 5, 2017 Keywords: Symmetric matrix, Toeplitz matrix, Numerical range Copyright 2017 by Jianzhen Liu Approved by Tin-Yau Tam, Chair, Professor of Mathematics Ziqin Feng, Assistant Professor of Mathematics Randall R. Holmes, Professor of Mathematics Ming Liao, Professor of Mathematics Abstract We prove that Toeplitz matrices are unitarily similar to complex symmetric matrices. Moreover, two n × n unitary matrices that uniformly turn all n × n Toeplitz matrices via similarity to complex symmetric matrices are explicitly given, respectively. When n ≤ 3, we prove that each complex symmetric matrix is unitarily similar to some Toeplitz matrix, but the statement is false when n > 3. ii Acknowledgments I would first like to acknowledge my advisor Dr. Tin-Yau Tam. He is more than an academic advisor. Indeed he is a mentor of my life. With his endless patience, he has been helping me to adjust to life in a new environment. He encourages all his students to be proactive to attend conferences and give talks and is really helpful to us. Dr. Tam and his wife, Kitty, always provide us a home-like environment. I also want to thank my family. My wife, Xiang Li, has done her very best to take care of me and our son Aiden. Without her strong support, it would not be possible for me to arrive at this stage. At the beginning of our marriage, we talked about bringing our kid(s) to the commencement and sharing every special moment.
    [Show full text]