DOCSLIB.ORG

Numerical Methods for Toeplitz Matrices

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Numerical Methods for Toeplitz Matrices z b r¡'e')- NUMERICAL METHODS FOR TOEPLITZ MATRTCES by Douglas Robin Sweet, B. Sc. (Hons) , Dip. Cornp. Sc. \ A thesis subniitt.ed for the clegree of Doctor of Philosopþ in the DeparEnent of Colrrputing Scienc.e, Universj-ty of Adelaide Mav 1982 I TABLE OF CONTENTS VOLIIME I Page TABLE OF CONTENTS i SIJMMARY v SIGNED STATEMEM vii AC KNOI,I¡LE D G ET,f ENTS viii NOTATION ix GLOSSARY OF ALGORITHMS xvii I INTRODUCTION 1. Toeplitz natrices I 2. Applications of Toeplitz and related natrices 2 3. Airns of 'the thesis 5 4^ Previous work on Toeplitz matrices 7 5. Main results 11 6. Organization of the thesis 13 2 FAST TOEPI,ITZ FACTORIZATION ALGORITHMS - ALTERNATIVE DERIVATIONS 1. Introduction 15 2. The Bareiss algorithm L7 3. Computing the factors of ? using the Bareiss algorithrn (BNA) 23 4. Derivation of FTF algorithms using rank-1 updates 28 5. Conclusion 37 3 THE RELATION BETWEEN TOEPLITZ ELIMINATION AND INVERSION ALGORTTI+IS 1. Introduction 38 2. The Trench-Zohar algorithn 39 3. The extended Bareiss syrûnetric algorithm 42 4. The al.ternative Bareiss symmetric algorithnr (ABSA) - Toeplitz inversiorr 47 5. Conclusion 52 11 Page 4 ERROR ANALYSIS OF BAREISSIS ALGQRITIßI 1. IntroductÌon 53 2, Bareiss aLgorithm ' niscellaneous resuLts 54 3. Bareiss algorithrn - increase in error bound 66 4. Bareiss al-gorithm - backward error analysis 7T 5. Conclusion 79 5 THE PIVOTED BAREISS ALGORTTHM 1. Introduction 80 2. Pivoting procedirres for the Bareiss algorithm 81 3. Pivoting strategies 114 4. fncrease in error bound - simple pivoting strategy 134 5. Introduction of Pivoting into the Bareiss algorithm (BSA) 158 6. Conclusion 159 6 NUT{ERICAL ASPECTS OF TOEPLITZ FACTOF{IZATION AND INVERSION 1. Introduction r40 2. Toeplitz factotization - increase in error bound r4l 3. Toeplitz factotization - backwa::cl error analysis r42 4. Relation bettveen the pivoted Bareiss algorithm and Toeplitz factorization 155 5. Pivoted Toeplitz factottzation - ayoidance of increase in error bound 159 6. Toeplitz inversion - increase in error bound 160 7. Pivoted extended Bareiss symmetric algorithnt 161 B. The pivoted alternative Bareiss synrnetric algorithm and pivoted Trench-Zohar algorithnt 162 9. Avoidance of error groL{th in PABSA or PTZA 169 10. Pivot selectj.on strategY t73 11. Conclusion 174 111 Page 7 FAST TOEPLITZ ORTHOGONLIZATION l. Introduction r75 2, The Gill.Go1ub'Murray-Saunder algorithn (GGMS) 178 3, Fast Toeplitz orthogonalization, version 1 (FTOI) 184 4. CaleuLation of Q and.R explicitly (FT02) 198 5. Conclusion 206 8 FAST 1'OEPLTTZ ORTHOGONALIZATION II 1. Introduction 207 2. Fast Toeplitz orthogonalization, version 3 (FT03) 208 3. Calculation of both 4 and .R explicitly : FT04 219 4. The use of fast Givens transforms in Toeplitz orthogonalization 225 5. Toeplitz orthogonalization - somê extensions 240 6. Conclusion 247 9 THE SINGULAR VALUE DECOMPOSITION OF TOEPLITZ IVIATRICES 1. Introduction ?.48 2. The Golub-Reinsch algorithm 249 3. Teoplitz SVD by Fast Toeptritz orthogonalization 253 4. Toeptitz SVD by Gram-Schmidt bidiagonalization 257 5. Conclusion 265 10. CONCLUSION 266 REFERENCES 268 1V .1 Ì l'¡ VOLUME II Èìt APPENDIX ^ PROGRAIqS A.ND RESULTS Page No. I t t str4tegy I A.1 PBAI - Pivoted Bareiss a]-gorithn, r 't PBA2 - Plvoted Bareiss algorithn, stTategy 2 A.B '' algorithn, strategy 3 A.2I ù PBAS - Pivoted Bareiss 1 t PBAFAC - Pivoted Toeplitz factorization A.31 I '¡I PTZA1 - Pivoted Trench-Zohar algorithm, strategy L A. 41 FT01 - Fast Toeplitz orthogonalization, version 1 4.48 FT02 - Fast Toeplitz orthogonalization, version 2 A.54 FT02S - Fast Toeplitz orthogonaLization, version 25 A.61 FT03 - Fast Toeplitz orthogonalization, version 5 A.72 FT04 - Fast Toeplitz orthogonalization, version 4 4.78 FT05 - Fast Toeplitz orthogonalization, version 5 A. 85 Miscellaneous lr'fatrix Routines ^.92 ,i I I v I Li¡ t- stIvu"lARY This thesis is rnainly concerned with net.hods for solving ToepLitz l"inear algebra problerns ¡n 0fuZ ) rnultiplications/divisions. There are three main airns (i) to find new connexions between known aLgorithns, and re-derive sone of these using clifferent approaches (ii) to derive new results concerning the numerical stability of sone algorithns, and to nodify these algorithns to inprove their numerical performance (iii) to derive fast Toeplitz algoritfuns for new applica- tions, such as the orthogonal deconposition and singular value decompo- siti on. In Chapter 2, fast Toeplitz faetorization algorithrns (FTFts) are :re-derived frorn the Bareiss algorithm for solving Toeplitz systenìs and also fron algr:rithms for performi-ng rank-1 updates of factors. In Chapter 3, the Bareiss algorithm is related to the Trench Algorithrn for Toeplitz invelsion. Several new results regarding the propagation of rounding errors in the Bareiss algorithn are derived in Chapter 4. A pivoting scheme is proposed in Chapter 5 to improve the numerical performance of the Bareiss algorithm. In Chapter 6, erïor analyses are performed on FTFrs and some pivoting is incorporated to improve their nunerical perfornance. The results of Chapter 3 are used to adapt the Bareis-s pivoting procedure to the Trench algorithm. v1 Methsds are proposed in Chapter 7 to conpute the QR factoriza- tion of a Toepritz natrix in 0fu2) oPerations' Thi5 ¿lgerithn uses the shift-invariance property of the Toeplitz natrix and a known procedure for updating the QR factors of a general natrix.. In Chapter B, methods are described for speeding up the aLgorithns of the previous chapter, and several extensions are proposed, . In Chapter 9, two algorithns are proposed to conpute the singular-va1ue decomposition (SVD) of a ToepLitz natrix in fewer operations than for a general matrix. The first algorithm ¡s O(ns ) but depending on the dimension of the problem requir:es up to 80% fewer operations than for general SVD algorithns. The second possibly unstable nethod has complexity .) 0(n' Log d. A modification of this method is proposed which nay enable the singular values to be calculated stably. I l va]- DECLARATION This thesis contains no rnaterial which has been accepted for the award of any other degree or diplona in any university and, to the best of my knowledge and belief, contains no naterial previously published or written by another person, except where due reference is nade in the text of the thesis. D.R. SWEET viii ACKNOI{LEDGEMENTS I wish to express ny sincere gratitude to Dr. Sylvan Elhay, for his encouraging support, his help in planning the thesis, and the rnany hours he has spent in paÌnstakingl-y checking the rigour of the nathenratics, and the many suggestions he has nade to improve the presenta- tion. To Dr. Jaroslav l(autsky, I give thanks for several stimulating discussions and also for his assj.stance while my supervisor was on study leave. Thanks, are due to nt¡' enployer, the Department of Defence, for giving me leave to pursue my studíes, To my colieagues at the Defence Research Centre, Salisbury, and especially to Graham Mountford, I am obliged for their encouragernent. The financial support provicled by the Australian Government under the Commonwealth Postgraduate Awards Schene is gratefully acknowiedged. To Tracey Young, special thanks are due for her patience and skili over the last ferv lnonths in typing the manuscript. I also recognize the assistance of Fiona Adlington in dr:awing the diagrans, and of Eljzabeth Hender:son and Dawn Danvent for their help in the typing. For her patience, encouragement and urging over the past fevr years I pay tribute to my wife Vanessa. 1X NOTATION General. Matrix and Vector Notation FY ¡or Exp lanation a, A vector with elements Qy oZ, . r. a^, whete m is the order of a A The natrix with elements a¿¡t 'ç-Lf ,. .,m;i=Lrn, where m and n are the lrunber of rows and colunlns respectively in ,4 Row i and column i of A Elements i to k of gi, i elenents h to i of ?.j A. Rows i to i of columns k to L of A 1,: J , K: L j columns to L of A Ai,i ';t 'u'' Rows i to of A; k A" The kth leading submatrix of ,4 (unless otherwise K indicated oT rAT The transpose of a, A A--1 The inverse of .4 R g The reverse of a., i.e if a: (arr...ro^)T, P-\T then a":(dmr.. roL) RT a, The reverse-transPose of ø tl1 9 A-' The -secondary transpose of ,4 (transpose about the secondary diagonal) .AT2=EATE (see below for E) -m dLq,gla,ij A diagonal matrix with diagonal eLements a?aZ'...am 1 det A The detenninant of ¡1 ll/ll; llall A natrix-norm of ¡l; a corresponding subordinate vector-ncrm of ø (if aPPl icable) ll¿ll t llall The p-norn of .4 and g P p x 9)'EÞo¡ Expl.anation A k;i The displaced leading subrnatrix of Á with order k and displacenent 7'; fot i>0, Ak,j=OO;krt+¡:k+j; j<o' f'ot Ak;¡=At+li l:k+l¡l,t:t< rrEastr?; rrSoutht') oTr, otu Sane as Ak;l ; Ak;-l, (E: ^9: ,5 4,¡tok;ì (At,k,1;k^i-' gl,k,i) ; Ast;ì.:l'",,:,t:'r) ?e llg¿.l lla..ll oö' oi , 1 A* The Toeplitz part of A dma,* Tfflrn-t url a. j ,- O : the ¿th diagonal above the nain diagonal J of the Toeplitz paït of A; i < 0 ¿ the liltn diagonal below the main diagonal of the Toeplitz part of .4. a@b The cyclic convolution of a and b m A A^ A^-1 . ,. A', where {AU} are square natrices of JT 1, æJ the same order (not leading submatrices of A) Ã,4 The computed value of A,a -A-A, 6Á, ôa The errors in .ãrã ; a-ã respectively aa/ a reL'A, reL â, I o" | | | ; I I ii o ¡ 4i " ¿¡ eond A The conclition nunber of .4, defined as ll¿ll lln-lll T A Toeplitz natrix { A block-vector with blockt O(i) blockt A A A block-rnatrix with (¿j ) Block-row í and bLock-col.unn of A 4(¿.
Load more

Recommended publications
  • Graph Equivalence Classes for Spectral Projector-Based Graph Fourier Transforms Joya A
    1 Graph Equivalence Classes for Spectral Projector-Based Graph Fourier Transforms Joya A. Deri, Member, IEEE, and José M. F. Moura, Fellow, IEEE Abstract—We define and discuss the utility of two equiv- Consider a graph G = G(A) with adjacency matrix alence graph classes over which a spectral projector-based A 2 CN×N with k ≤ N distinct eigenvalues and Jordan graph Fourier transform is equivalent: isomorphic equiv- decomposition A = VJV −1. The associated Jordan alence classes and Jordan equivalence classes. Isomorphic equivalence classes show that the transform is equivalent subspaces of A are Jij, i = 1; : : : k, j = 1; : : : ; gi, up to a permutation on the node labels. Jordan equivalence where gi is the geometric multiplicity of eigenvalue 휆i, classes permit identical transforms over graphs of noniden- or the dimension of the kernel of A − 휆iI. The signal tical topologies and allow a basis-invariant characterization space S can be uniquely decomposed by the Jordan of total variation orderings of the spectral components. subspaces (see [13], [14] and Section II). For a graph Methods to exploit these classes to reduce computation time of the transform as well as limitations are discussed. signal s 2 S, the graph Fourier transform (GFT) of [12] is defined as Index Terms—Jordan decomposition, generalized k gi eigenspaces, directed graphs, graph equivalence classes, M M graph isomorphism, signal processing on graphs, networks F : S! Jij i=1 j=1 s ! (s ;:::; s ;:::; s ;:::; s ) ; (1) b11 b1g1 bk1 bkgk I. INTRODUCTION where sij is the (oblique) projection of s onto the Jordan subspace Jij parallel to SnJij.
    [Show full text]
  • A Weakly Stable Algorithm for General Toeplitz Systems
    A Weakly Stable Algorithm for General Toeplitz Systems∗ Adam W. Bojanczyk Richard P. Brent School of Electrical Engineering Computer Sciences Laboratory Cornell University Australian National University Ithaca, NY 14853-5401 Canberra, ACT 0200 Frank R. de Hoog Division of Mathematics and Statistics CSIRO, GPO Box 1965 Canberra, ACT 2601 Report TR-CS-93-15 6 August 1993 (revised 24 June 1994) Abstract We show that a fast algorithm for the QR factorization of a Toeplitz or Hankel matrix A is weakly stable in the sense that RT R is close to AT A. Thus, when the algorithm is used to solve the semi-normal equations RT Rx = AT b, we obtain a weakly stable method for the solution of a nonsingular Toeplitz or Hankel linear system Ax = b. The algorithm also applies to the solution of the full-rank Toeplitz or Hankel least squares problem min kAx − bk2. 1991 Mathematics Subject Classification. Primary 65F25; Secondary 47B35, 65F05, 65F30, 65Y05, 65Y10 Key words and phrases. Cholesky factorization, error analysis, Hankel matrix, least squares, normal equations, orthogonal factorization, QR factorization, semi-normal equa- tions, stability, Toeplitz matrix, weak stability. 1 Introduction arXiv:1005.0503v1 [math.NA] 4 May 2010 Toeplitz linear systems arise in many applications, and there are many algorithms which solve nonsingular n × n Toeplitz systems Ax = b in O(n2) arithmetic operations [2, 13, 44, 45, 49, 54, 55, 65, 67, 77, 78, 80, 81, 85, 86]. Some algorithms are restricted to symmetric systems (A = AT ) and others apply to general Toeplitz systems. Because of their recursive nature, most O(n2) algorithms assume that all leading principal submatrices of A are nonsingular, and break down if this is not the case.
    [Show full text]
  • Polynomial Sequences Generated by Linear Recurrences
    Innocent Ndikubwayo Polynomial Sequences Generated by Linear Recurrences: Location and Reality of Zeros Polynomial Sequences Generated by Linear Recurrences: Location and Reality of Zeros Linear Recurrences: Location by Sequences Generated Polynomial Innocent Ndikubwayo ISBN 978-91-7911-462-6 Department of Mathematics Doctoral Thesis in Mathematics at Stockholm University, Sweden 2021 Polynomial Sequences Generated by Linear Recurrences: Location and Reality of Zeros Innocent Ndikubwayo Academic dissertation for the Degree of Doctor of Philosophy in Mathematics at Stockholm University to be publicly defended on Friday 14 May 2021 at 15.00 in sal 14 (Gradängsalen), hus 5, Kräftriket, Roslagsvägen 101 and online via Zoom, public link is available at the department website. Abstract In this thesis, we study the problem of location of the zeros of individual polynomials in sequences of polynomials generated by linear recurrence relations. In paper I, we establish the necessary and sufficient conditions that guarantee hyperbolicity of all the polynomials generated by a three-term recurrence of length 2, whose coefficients are arbitrary real polynomials. These zeros are dense on the real intervals of an explicitly defined real semialgebraic curve. Paper II extends Paper I to three-term recurrences of length greater than 2. We prove that there always exist non- hyperbolic polynomial(s) in the generated sequence. We further show that with at most finitely many known exceptions, all the zeros of all the polynomials generated by the recurrence lie and are dense on an explicitly defined real semialgebraic curve which consists of real intervals and non-real segments. The boundary points of this curve form a subset of zero locus of the discriminant of the characteristic polynomial of the recurrence.
    [Show full text]
  • Explicit Inverse of a Tridiagonal (P, R)–Toeplitz Matrix
    Explicit inverse of a tridiagonal (p; r){Toeplitz matrix A.M. Encinas, M.J. Jim´enez Departament de Matemtiques Universitat Politcnica de Catalunya Abstract Tridiagonal matrices appears in many contexts in pure and applied mathematics, so the study of the inverse of these matrices becomes of specific interest. In recent years the invertibility of nonsingular tridiagonal matrices has been quite investigated in different fields, not only from the theoretical point of view (either in the framework of linear algebra or in the ambit of numerical analysis), but also due to applications, for instance in the study of sound propagation problems or certain quantum oscillators. However, explicit inverses are known only in a few cases, in particular when the tridiagonal matrix has constant diagonals or the coefficients of these diagonals are subjected to some restrictions like the tridiagonal p{Toeplitz matrices [7], such that their three diagonals are formed by p{periodic sequences. The recent formulae for the inversion of tridiagonal p{Toeplitz matrices are based, more o less directly, on the solution of second order linear difference equations, although most of them use a cumbersome formulation, that in fact don not take into account the periodicity of the coefficients. This contribution presents the explicit inverse of a tridiagonal matrix (p; r){Toeplitz, which diagonal coefficients are in a more general class of sequences than periodic ones, that we have called quasi{periodic sequences. A tridiagonal matrix A = (aij) of order n + 2 is called (p; r){Toeplitz if there exists m 2 N0 such that n + 2 = mp and ai+p;j+p = raij; i; j = 0;:::; (m − 1)p: Equivalently, A is a (p; r){Toeplitz matrix iff k ai+kp;j+kp = r aij; i; j = 0; : : : ; p; k = 0; : : : ; m − 1: We have developed a technique that reduces any linear second order difference equation with periodic or quasi-periodic coefficients to a difference equation of the same kind but with constant coefficients [3].
    [Show full text]
  • Linear Algebra: Beware!
    LINEAR ALGEBRA: BEWARE! MATH 196, SECTION 57 (VIPUL NAIK) You might be expecting linear algebra to be a lot like your calculus classes at the University. This is probably true in terms of the course structure and format. But it’s not true at the level of subject matter. Some important differences are below. • Superficially, linear algebra is a lot easier, since it relies mostly on arithmetic rather than algebra. The computational procedures involve the systematic and correct application of processes for adding, subtracting, multiplying, and dividing numbers. But the key word here is superficially. • Even for the apparently straightforward computational exercises, it turns out that people are able to do them a lot better if they understand what’s going on. In fact, in past test questions, people have often made fewer errors when doing the problem using full-scale algebraic symbol manipulation rather than the synthetic arithmetic method. • One important difference between linear algebra and calculus is that with calculus, it’s relatively easy to understand ideas partially. One can obtain much of the basic intuition of calculus by un- derstanding graphs of functions. In fact, limit, continuity, differentaaition, and integration all have basic descriptions in terms of the graph. Note: these aren’t fully rigorous, which is why you had to take a year’s worth of calculus class to cement your understanding of the ideas. But it’s a start. With linear algebra, there is no single compelling visual tool that connects all the ideas, and conscious effort is needed even for a partial understanding. • While linear algebra lacks any single compelling visual tool, it requires either considerable visuo- spatial skill or considerable abstract symbolic and verbal skill (or a suitable linear combination thereof).
    [Show full text]
  • Toeplitz and Toeplitz-Block-Toeplitz Matrices and Their Correlation with Syzygies of Polynomials
    TOEPLITZ AND TOEPLITZ-BLOCK-TOEPLITZ MATRICES AND THEIR CORRELATION WITH SYZYGIES OF POLYNOMIALS HOUSSAM KHALIL∗, BERNARD MOURRAIN† , AND MICHELLE SCHATZMAN‡ Abstract. In this paper, we re-investigate the resolution of Toeplitz systems T u = g, from a new point of view, by correlating the solution of such problems with syzygies of polynomials or moving lines. We show an explicit connection between the generators of a Toeplitz matrix and the generators of the corresponding module of syzygies. We show that this module is generated by two elements of degree n and the solution of T u = g can be reinterpreted as the remainder of an explicit vector depending on g, by these two generators. This approach extends naturally to multivariate problems and we describe for Toeplitz-block-Toeplitz matrices, the structure of the corresponding generators. Key words. Toeplitz matrix, rational interpolation, syzygie 1. Introduction. Structured matrices appear in various domains, such as scientific computing, signal processing, . They usually express, in a linearize way, a problem which depends on less pa- rameters than the number of entries of the corresponding matrix. An important area of research is devoted to the development of methods for the treatment of such matrices, which depend on the actual parameters involved in these matrices. Among well-known structured matrices, Toeplitz and Hankel structures have been intensively studied [5, 6]. Nearly optimal algorithms are known for the multiplication or the resolution of linear systems, for such structure. Namely, if A is a Toeplitz matrix of size n, multiplying it by a vector or solving a linear system with A requires O˜(n) arithmetic operations (where O˜(n) = O(n logc(n)) for some c > 0) [2, 12].
    [Show full text]
  • A Note on Multilevel Toeplitz Matrices
    Spec. Matrices 2019; 7:114–126 Research Article Open Access Lei Cao and Selcuk Koyuncu* A note on multilevel Toeplitz matrices https://doi.org/110.1515/spma-2019-0011 Received August 7, 2019; accepted September 12, 2019 Abstract: Chien, Liu, Nakazato and Tam proved that all n × n classical Toeplitz matrices (one-level Toeplitz matrices) are unitarily similar to complex symmetric matrices via two types of unitary matrices and the type of the unitary matrices only depends on the parity of n. In this paper we extend their result to multilevel Toeplitz matrices that any multilevel Toeplitz matrix is unitarily similar to a complex symmetric matrix. We provide a method to construct the unitary matrices that uniformly turn any multilevel Toeplitz matrix to a complex symmetric matrix by taking tensor products of these two types of unitary matrices for one-level Toeplitz matrices according to the parity of each level of the multilevel Toeplitz matrices. In addition, we introduce a class of complex symmetric matrices that are unitarily similar to some p-level Toeplitz matrices. Keywords: Multilevel Toeplitz matrix; Unitary similarity; Complex symmetric matrices 1 Introduction Although every complex square matrix is similar to a complex symmetric matrix (see Theorem 4.4.24, [5]), it is known that not every n × n matrix is unitarily similar to a complex symmetric matrix when n ≥ 3 (See [4]). Some characterizations of matrices unitarily equivalent to a complex symmetric matrix (UECSM) were given by [1] and [3]. Very recently, a constructive proof that every Toeplitz matrix is unitarily similar to a complex symmetric matrix was given in [2] in which the unitary matrices turning all n × n Toeplitz matrices to complex symmetric matrices was given explicitly.
    [Show full text]
  • Totally Positive Toeplitz Matrices and Quantum Cohomology of Partial Flag Varieties
    JOURNAL OF THE AMERICAN MATHEMATICAL SOCIETY Volume 16, Number 2, Pages 363{392 S 0894-0347(02)00412-5 Article electronically published on November 29, 2002 TOTALLY POSITIVE TOEPLITZ MATRICES AND QUANTUM COHOMOLOGY OF PARTIAL FLAG VARIETIES KONSTANZE RIETSCH 1. Introduction A matrix is called totally nonnegative if all of its minors are nonnegative. Totally nonnegative infinite Toeplitz matrices were studied first in the 1950's. They are characterized in the following theorem conjectured by Schoenberg and proved by Edrei. Theorem 1.1 ([10]). The Toeplitz matrix ∞×1 1 a1 1 0 1 a2 a1 1 B . .. C B . a2 a1 . C B C A = B .. .. .. C B ad . C B C B .. .. C Bad+1 . a1 1 C B C B . C B . .. .. a a .. C B 2 1 C B . C B .. .. .. .. ..C B C is totally nonnegative@ precisely if its generating function is of theA form, 2 (1 + βit) 1+a1t + a2t + =exp(tα) ; ··· (1 γit) i Y2N − where α R 0 and β1 β2 0,γ1 γ2 0 with βi + γi < . 2 ≥ ≥ ≥···≥ ≥ ≥···≥ 1 This beautiful result has been reproved many times; see [32]P for anP overview. It may be thought of as giving a parameterization of the totally nonnegative Toeplitz matrices by ~ N N ~ (α;(βi)i; (~γi)i) R 0 R 0 R 0 i(βi +~γi) < ; f 2 ≥ × ≥ × ≥ j 1g i X2N where β~i = βi βi+1 andγ ~i = γi γi+1. − − Received by the editors December 10, 2001 and, in revised form, September 14, 2002. 2000 Mathematics Subject Classification. Primary 20G20, 15A48, 14N35, 14N15.
    [Show full text]
  • Parallel Systems in Symbolic and Algebraic Computation
    UCAM-CL-TR-537 Technical Report ISSN 1476-2986 Number 537 Computer Laboratory Parallel systems in symbolic and algebraic computation Mantsika Matooane June 2002 15 JJ Thomson Avenue Cambridge CB3 0FD United Kingdom phone +44 1223 763500 http://www.cl.cam.ac.uk/ c 2002 Mantsika Matooane This technical report is based on a dissertation submitted August 2001 by the author for the degree of Doctor of Philosophy to the University of Cambridge, Trinity College. Technical reports published by the University of Cambridge Computer Laboratory are freely available via the Internet: http://www.cl.cam.ac.uk/TechReports/ Series editor: Markus Kuhn ISSN 1476-2986 Abstract This thesis describes techniques that exploit the distributed memory in massively parallel processors to satisfy the peak memory requirements of some very large com- puter algebra problems. Our aim is to achieve balanced memory use, which differen- tiates this work from other parallel systems whose focus is on gaining speedup. It is widely observed that failures in computer algebra systems are mostly due to mem- ory overload: for several problems in computer algebra, some of the best available algorithms suffer from intermediate expression swell where the result is of reason- able size, but the intermediate calculation encounters severe memory limitations. This observation motivates our memory-centric approach to parallelizing computer algebra algorithms. The memory balancing is based on a randomized hashing algorithm for dynamic distribution of data. Dynamic distribution means that the intermediate data is allocated storage space at the time that it is created and therefore the system can avoid overloading some processing elements.
    [Show full text]
  • Arxiv:1810.01634V2 [Cs.SC] 6 Nov 2020 Algebraic Number Fields And
    Algebraic number fields and the LLL algorithm M. J´anos Uray [email protected] ELTE – E¨otv¨os Lor´and University (Budapest) Faculty of Informatics Department of Computer Algebra Abstract In this paper we analyze the computational costs of various operations and algorithms in algebraic number fields using exact arithmetic. Let K be an algebraic number field. In the first half of the paper, we calculate the running time and the size of the output of many operations in K in terms of the size of the input and the parameters of K. We include some earlier results about these, but we go further than them, e.g. we also analyze some R-specific operations in K like less-than comparison. In the second half of the paper, we analyze two algorithms: the Bareiss algorithm, which is an integer-preserving version of the Gaussian elimination, and the LLL algorithm, which is for lattice basis reduction. In both cases, we extend the algorithm from Zn to Kn, and give a polynomial upper bound on the running time when the computations in K are performed exactly (as opposed to floating-point approximations). 1 Introduction Exact computation with algebraic numbers is an important feature that most computer algebra systems provide. They use efficient algorithms for the calculations, arXiv:1810.01634v2 [cs.SC] 6 Nov 2020 described in several papers and books, e.g. in [1, 2, 3]. However, the computational costs of these algorithms are often not obvious to calculate, because the bit complexity depends on how much the representing multi-precision integers grow during the computation.
    [Show full text]
  • A Note on Inversion of Toeplitz Matrices$
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Applied Mathematics Letters 20 (2007) 1189–1193 www.elsevier.com/locate/aml A note on inversion of Toeplitz matrices$ Xiao-Guang Lv, Ting-Zhu Huang∗ School of Applied Mathematics, University of Electronic Science and Technology of China, Chengdu, Sichuan, 610054, PR China Received 18 October 2006; accepted 30 October 2006 Abstract It is shown that the invertibility of a Toeplitz matrix can be determined through the solvability of two standard equations. The inverse matrix can be denoted as a sum of products of circulant matrices and upper triangular Toeplitz matrices. The stability of the inversion formula for a Toeplitz matrix is also considered. c 2007 Elsevier Ltd. All rights reserved. Keywords: Toeplitz matrix; Circulant matrix; Inversion; Algorithm 1. Introduction Let T be an n-by-n Toeplitz matrix: a0 a−1 a−2 ··· a1−n ··· a1 a0 a−1 a2−n ··· T = a2 a1 a0 a3−n , . . .. an−1 an−2 an−3 ··· a0 where a−(n−1),..., an−1 are complex numbers. We use the shorthand n T = (ap−q )p,q=1 for a Toeplitz matrix. The inversion of a Toeplitz matrix is usually not a Toeplitz matrix. A very important step is to answer the question of how to reconstruct the inversion of a Toeplitz matrix by a low number of its columns and the entries of the original Toeplitz matrix. It was first observed by Trench [1] and rediscovered by Gohberg and Semencul [2] that T −1 can be reconstructed from its first and last columns provided that the first component of the first column does not vanish.
    [Show full text]
  • TOEPLITZ MATRIX APPROXIMATION by Suliman Al-Homidan
    TOEPLITZ MATRIX APPROXIMATION by Suliman Al-Homidan Department of Mathematics, King Fahd University of Petroleum and Minerals, Dhahran 31261, PO Box 119, Saudi Arabia 1 1. Matrix nearness problems 2. Hybrid Methods for Finding the Nearest Euclidean Distance Matrix 3. Educational Testing Problem 4. Hybrid Methods for Minimizing Least Distance Functions with Semi-Definite Matrix Constraints 5. The Problem 6. l1Sequential Quadratic Programming Method 2 1 Matrix nearness problems Given a matrix F ∈ IRn×n then consider the problem minimize kF − Dk (kF − Dk ≤ |F |) D Such that D has property P P can be any one or mixture of: * Symmetry * Skew-Symmetry * Poitive semi-definiteness * Orthogonality, Unitary * Normality * Rank-deficiency, Singularity 3 * D in a linesr space * D with some fixed columns, rows, subma- trix * Instability * D with a given λ, repeated λ * D is Euclidean Distance Matrix * D is Toeplitz or Hankel 4 2 Hybrid Methods for Finding the Nearest Euclidean Distance Matrix Definition A matrix D ∈ IRn×n is called a Euclidean dis- tance matrix iff there exist n points x1,..., xn in an affine subspace of dimension IRm (m ≤ n − 1) such that 2 dij = kxi − xjk2 ∀i, j. (1) The Euclidean distance problem can now be stated as follows. Given a matrix F ∈ IRn×n, find the Euclidean distance matrix D ∈ IRn×n that minimizes kF − DkF (2) where k.kF denotes the Frobenius norm. see Al-Homidan and Fletcher [1] 5 3 Educational Testing Problem The educational testing problem. can be ex- pressed as maximize eT θ θ ∈ IRn subject to F − diag θ ≥ 0 θi ≥ 0 i = 1, ..., n (3) where e = (1, 1, ..., 1)T .
    [Show full text]