DOCSLIB.ORG

On the Local Smith Normal Form

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
On the Local Smith Normal Form Smith Normal Form over Local Rings and Related Problems by Mustafa Elsheikh A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Doctor of Philosophy in Computer Science Waterloo, Ontario, Canada, 2017 c Mustafa Elsheikh 2017 Examining Committee Membership The following served on the Examining Committee for this thesis. The decision of the Examining Committee is by majority vote. External Examiner Jean-Guillaume Dumas Professeur, Math´ematiques Appliqu´ees Universit´eGrenoble Alpes, France Supervisor Mark Giesbrecht Professor, David R. Cheriton School of Computer Science University of Waterloo, Canada Internal Member George Labahn Professor, David R. Cheriton School of Computer Science University of Waterloo, Canada Internal Member Arne Storjohann Associate Professor, David R. Cheriton School of Computer Science University of Waterloo, Canada Internal-external Member Kevin Hare Professor, Department of Pure Mathematics University of Waterloo, Canada ii Author's Declaration This thesis consists of material all of which I authored or co-authored: see Statement of Contributions included in the thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners. I understand that my thesis may be made electronically available to the public. iii Statement of Contributions I am the sole author of Chapters 1, 4, and 7. Chapter 2 is based on an article co- authored with Mark Giesbrecht, B. David Saunders, and Andy Novocin. Chapter 3 is based on collaboration with Mark Giesbrecht, and B. David Saunders. Chapter 5 is based on an article co-authored with Mark Giesbrecht. Chapter 6 is based on collaboration with Mark Giesbrecht, and Andy Novocin. iv Abstract The Smith normal form is a diagonalization of matrices with many applications in diophantine analysis, graph theory, system control theory, simplicial homology, and more recently, in topological analysis of big data. Efficient computation of Smith normal form is a well-studied area for matrices with integer and polynomial entries. Existing successful algorithms typically rely on elimination for dense matrices and iterative Krylov space methods for sparse matrices. Our interest lies in computing Smith normal form for sparse matrices over local rings, where traditional iterative methods face challenges due to the lack of unique minimal poly- nomials. We explore different approaches to tackling this problem for two local rings: the integers modulo a prime power, and the polynomials modulo a power of an irreducible polynomial. Over local polynomial rings, we find success in linearization into larger di- mension matrices over the base field. Effectively we transform the problem of computing the Smith normal form into a small number of rank problems over the base field. The latter problem has existing efficient algorithms for sparse and dense matrices. The problem is harder over local integer rings. We take the approach of hybrid sparse- dense algorithms. We also tackle a restricted version of the problem where we detect only the first non-trivial invariant factor. We also give an algorithm to find the first few invariant factors using iterative rank-1 updates. This method becomes dense when applied to finding all the invariant factors. We digress slightly into the related problem of preconditioning. We show that linear- time preconditioners are suitable for computing Smith normal form, and computing nullspace samples. For the latter problem we design an algorithm for computing uniform samples from the nullspace. On a separate track, we focus on the properties of the Smith normal form decomposition. We relate the invariant factors to the eigenvalues. Our ultimate goal is to extend the applications of numerical algorithms for computing eigenvalues to computing the invariant factors of symbolic matrices. v Acknowledgements I would like to thank Mark Giesbrecht for being a mentor, a collaborator, and a good friend. I would like to thank my family for their constant love and support. Thank you Inas. vi Table of Contents 1 Introduction1 1.1 Smith Normal Form..............................1 1.2 The Black-Box Model..............................4 1.3 Probabilistic Algorithms............................9 1.4 Thesis Outline.................................. 10 2 Sparse Smith Normal Form 12 2.1 Introduction................................... 12 2.2 Previous Work................................. 14 2.2.1 Finding the Last Invariant Factor................... 14 2.2.2 The Valence Method.......................... 15 2.2.3 Using the Characteristic Polynomial................. 17 2.3 Linearization of Polynomial Matrices..................... 18 2.3.1 A Black-Box for the Embedding.................... 22 2.3.2 The Algorithm............................. 22 2.4 Smith Normal Form over Z=peZ ....................... 24 2.4.1 Nullspace Method............................ 24 2.4.2 Probabilistic Dimension Reduction.................. 25 vii 2.4.3 Working with Small Primes...................... 28 2.4.4 The Algorithm............................. 28 2.5 Detecting Non-Trivial Smith Normal Form.................. 30 3 Preconditioning 34 3.1 Introduction................................... 34 3.2 Nullspace Sampling............................... 36 3.2.1 Transpose Preconditioners....................... 37 3.2.2 Avoiding Extension Fields....................... 41 3.3 Smith Normal Form.............................. 43 3.3.1 Preconditioning and Determinantal Divisors............. 44 3.4 Conclusion.................................... 48 4 Rank Reduction 49 4.1 Introduction................................... 49 4.2 Invariant Factors and Rank-1 Updates.................... 52 4.3 Block Reduction................................ 59 4.4 Nullspace Sampling............................... 64 5 The Eigenvalues and the Invariant Factors 68 5.1 Introduction................................... 68 5.1.1 The p-adic Correspondence...................... 72 5.1.2 Previous Work............................. 72 5.2 Establishing p-Correspondence......................... 74 5.3 Density of p-Characterized Matrices...................... 78 5.3.1 Density at Large Primes........................ 82 5.4 Density at Small Primes............................ 89 viii 6 Ranks of Remainder Matrices 91 6.1 Introduction................................... 91 6.2 Quotient and Remainder Matrices....................... 92 6.2.1 Remainder of Rank-1 Matrices..................... 93 6.2.2 A Note on Latin Squares........................ 96 6.2.3 Rank Theorem............................. 98 6.3 p-Adic Matrices................................. 100 6.3.1 Binary Code Matrices......................... 100 6.3.2 Non-Symmetric Matrices........................ 104 6.3.3 Odd Primes............................... 105 7 Conclusion and Future Work 107 References 111 ix Chapter 1 Introduction In this thesis we will study the problem of computing the Smith normal form over local rings, and some related problems regarding computing nullspace vectors, rank properties and eigenvalues properties. We are primarily concerned with the case of sparse matrices, but we will occasionally consider dense matrices as well. We start this chapter by defining several concepts central to our discussion. We finish by giving an overview of the chapters of this thesis. 1.1 Smith Normal Form Let F be a field, and let A be an n × n matrix over F. We use det(A), rank(A), charpoly(A), im(A), ker(A) to denote the determinant, rank, characteristic polynomial, image, and right kernel of A, respectively. We use minpoly(A) to denote the minimal polynomial of A, that is, the lowest degree non-zero monic polynomial f 2 F[x] such that f(A) = 0. We use fλ1; : : : ; λng to denote the eigenvalues of A. Two notions of matrix transformation are notable: similarity transformation and equiv- alence transformation. We say that A and B are similar if there exists an invertible matrix W such that A = W −1BW . On the other hand, we say that A and B are equivalent if there exists two invertible matrices P , Q such that A = P BQ. When working over a principal ideal ring R, we require that P , Q be unimodular, i.e., have a determinant which is unit 1 in the ring. Some matrix invariants, such as rank (when suitably defined over the ring), are preserved under both transformations. Other invariants, such as the characteristic polynomial (and hence) the eigenvalues, are preserved under the similarity transformation only. This will have important implications later when we discuss the preconditioning operations. Consider a matrix A over a field. The eigenvalues of A will typically lie in an ex- tension field K (that is, the splitting field of the characteristic polynomial of A). It is well-known that over K, the matrix A can be brought to the Jordan form using a similarity transformation J = W AW −1. The matrix J is a block-diagonal matrix given by 2 3 J1 6 7 6 7 6 J2 7 J = 6 7 ; 6 .. 7 6 . 7 4 5 J` where each Ji is called the Jordan block, which is a ki × ki matrix 2 3 λi 1 6 7 6 .. .. 7 6 . 7 Ji = 6 7 : 6 .. 7 6 . 1 7 4 5 λi The number of Jordan blocks associated with an eigenvalue and the dimension of each block is determined by the geometric and algebraic multiplicities of that eigenvalue. We note that minpoly(A) is always a factor of charpoly(A). However, as we will discuss later, if all the Jordan blocks corresponding to the zero eigenvalue have size at most 1, then charpoly(A) and minpoly(A) differ by at least a power of x, which will be useful in computing
Load more

Recommended publications
  • Modeling, Inference and Clustering for Equivalence Classes of 3-D Orientations Chuanlong Du Iowa State University
    Iowa State University Capstones, Theses and Graduate Theses and Dissertations Dissertations 2014 Modeling, inference and clustering for equivalence classes of 3-D orientations Chuanlong Du Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/etd Part of the Statistics and Probability Commons Recommended Citation Du, Chuanlong, "Modeling, inference and clustering for equivalence classes of 3-D orientations" (2014). Graduate Theses and Dissertations. 13738. https://lib.dr.iastate.edu/etd/13738 This Dissertation is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Graduate Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. Modeling, inference and clustering for equivalence classes of 3-D orientations by Chuanlong Du A dissertation submitted to the graduate faculty in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Major: Statistics Program of Study Committee: Stephen Vardeman, Co-major Professor Daniel Nordman, Co-major Professor Dan Nettleton Huaiqing Wu Guang Song Iowa State University Ames, Iowa 2014 Copyright c Chuanlong Du, 2014. All rights reserved. ii DEDICATION I would like to dedicate this dissertation to my mother Jinyan Xu. She always encourages me to follow my heart and to seek my dreams. Her words have always inspired me and encouraged me to face difficulties and challenges I came across in my life. I would also like to dedicate this dissertation to my wife Lisha Li without whose support and help I would not have been able to complete this work.
    [Show full text]
  • Arxiv:1302.2015V2 [Cs.CG]
    MATHEMATICS OF COMPUTATION Volume 00, Number 0, Pages 000–000 S 0025-5718(XX)0000-0 PERSISTENCE MODULES: ALGEBRA AND ALGORITHMS PRIMOZ SKRABA Joˇzef Stefan Institute, Ljubljana, Slovenia Artificial Intelligence Laboratory, Joˇzef Stefan Institute, Jamova 39, 1000 Ljubljana, Slovenia MIKAEL VEJDEMO-JOHANSSON Corresponding author Formerly: School of Computer Science, University of St Andrews, Scotland Computer Vision and Active Perception Lab, KTH, Teknikringen 14, 100 44 Stockholm, Sweden Abstract. Persistent homology was shown by Zomorodian and Carlsson [35] to be homology of graded chain complexes with coefficients in the graded ring k[t]. As such, the behavior of persistence modules — graded modules over k[t] — is an important part in the analysis and computation of persistent homology. In this paper we present a number of facts about persistence modules; ranging from the well-known but under-utilized to the reconstruction of techniques to work in a purely algebraic approach to persistent homology. In particular, the results we present give concrete algorithms to compute the persistent homology of a simplicial complex with torsion in the chain complex. Contents 1. Introduction 2 2. Persistent (Co-)Homology 3 arXiv:1302.2015v2 [cs.CG] 15 Feb 2013 3. Overview of Commutative Algebra 4 4. Applications 21 5. Conclusions & Future Work 23 References 23 Appendix A. Algorithm for Computing Presentations of Persistence Modules 25 Appendix B. Relative Persistent Homology Example 26 E-mail addresses: [email protected], [email protected]. 2010 Mathematics Subject Classification. 13P10, 55N35. c XXXX American Mathematical Society 1 2 PERSISTENCE MODULES: ALGEBRA AND ALGORITHMS 1. Introduction The ideas of topological persistence [20] and persistent homology [35] have had a fundamental impact on computational geometry and the newly spawned field of applied topology.
    [Show full text]
  • On Finding Multiplicities of Characteristic Polynomial Factors Of
    On finding multiplicities of characteristic polynomial factors of black-box matrices∗. Jean-Guillaume Dumas† Cl´ement Pernet‡ B. David Saunders§ November 2, 2018 Abstract We present algorithms and heuristics to compute the characteristic polynomial of a matrix given its minimal polynomial. The matrix is rep- resented as a black-box, i.e., by a function to compute its matrix-vector product. The methods apply to matrices either over the integers or over a large enough finite field. Experiments show that these methods perform efficiently in practice. Combined in an adaptive strategy, these algorithms reach significant speedups in practice for some integer matrices arising in an application from graph theory. Keywords: Characteristic polynomial ; black-box matrix ; finite field. 1 Introduction Computing the characteristic polynomial of an integer matrix is a classical math- ematical problem. It is closely related to the computation of the Frobenius nor- mal form which can be used to test two matrices for similarity, or computing invariant subspaces under the action of the matrix. Although the Frobenius normal form contains more information on the matrix than the characteristic arXiv:0901.4747v2 [cs.SC] 18 May 2009 polynomial, most algorithms to compute it are based on computations of char- acteristic polynomials (see for example [25, 9.7]). Several matrix representations are used in§ computational linear algebra. In the dense representation, a m n matrix is considered as the array of all the m n coefficients. The sparse representation× only considers non-zero coefficients using× different possible data structures. In the black-box representation, the matrix ∗Saunders supported by National Science Foundation Grants CCF-0515197, CCF-0830130.
    [Show full text]
  • Sometimes Only Square Matrices Can Be Diagonalized 19
    PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 52, October 1975 SOMETIMESONLY SQUARE MATRICESCAN BE DIAGONALIZED LAWRENCE S. LEVY ABSTRACT. It is proved that every SQUARE matrix over a serial ring is equivalent to some diagonal matrix, even though there are rectangular matri- ces over these rings which cannot be diagonalized. Two matrices A and B over a ring R are equivalent if B - PAQ for in- vertible matrices P and Q over R- Following R. B. Warfield, we will call a module serial if its submodules are totally ordered by inclusion; and we will call a ring R serial it R is a direct sum of serial left modules, and also a direct sum of serial right mod- ules. When R is artinian, these become the generalized uniserial rings of Nakayama LE-GJ- Note that, in serial rings, finitely generated ideals do not have to be principal; for example, let R be any full ring of lower triangular matrices over a field. Moreover, it is well known (and easily proved) that if aR + bR is a nonprincipal right ideal in any ring, the 1x2 matrix [a b] is not equivalent to a diagonal matrix. Thus serial rings do not have the property that every rectangular matrix can be diagonalized. 1. Background. Serial rings are clearly semiperfect (P/radR is semisim- ple artinian and idempotents can be lifted modulo radP). (1.1) Every indecomposable projective module over a semiperfect ring R is S eR for some primitive idempotent e of R. (See [M].) A double-headed arrow -» will denote an "onto" homomorphism.
    [Show full text]
  • The Intersection of Some Classical Equivalence Classes of Matrices Mark Alan Mills Iowa State University
    Iowa State University Capstones, Theses and Retrospective Theses and Dissertations Dissertations 1999 The intersection of some classical equivalence classes of matrices Mark Alan Mills Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/rtd Part of the Mathematics Commons Recommended Citation Mills, Mark Alan, "The intersection of some classical equivalence classes of matrices " (1999). Retrospective Theses and Dissertations. 12153. https://lib.dr.iastate.edu/rtd/12153 This Dissertation is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Retrospective Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. INFORMATION TO USERS This manuscript has been reproduced from the microfilm master. UMI films the text directly fi'om the original or copy submitted. Thus, some thesis and dissertation copies are in typewriter face, while others may be from any type of computer printer. The quality of this reproduction is dependent upon the quality of the copy submitted. Broken or indistinct print, colored or poor quality illustrations and photographs, print bleedthrough, substandard margins, and improper alignment can adversely affect reproduction. In the unlikely event that the author did not send UMI a complete manuscript and there are missing pages, these will be noted. Also, if unauthorized copyright material had to be removed, a note will indicate the deletion. Oversize materials (e.g., maps, drawings, charts) are reproduced by sectioning the original, beginning at the upper left-hand comer and continuing firom left to right in equal sections with small overlaps.
    [Show full text]
  • A Review of Matrix Scaling and Sinkhorn's Normal Form for Matrices
    A review of matrix scaling and Sinkhorn’s normal form for matrices and positive maps Martin Idel∗ Zentrum Mathematik, M5, Technische Universität München, 85748 Garching Abstract Given a nonnegative matrix A, can you find diagonal matrices D1, D2 such that D1 AD2 is doubly stochastic? The answer to this question is known as Sinkhorn’s theorem. It has been proved with a wide variety of methods, each presenting a variety of possible generalisations. Recently, generalisations such as to positive maps between matrix algebras have become more and more interesting for applications. This text gives a review of over 70 years of matrix scaling. The focus lies on the mathematical landscape surrounding the problem and its solution as well as the generalisation to positive maps and contains hardly any nontrivial unpublished results. Contents 1. Introduction3 2. Notation and Preliminaries4 3. Different approaches to equivalence scaling5 3.1. Historical remarks . .6 3.2. The logarithmic barrier function . .8 3.3. Nonlinear Perron-Frobenius theory . 12 3.4. Entropy optimisation . 14 3.5. Convex programming and dual problems . 17 3.6. Topological (non-constructive) approaches . 20 arXiv:1609.06349v1 [math.RA] 20 Sep 2016 3.7. Other ideas . 21 3.7.1. Geometric proofs . 22 3.7.2. Other direct convergence proofs . 23 ∗[email protected] 1 4. Equivalence scaling 24 5. Other scalings 27 5.1. Matrix balancing . 27 5.2. DAD scaling . 29 5.3. Matrix Apportionment . 33 5.4. More general matrix scalings . 33 6. Generalised approaches 35 6.1. Direct multidimensional scaling . 35 6.2. Log-linear models and matrices as vectors .
    [Show full text]
  • Math 623: Matrix Analysis Final Exam Preparation
    Mike O'Sullivan Department of Mathematics San Diego State University Spring 2013 Math 623: Matrix Analysis Final Exam Preparation The final exam has two parts, which I intend to each take one hour. Part one is on the material covered since the last exam: Determinants; normal, Hermitian and positive definite matrices; positive matrices and Perron's theorem. The problems will all be very similar to the ones in my notes, or in the accompanying list. For part two, you will write an essay on what I see as the fundamental theme of the course, the four equivalence relations on matrices: matrix equivalence, similarity, unitary equivalence and unitary similarity (See p. 41 in Horn 2nd Ed. He calls matrix equivalence simply \equivalence."). Imagine you are writing for a fellow master's student. Your goal is to explain to them the key ideas. Matrix equivalence: (1) Define it. (2) Explain the relationship with abstract linear transformations and change of basis. (3) We found a simple set of representatives for the equivalence classes: identify them and sketch the proof. Similarity: (1) Define it. (2) Explain the relationship with abstract linear transformations and change of basis. (3) We found a set of representatives for the equivalence classes using Jordan matrices. State the Jordan theorem. (4) The proof of the Jordan theorem can be broken into two parts: (1) writing the ambient space as a direct sum of generalized eigenspaces, (2) classifying nilpotent matrices. Sketch the proof of each. Explain the role of invariant spaces. Unitary equivalence (1) Define it. (2) Explain the relationship with abstract inner product spaces and change of basis.
    [Show full text]
  • Computing Simplicial Homology Based on Efficient Smith Normal Form Algorithms
    Computing Simplicial Homology Based on Efficient Smith Normal Form Algorithms Jean-Guillaume Dumas1, Frank Heckenbach2, David Saunders3, and Volkmar Welker4 1 Laboratoire de Mod´elisation et Calcul, IMAG-B. P. 53, 38041 Grenoble, France 2 Universit¨atErlangen-N¨urnberg, Mathematisches Institut, Bismarckstr. 1 1/2, 91054 Erlangen, Germany 3 University of Delaware, Department of Computer and Information Sciences, Newark, DE 19716, USA 4 Philipps-Universit¨atMarburg, Fachbereich Mathematik und Informatik, 35032 Marburg, Germany Abstract. We recall that the calculation of homology with integer coefficients of a simplicial complex reduces to the calculation of the Smith Normal Form of the boundary matrices which in general are sparse. We provide a review of several al- gorithms for the calculation of Smith Normal Form of sparse matrices and compare their running times for actual boundary matrices. Then we describe alternative ap- proaches to the calculation of simplicial homology. The last section then describes motivating examples and actual experiments with the GAP package that was im- plemented by the authors. These examples also include as an example of other homology theories some calculations of Lie algebra homology. 1 Introduction Geometric properties of topological spaces are often conveniently expressed by algebraic invariants of the space. Notably the fundamental group, the higher homotopy groups, the homology groups and the cohomology algebra play a prominent role in this respect. This paper focuses on methods for the computer calculation of the homology of finite simplicial complexes and its applications (see comments on the other invariants in Section 7). We assume that the topological space, whose homology we want to cal- culate, is given as an abstract simplicial complex.
    [Show full text]
  • A Local Approach to Matrix Equivalence*
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector A Local Approach to Matrix Equivalence* Larry J. Gerstein Department of Mathematics University of California Santa Barbara, California 93106 Submitted by Hans Schneider ABSTRACT Matrix equivalence over principal ideal domains is considered, using the tech- nique of localization from commutative algebra. This device yields short new proofs for a variety of results. (Some of these results were known earlier via the theory of determinantal divisors.) A new algorithm is presented for calculation of the Smith normal form of a matrix, and examples are included. Finally, the natural analogue of the Witt-Grothendieck ring for quadratic forms is considered in the context of matrix equivalence. INTRODUCTION It is well known that every matrix A over a principal ideal domain is equivalent to a diagonal matrix S(A) whose main diagonal entries s,(A),s,(A), . divide each other in succession. [The s,(A) are the invariant factors of A; they are unique up to unit multiples.] How should one effect this diagonalization? If the ring is Euclidean, a sequence of elementary row and column operations will do the job; but in the general case one usually relies on the theory of determinantal divisors: Set d,,(A) = 1, and for 1 < k < r = rankA define d,(A) to be the greatest common divisor of all the k x k subdeterminants of A; then +(A) = dk(A)/dk_-l(A) for 1 < k < r, and sk(A) = 0 if k > r. The calculation of invariant factors via determinantal divisors in this way is clearly a very tedious process.
    [Show full text]
  • Observavility Brunovsky Normal Form: Multi-Output Linear Dynamical Systems Driss Boutat, Frédéric Kratz, Jean-Pierre Barbot
    Observavility Brunovsky Normal Form: Multi-Output Linear Dynamical Systems Driss Boutat, Frédéric Kratz, Jean-Pierre Barbot To cite this version: Driss Boutat, Frédéric Kratz, Jean-Pierre Barbot. Observavility Brunovsky Normal Form: Multi- Output Linear Dynamical Systems. American Control Conference, ACC09, IEEE, Jun 2009, St. Louis, MO, United States. hal-00772281 HAL Id: hal-00772281 https://hal.inria.fr/hal-00772281 Submitted on 10 Jan 2013 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Observavility Brunovsky Normal Form: Multi-Output Linear Dynamical Systems Driss Boutat, Fred´ eric´ Kratz and Jean-Pierre Barbot Abstract— This paper gives the sufficient and necessary II. NOTATION AND PROBLEM STATEMENT conditions to guarantee the existence of a linear change of co- ordinates to transform a multi-output linear dynamical system (modulo a nonlinear term depending on inputs and outputs) in the observability Brunovsky canonical form. Consider the following multi-output dynamical system: I. INTRODUCTION x˙ = Ax + γ(y, u) (1) y = Cx (2) For a single output dynamical linear system the observability rank condition is a necessary and sufficient condition to transform it into the Brunovsky observability where: normal form. In this last form, it is possible to use classical observer such that [8] observer and, [5] observer.
    [Show full text]
  • Linear Algebra
    LINEAR ALGEBRA T.K.SUBRAHMONIAN MOOTHATHU Contents 1. Vector spaces and subspaces 2 2. Linear independence 5 3. Span, basis, and dimension 7 4. Linear operators 11 5. Linear functionals and the dual space 15 6. Linear operators = matrices 18 7. Multiplying a matrix left and right 22 8. Solving linear equations 28 9. Eigenvalues, eigenvectors, and the triangular form 32 10. Inner product spaces 36 11. Orthogonal projections and least square solutions 39 12. Unitary operators: they preserve distances and angles 43 13. Orthogonal diagonalization of normal and self-adjoint operators 46 14. Singular value decomposition 50 15. Determinant of a square matrix: properties 51 16. Determinant: existence and expressions 54 17. Minimal and characteristic polynomials 58 18. Primary decomposition theorem 61 19. The Jordan canonical form (JCF) 65 20. Trace of a square matrix 71 21. Quadratic forms 73 Developing effective techniques to solve systems of linear equations is one important goal of Linear Algebra. Our study of Linear Algebra will proceed through two parallel roads: (i) the theory of linear operators, and (ii) the theory of matrices. Why do we say parallel roads? Well, here is an illustrative example. Consider the following system of linear equations: 1 2 T.K.SUBRAHMONIAN MOOTHATHU 2x1 + 3x2 = 7 4x1 − x2 = 5. 2 We are interested in two questions: is there a solution (x1; x2) 2 R to the above? and if there is a solution, is the solution unique? This problem can be formulated in two other ways: 2 2 First reformulation: Let T : R ! R be T (x1; x2) = (2x1 + 3x2; 4x1 − x2).
    [Show full text]
  • A Rough Guide to Linear Algebra
    A rough guide to linear algbera Dongryul Kim Version of April 18, 2020 ii Contents Preface v 1 Sets 1 1.1 Sets and maps . .1 1.2 Products, coproducts, and sets of maps . .4 1.3 Fun with diagrams . .7 1.4 Equivalence classes . .9 2 Vector spaces 13 2.1 Fields . 13 2.2 Vector spaces . 15 2.3 Matrices . 18 2.4 Products and direct sums . 21 2.5 Subspaces and quotients . 27 2.6 Vector spaces from linear maps . 29 2.7 Bases and dimension . 34 2.8 Dual spaces . 44 2.9 Linear algebra in combinatorics . 50 3 Multilinear algebra 55 3.1 Bilinear maps and tensor products . 55 3.2 Symmetric and exterior algebras . 62 3.3 The determinant . 68 3.4 Computing the inverse matrix . 72 4 Linear algebra without division 79 4.1 Commutative rings . 79 4.2 Modules . 82 4.3 Classification of finitely generated modules over a PID . 86 4.4 Frobenius and Jordan normal form . 97 4.5 Eigenvalues and eigenvectors . 103 iii iv CONTENTS 5 Linear algebra over R and C 109 5.1 A bit of analysis . 109 5.2 Inner products . 112 5.3 Operators on Hilbert spaces . 118 5.4 The spectral theorem . 121 5.5 Positivity of operators . 125 5.6 Duality in linear programming . 130 Epilogue 131 Preface At a certain point, one adopts a mode of learning mathematics. Then at a later point, after progressing through various styles of teaching and writing, one develops one's own point of view for how mathematics is to be taught.
    [Show full text]