DOCSLIB.ORG

Contents • Preliminaries O Elementary Matrix Operations O

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Contents • Preliminaries O Elementary Matrix Operations O © Dennis L. Bricker Dept of Mechanical & Industrial Engineering University of Iowa Solving Linear Eqns 8/26/2003 page 1 Solving Linear Eqns 8/26/2003 page 3 Contents • Preliminaries o Elementary Matrix Operations o Elementary Matrices o Echelon Matrices o Rank of Matrices • Elimination Methods o Gauss Elimination o Gauss-Jordan Elimination • Factorization Methods o Product Form of Inverse (PFI) o LU Factorization o LDLT Factorization o Cholesky LLT Factorization Solving Linear Eqns 8/26/2003 page 2 Solving Linear Eqns 8/26/2003 page 4 Solving Linear Eqns 8/26/2003 page 5 Solving Linear Eqns 8/26/2003 page 7 Solving Linear Eqns 8/26/2003 page 6 Solving Linear Eqns 8/26/2003 page 8 Solving Linear Eqns 8/26/2003 page 9 Solving Linear Eqns 8/26/2003 page 11 Solving Linear Eqns 8/26/2003 page 10 Solving Linear Eqns 8/26/2003 page 12 Solving Linear Eqns 8/26/2003 page 13 Solving Linear Eqns 8/26/2003 page 15 Solving Linear Eqns 8/26/2003 page 14 Solving Linear Eqns 8/26/2003 page 16 Solving Linear Eqns 8/26/2003 page 17 Solving Linear Eqns 8/26/2003 page 19 Solving Linear Eqns 8/26/2003 page 18 Solving Linear Eqns 8/26/2003 page 20 Solving Linear Eqns 8/26/2003 page 21 Solving Linear Eqns 8/26/2003 page 23 Solving Linear Eqns 8/26/2003 page 22 Solving Linear Eqns 8/26/2003 page 24 Solving Linear Eqns 8/26/2003 page 25 Solving Linear Eqns 8/26/2003 page 27 Solving Linear Eqns 8/26/2003 page 26 Solving Linear Eqns 8/26/2003 page 28 Solving Linear Eqns 8/26/2003 page 29 Solving Linear Eqns 8/26/2003 page 31 Solving Linear Eqns 8/26/2003 page 30 Solving Linear Eqns 8/26/2003 page 32 Solving Linear Eqns 8/26/2003 page 33 Solving Linear Eqns 8/26/2003 page 35 Solving Linear Eqns 8/26/2003 page 34 Solving Linear Eqns 8/26/2003 page 36 CHOLESKY FACTORIZATION Cholesky factorization… Suppose that A is a symmetric & positive definite matrix. Then the Cholesky factorization of A is A = LLˆˆT where Lˆ is a lower triangular matrix. Computation: Suppose that we have the factorization A = LDLT i ≥ ˆ Then if Di 0, we can define a new diagonal matrix D where ˆ ii≡ DiiD T Then A ==L D LTT L Dˆˆ D L =()() LD ˆ LD ˆ = L ˆˆ L Twhere Lˆˆ= LD Solving Linear Eqns 8/26/2003 page 37 Solving Linear Eqns 8/26/2003 page 39 Example: The lower triangular matrix L is found by performing (on the identity matrix) the inverse of the row operations used to reduce We wish to find the Cholesky factorization of the matrix the A matrix: 201 A = 011 100 112 ←+1 RR33 R 1 2 ⇒ L = 010 RRR←+ 332 1 11 2 We now have the LU factorization of matrix A: 100201 ALU==010011 111100 22 Solving Linear Eqns 8/26/2003 page 38 Solving Linear Eqns 8/26/2003 page 40 Define the diagonal matrix D: ˆ ˆ ii≡ Define the diagonal matrix D where DiiD : 1 20 0 00 2 −1 20 0 DD= 01 0⇒ = 0 10 Dˆ = 01 0 001002 2 001 Note that 2 1 10020 0 2 0 0 0020 1 2 −1 LLDˆˆ==01001 0 = 0 1 0 UDUˆ ==010011 Then compute 111111 0 0 1 00200 1 2 2 22 2 101 So the Cholesky factorization is 2 = 01 1 20 1 20 02 00 1 ALL==ˆˆT 010 011 11100 1 22 2 Solving Linear Eqns 8/26/2003 page 41 Solving Linear Eqns 8/26/2003 page 43 And so, 1 10020010 2 ALDL==T 010010011 110011100 22 Solving Linear Eqns 8/26/2003 page 42.
Load more

Recommended publications
  • Chapter Four Determinants
    Chapter Four Determinants In the first chapter of this book we considered linear systems and we picked out the special case of systems with the same number of equations as unknowns, those of the form T~x = ~b where T is a square matrix. We noted a distinction between two classes of T ’s. While such systems may have a unique solution or no solutions or infinitely many solutions, if a particular T is associated with a unique solution in any system, such as the homogeneous system ~b = ~0, then T is associated with a unique solution for every ~b. We call such a matrix of coefficients ‘nonsingular’. The other kind of T , where every linear system for which it is the matrix of coefficients has either no solution or infinitely many solutions, we call ‘singular’. Through the second and third chapters the value of this distinction has been a theme. For instance, we now know that nonsingularity of an n£n matrix T is equivalent to each of these: ² a system T~x = ~b has a solution, and that solution is unique; ² Gauss-Jordan reduction of T yields an identity matrix; ² the rows of T form a linearly independent set; ² the columns of T form a basis for Rn; ² any map that T represents is an isomorphism; ² an inverse matrix T ¡1 exists. So when we look at a particular square matrix, the question of whether it is nonsingular is one of the first things that we ask. This chapter develops a formula to determine this. (Since we will restrict the discussion to square matrices, in this chapter we will usually simply say ‘matrix’ in place of ‘square matrix’.) More precisely, we will develop infinitely many formulas, one for 1£1 ma- trices, one for 2£2 matrices, etc.
    [Show full text]
  • 2014 CBK Linear Algebra Honors.Pdf
    PETERS TOWNSHIP SCHOOL DISTRICT CORE BODY OF KNOWLEDGE LINEAR ALGEBRA HONORS GRADE 12 For each of the sections that follow, students may be required to analyze, recall, explain, interpret, apply, or evaluate the particular concept being taught. Course Description This college level mathematics course will cover linear algebra and matrix theory emphasizing topics useful in other disciplines such as physics and engineering. Key topics include solving systems of equations, evaluating vector spaces, performing linear transformations and matrix representations. Linear Algebra Honors is designed for the extremely capable student who has completed one year of calculus. Systems of Linear Equations Categorize a linear equation in n variables Formulate a parametric representation of solution set Assess a system of linear equations to determine if it is consistent or inconsistent Apply concepts to use back-substitution and Guassian elimination to solve a system of linear equations Investigate the size of a matrix and write an augmented or coefficient matrix from a system of linear equations Apply concepts to use matrices and Guass-Jordan elimination to solve a system of linear equations Solve a homogenous system of linear equations Design, setup and solve a system of equations to fit a polynomial function to a set of data points Design, set up and solve a system of equations to represent a network Matrices Categorize matrices as equal Construct a sum matrix Construct a product matrix Assess two matrices as compatible Apply matrix multiplication
    [Show full text]
  • Section 2.4–2.5 Partitioned Matrices and LU Factorization
    Section 2.4{2.5 Partitioned Matrices and LU Factorization Gexin Yu [email protected] College of William and Mary Gexin Yu [email protected] Section 2.4{2.5 Partitioned Matrices and LU Factorization One approach to simplify the computation is to partition a matrix into blocks. 2 3 0 −1 5 9 −2 3 Ex: A = 4 −5 2 4 0 −3 1 5. −8 −6 3 1 7 −4 This partition can also be written as the following 2 × 3 block matrix: A A A A = 11 12 13 A21 A22 A23 3 0 −1 In the block form, we have blocks A = and so on. 11 −5 2 4 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns. Standard computation techniques are inefficient in such cases, so we need to develop techniques which exploit the internal structure of the matrices. In most cases, the matrices of interest have lots of zeros. Gexin Yu [email protected] Section 2.4{2.5 Partitioned Matrices and LU Factorization 2 3 0 −1 5 9 −2 3 Ex: A = 4 −5 2 4 0 −3 1 5. −8 −6 3 1 7 −4 This partition can also be written as the following 2 × 3 block matrix: A A A A = 11 12 13 A21 A22 A23 3 0 −1 In the block form, we have blocks A = and so on. 11 −5 2 4 partition matrices into blocks In real world problems, systems can have huge numbers of equations and un-knowns.
    [Show full text]
  • Linear Algebra and Matrix Theory
    Linear Algebra and Matrix Theory Chapter 1 - Linear Systems, Matrices and Determinants This is a very brief outline of some basic definitions and theorems of linear algebra. We will assume that you know elementary facts such as how to add two matrices, how to multiply a matrix by a number, how to multiply two matrices, what an identity matrix is, and what a solution of a linear system of equations is. Hardly any of the theorems will be proved. More complete treatments may be found in the following references. 1. References (1) S. Friedberg, A. Insel and L. Spence, Linear Algebra, Prentice-Hall. (2) M. Golubitsky and M. Dellnitz, Linear Algebra and Differential Equa- tions Using Matlab, Brooks-Cole. (3) K. Hoffman and R. Kunze, Linear Algebra, Prentice-Hall. (4) P. Lancaster and M. Tismenetsky, The Theory of Matrices, Aca- demic Press. 1 2 2. Linear Systems of Equations and Gaussian Elimination The solutions, if any, of a linear system of equations (2.1) a11x1 + a12x2 + ··· + a1nxn = b1 a21x1 + a22x2 + ··· + a2nxn = b2 . am1x1 + am2x2 + ··· + amnxn = bm may be found by Gaussian elimination. The permitted steps are as follows. (1) Both sides of any equation may be multiplied by the same nonzero constant. (2) Any two equations may be interchanged. (3) Any multiple of one equation may be added to another equation. Instead of working with the symbols for the variables (the xi), it is eas- ier to place the coefficients (the aij) and the forcing terms (the bi) in a rectangular array called the augmented matrix of the system. a11 a12 .
    [Show full text]
  • Block Matrices in Linear Algebra
    PRIMUS Problems, Resources, and Issues in Mathematics Undergraduate Studies ISSN: 1051-1970 (Print) 1935-4053 (Online) Journal homepage: https://www.tandfonline.com/loi/upri20 Block Matrices in Linear Algebra Stephan Ramon Garcia & Roger A. Horn To cite this article: Stephan Ramon Garcia & Roger A. Horn (2020) Block Matrices in Linear Algebra, PRIMUS, 30:3, 285-306, DOI: 10.1080/10511970.2019.1567214 To link to this article: https://doi.org/10.1080/10511970.2019.1567214 Accepted author version posted online: 05 Feb 2019. Published online: 13 May 2019. Submit your article to this journal Article views: 86 View related articles View Crossmark data Full Terms & Conditions of access and use can be found at https://www.tandfonline.com/action/journalInformation?journalCode=upri20 PRIMUS, 30(3): 285–306, 2020 Copyright # Taylor & Francis Group, LLC ISSN: 1051-1970 print / 1935-4053 online DOI: 10.1080/10511970.2019.1567214 Block Matrices in Linear Algebra Stephan Ramon Garcia and Roger A. Horn Abstract: Linear algebra is best done with block matrices. As evidence in sup- port of this thesis, we present numerous examples suitable for classroom presentation. Keywords: Matrix, matrix multiplication, block matrix, Kronecker product, rank, eigenvalues 1. INTRODUCTION This paper is addressed to instructors of a first course in linear algebra, who need not be specialists in the field. We aim to convince the reader that linear algebra is best done with block matrices. In particular, flexible thinking about the process of matrix multiplication can reveal concise proofs of important theorems and expose new results. Viewing linear algebra from a block-matrix perspective gives an instructor access to use- ful techniques, exercises, and examples.
    [Show full text]
  • 1.5 Elementary Matrices and a Method for Finding the Inverse
    1.5 Elementary Matrices and a Method for Finding the Inverse De¯nition 1 A n £ n matrix is called an elementary matrix if it can be obtained from In by performing a single elementary row operation Reminder: Elementary row operations: 1. Multiply a row a by k 2 R 2. Exchange two rows 3. Add a multiple of one row to another Theorem 1 If the elementary matrix E results from performing a certain row operation on In and A is a m £ n matrix, then EA is the matrix that results when the same row operation is performed on A. Proof: Has to be done for each elementary row operation. Example 1 · ¸ · ¸ a b 0 1 A = ;E = c d 1 0 E was obtained from I2 by exchanging the two rows. · ¸ · ¸ · ¸ 0 1 a b c d EA = = 1 0 c d a b EA is the matrix which results from A by exchanging the two rows. (to be expected according to the theorem above.) Theorem 2 Every elementary matrix is invertible, and the inverse is also an elementary matrix. Theorem 3 If A is a n £ n matrix then the following statements are equivalent 1. A is invertible 2. Ax = 0 has only the trivial solution 3. The reduced echelon form of A is In 4. A can be expressed as a product of elementary matrices. 1 Proof: Prove the theorem by proving (a))(b))(c))(d))(a): (a))(b): Assume A is invertible and x0 is a solution of Ax = 0, then ¡1 Ax0 = 0, multiplying both sides with A gives ¡1 (A A)x0 = 0 , Inx0 = 0 , x0 = 0.
    [Show full text]
  • Unimodular Modules Paul Camion1
    Discrete Mathematics 306 (2006) 2355–2382 www.elsevier.com/locate/disc Unimodular modules Paul Camion1 CNRS, Universite Pierre et Marie Curie, Case Postale 189-Combinatoire, 4, Place Jussieu, 75252 Paris Cedex 05, France Received 12 July 2003; received in revised form 4 January 2006; accepted 9 January 2006 Available online 24 July 2006 Abstract The present publication is mainly a survey paper on the author’s contributions on the relations between graph theory and linear algebra. A system of axioms introduced by Ghouila-Houri allows one to generalize to an arbitrary Abelian group the notion of interval in a linearly ordered group and to state a theorem that generalizes two due to A.J. Hoffman. The first is on the feasibility of a system of inequalities and the other is Hoffman’s circulation theorem reported in the first Berge’s book on graph theory. Our point of view permitted us to prove classical results of linear programming in the more general setting of linearly ordered groups and rings. It also shed a new light on convex programming. © 2006 Published by Elsevier B.V. Keywords: Graph theory; Linear algebra; Abelian group; Ring; Modules; Generator; Linearly ordered group; Linearly ordered ring; Convexity; Polyhedron; Matroid 1. Introduction 1.1. Motivations We refer here to Berge’s book [3]. All results in the present paper have their origin in Section 15 of that book, translated into English from [1], and in Berge’s subsequent paper [2]. The aim of this paper, which is a rewriting of part of [14], is to gather together many of the results known already in 1965 and to set them in an algebraic context.
    [Show full text]
  • An Algorithmic Proof of Suslin's Stability Theorem Over Polynomial
    An Algorithmic Proof of Suslin’s Stability Theorem over Polynomial Rings Hyungju Park∗ Cynthia Woodburn† Abstract Let k be a field. Then Gaussian elimination over k and the Eu- clidean division algorithm for the univariate polynomial ring k[x] allow us to write any matrix in SLn(k) or SLn(k[x]), n ≥ 2, as a product of elementary matrices. Suslin’s stability theorem states that the same is true for the multivariate polynomial ring SLn(k[x1,...,xm]) with n ≥ 3. As Gaussian elimination gives us an algorithmic way of finding an explicit factorization of the given matrix into elementary matrices over a field, we develop a similar algorithm over polynomial rings. 1 Introduction Immediately after proving the famous Serre’s Conjecture (the Quillen-Suslin theorem, nowadays) in 1976 [11], A. Suslin went on [12] to prove the following K -analogue of Serre’s Conjecture which is now known as Suslin’s stability arXiv:alg-geom/9405003v1 10 May 1994 1 theorem: Let R be a commutative Noetherian ring and n ≥ max(3, dim(R)+ 2). Then, any n × n matrix A =(fij) of determinant 1, with fij being elements of the polynomial ring R[x1,...,xm], can be writ- ten as a product of elementary matrices over R[x1,...,xm]. ∗Dept. of Mathematics, University of California, Berkeley; [email protected] †Dept. of Mathematics, Pittsburg State University; [email protected] 1 Definition 1 For any ring R, an n × n elementary matrix Eij(a) over R is a matrix of the form I + a · eij where i =6 j, a ∈ R and eij is the n × n matrix whose (i, j) component is 1 and all other components are zero.
    [Show full text]
  • Work Notes on Elementary Matrices Augustin A
    r~3 HEWLETT ~r. PACKARD Work Notes on Elementary Matrices Augustin A. Dubrulle Computer Systems Laboratory HPL-93-69 July, 1993 [email protected] matrix Elementary matrices are studied in a general computations, framework where the Gauss and Householder matrix block types are particular cases. This compendium algorithms, linear includes an analysis of characteristic properties, algebra some new derivations for the representation of products, and selected applications. It is the condensation of notes useful for the development and test of matrix software, including high­ performance block algorithms. Internal Accession Date Only © Copyright Hewlett-Packard Company 1993 Work Notes on ELEMENTARY MATRICES AUGUSTIN A. DUBRULLE Hewlett-Packard Laboratories 1501 Page Mill Road Palo Alto, CA 94904 dubrulleGhpl.hp.com July 1993 ABSTRACT Elementary matrices are studied in a general framework where the Gauss and Householder types are particular cases. This compendium includes an analysis of characteristic properties, some new derivations for the representation of products, and selected applications. It is the condensation of notes useful for the development and test of matrix software, including high-performance block algorithms. 1 Introduction Elementary transformations [7, 8, 13] are the basic building blocks of nu­ merical linear algebra. The most useful transformations for the solution of linear equations and eigenvalue problems are represented by two types of elementary matrices. Householder matrices (or reflectors), which con­ stitute the first type, preserve the euclidean norm and are unconditionally stable. Gauss matrices, which make up the second type, are economical of computation, but are not generally stable. The product of a Gauss matrix and a well-chosen, data-dependent, transposition matrix (another elemen­ tary matrix) defines a transformation the instability of which is contained, and which sometimes constitutes a practical alternative to Householder re­ flections.
    [Show full text]
  • Elementary Matrices, Matrix Inverse, Determinants, More on Linear Systems
    DM559 Linear and Integer Programming Lecture 4 Elementary Matrices, Matrix Inverse, Determinants, More on Linear Systems Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Elementary Matrices Matrix Inverse Determinants Outline Cramer’s rule 1. Elementary Matrices 2. Matrix Inverse 3. Determinants 4. Cramer’s rule 2 Elementary Matrices Matrix Inverse Determinants Outline Cramer’s rule 1. Elementary Matrices 2. Matrix Inverse 3. Determinants 4. Cramer’s rule 3 Elementary Matrices Matrix Inverse Determinants Row Operations Revisited Cramer’s rule Let’s examine the process of applying the elementary row operations: 2 3 2−! 3 a11 a12 ··· a1n a 1 −! 6a21 a22 ··· a2n 7 6 a 2 7 A = 6 7 = 6 7 6 . .. 7 6 . 7 4 . 5 4 . 5 −! am1 am2 ··· amn a m −! ( a i row ith of matrix A) Then the three operations can be described as: 2 −!a 3 2−!a 3 2 −!a 3 −!1 −!2 −! 1 −! 6λ a 27 6 a 1 7 6 a 2 + λ a 17 6 7 6 7 6 7 6 . 7 6 . 7 6 . 7 4 . 5 4 . 5 4 . 5 −! −! −! a m a m a m 4 Elementary Matrices Matrix Inverse Determinants Cramer’s rule For any n × n matrices A and B: 2 3 2 3 2−! 3 a11 a12 ··· a1n b11 b12 ··· b1n a 1B −! 6a21 a22 ··· a2n7 6b21 b22 ··· b2n7 6 a 2B7 AB = 6 7 6 7 = 6 7 6 . .. 7 6 . .. 7 6 . 7 4 . 5 4 . 5 4 . 5 −! an1 an2 ··· ann bn1 bn2 ··· bnn a nB 2 −! 3 2 −! 3 2 −! 3 a 1B a 1B a 1 −! −! −! −! −! −! 6 a 2B + λ a 1B7 6( a 2 + λ a 1)B7 6 a 2 + λ a 17 6 7 = 6 7 = 6 7 B 6 .
    [Show full text]
  • Proofs Homework Set 5
    Proofs Homework Set 5 MATH 217 — WINTER 2011 Due February 9 PROBLEM 5.1. If A and B are n × n matrices which are row equivalent, prove that AC and BC are row equivalent for every n × n matrix C. We will do this in two parts. (a) Show that if A ∼ B (that is, if they are row equivalent), then EA = B for some matrix E which is a product of elementary matrices. Proof. By definition, if A ∼ B, there is some sequence of elementary row operations which, when performed on A, produce B. Further, multiplying on the left by the corresponding elementary matrix is the same as performing that row operation. So we have A ∼ E1A ∼ E2E1A ∼ · · · ∼ EpEp−1 ··· E2E1A = B Thus, if E = EpEp−1 ··· E2E1, we have EA = B. (b) Show that if EA = B for some matrix E which is a product of elementary matrices, then AC ∼ BC for every n × n matrix C. Proof. Write E = EpEp−1 ··· E2E1 where each Ei is an elementary matrix. Then AC ∼ E1AC ∼ E2E1AC ∼ · · · ∼ EpEp−1 ··· E2E1AC = EAC Since EA = B, we can multiply on the right by C to get EAC = BC. Therefore AC ∼ BC, as claimed. PROBLEM 5.2. An upper triangular matrix is a square matrix in which the entries below the 4 5 10 1 0 7 −1 1 diagonal are all zero, that is, aij = 0 whenever i > j. An example is the 4 × 4 matrix 0 0 2 0 . 0 0 0 9 Let A be a n × n upper triangular matrix with nonzero diagonal entries.
    [Show full text]
  • Chapter 3 Gaussian Elimination, LU-Factorization, and Cholesky
    Chapter 3 Gaussian Elimination, LU-Factorization, and Cholesky Factorization 3.1 Gaussian Elimination and LU-Factorization Let A be an n n matrix, let b Rn be an n-dimensional vector and assume× that A is invertible.∈ Our goal is to solve the system Ax = b.SinceA is assumed to be invertible, we know that this system has a 1 unique solution, x = A− b. Experience shows that two counter-intuitive facts are re- vealed: 171 172CHAPTER 3. GAUSSIAN ELIMINATION, LU AND CHOLESKY FACTORIZATION 1 (1) One should avoid computing the inverse, A− ,ofA explicitly. This is because this would amount to solv- (j) ing the n linear systems, Au = ej,forj =1,...,n, where ej =(0,...,1,...,0) is the jth canonical basis vector of Rn (with a 1 is the jth slot). By doing so, we would replace the resolution of a single system by the resolution of n systems, and we would 1 still have to multiply A− by b. (2) One does not solve (large) linear systems by comput- ing determinants (using Cramer’s formulae). This is because this method requires a number of ad- ditions (resp. multiplications) proportional to (n+1)! (resp. (n +2)!). The key idea on which most direct methods are based is that if A is an upper-triangular matrix,whichmeans that a =0for1 j<i n (resp. lower-triangular, ij ≤ ≤ which means that aij =0for1 i<j n), then computing the solution, x,istrivial.≤ ≤ 3.1. GAUSSIAN ELIMINATION AND LU-FACTORIZATION 173 Indeed, say A is an upper-triangular matrix a11 a12 a1 n 2 a1 n 1 a1 n ··· − − 0 a22 a2 n 2 a2 n 1 a2 n 00···..
    [Show full text]