DOCSLIB.ORG

Ubung 4.10 Check That the Inverse of L

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Ubung 4.10 Check That the Inverse of L Ubung¨ 4.10 Check that the inverse of L(k) is given by 1 .. 0 . . . .. .. . . 0 1 (L(k))−1 = . (4.7) . .. . −lk ,k . +1 . . 0 .. . . .. .. 0 ··· 0 −l 0 ··· 0 1 n,k Each step of the above Gaussian elimination process sketched in Fig. 4.2 is realized by a multiplication from the left by a matrix, in fact, the matrix (L(k))−1 (cf. (4.7)). That is, the Gaussian elimination process can be described as A = A(1) → A(2) =(L(1))−1A(1) → A(3) =(L(2))−1A(2) =(L(2))−1(L(1))−1A(1) → ... → A(n) =(L(n−1))−1A(n−1) = ... =(L(n−1))−1(L(n−2))−1 ... (L(2))−1(L(1))−1A(1) =:U upper triangular Rewriting this|{z yields,} the LU-factorization A = L(1) ··· L(n−1) U =:L The matrix L is a lower triangular matrix| as{z the product} of lower triangular matrices (cf. Exercise 4.5). In fact, due to the special structure of the matrices L(k), it is given by 1 . l .. L = 21 . . .. .. ln ··· ln,n 1 1 −1 as the following exercise shows: Ubung¨ 4.11 For each k the product L(k)L(k+1) ··· L(n−1) is given by 1 .. 0 . . . .. .. . . 0 1 L(k)L(k+1) ··· L(n−1) = . . . lk ,k 1 +1 . . l .. k+2,k+1 . . .. .. 0 ··· 0 l l ··· l 1 n,k n,k+1 n,n−1 40 Thus, we have shown that Gaussian elimination produces a factorization A = LU, (4.8) where L and U are lower and upper triangular matrices determined by Alg. 4.7. 4.3 LU-factorization In numerical practice, linear systems are solved by computing the factors L and U in (4.8) and the system is then solved with one forward and one back substitution: 1. compute L, U such that A = LU 2. solve Ly = b using forward substitution 3. solve Ux = y using back substitution Bemerkung 4.12 In matlab, the LU-factorization is realized by lu(A). In python one can use scipy.linalg.lu. As we have seen in Section 4.2.1, the LU-factorization can be computed with Gaussian elimi- nation. An alternative way of computing the factors L, U is given in the following section. 4.3.1 Crout’s algorithm for computing LU-factorization We seek L, U such that 1 u11 ··· ··· u1n a11 ··· ··· a1n .. .. l21 . . ! . = . . .. .. .. . ln ··· ln,n 1 unn an ··· ··· ann 1 −1 1 2 2 This represents n equations for n unknowns, i.e., we are looking for lij,uij, such that n ! aik = lij ujk, ∀i, k =1, . , n. j=1 X L is lower triangular, U is upper triangular =⇒ min(i,k) ! aik = lij ujk ∀i, k =1,...,n (4.9) j=1 X Idea: Traverse the n2 equations in (4.9) in following order: (“Crout ordering”)]] (1, 1) , (1, 2) ,..., (1, n) (2, 1) , (3, 1) ,..., (n, 1) (2, 2) , (2, 3) ,..., (2, n) (3, 2) , (4, 2) ,..., (n, 2) etc. 41 Procedure: 1. step: i =1, k =1,...,n in (4.9): ! l11 u1k = a1k =1 ⇒ U(1, :) can be computed |{z} 2. step: k =1, i =2,...,n in (4.9): ! li1u11 = ai1 ⇒ L([2 : n], 1) can be determined 3. step: i =2, k =2,...,n in (4.9): ! l21 u1k + l22 u2k = a2k for k =2,...,n is known is known =1 by 2. step by 1. step ⇒ can compute|{z}U(2, [2|{z} : n]) |{z} 4. step: k =2, i =3,...,n in (4.9): ! li1 u12 +li2 u22 = ai2 for i =3,...,n known by known by known by 2. step 1. step 3. step ⇒ can compute|{z}L([3|{z} : n], 2) |{z} . The procedure is formalized in the following Algorithmus 4.13 (Crout’s LU-factorization) Input: invertible matrix A ∈ Rn×n that has an LU-factorization Output: the non-trivial entries of the normalized LU-factorization for i = 1 : n do for k = i : n do i−1 uik := aik − lijujk j=1 end for P for k = i + 1 : n do i−1 lki := aki − lkjuji uii j=1 ! P . 42 end for end for Bemerkung 4.14 (cost when solving (4.1) with LU-factorization) • The LU-factorization dominates with O(n3) (more precisely: 2/3n3 + O(n2) floating point operations) the total cost, since the cost of back substitution and forward substitution are O(n2) • An advantage of an LU-factorization arises, when problems with multiple right-hand sides are considered: solving Ax = b for M right-hand sides b, requires only a single LU- 2 3 2 factorization, i.e., the cost are 3 n +2Mn In practice A is overwritten by its LU-decomposition: Algorithmus 4.15 (LU-factorization with overwriting A) Input: A, invertible, A has a LU-factorization Output: algorithm replaces aij with uij for j ≥ i and with lij for j < i for i = 1 : n do for k = i : n do i−1 aik := aik − aij ajk j=1 end for P for k =(i + 1) : n do i−1 aki := aki − akj aji aii j=1 ! end for P . end for 4.3.2 banded matrices n×n A matrix A ∈ R is a banded matrix with upper bandwidth q and lower bandwidth p if aik =0 for all i, k with i>k + p or k > i + q. The following theorem shows that banded matrices are of interest if p and q are small (compared to n): Satz 4.16 Let A ∈ Rn×n be a banded matrix with upper bandwidth q and lower bandwidth p. Let A be invertible and admit an LU-factorization. Then: (i) L has lower bandwidth p and U has upper bandwidth q. (ii) Cost to solve Ax = b: 43 a11 ··· a1,q+1 . .. .. . .. .. ap+1,1 . . .. .. .. . .. .. a n−q,n . .. .. a ··· a n,n−p nn Abbildung 4.3: banded matrix with upper bandwidth q and lower bandwidth p. (a) O(npq) floating point operations (flops) to determine LU-factorization (b) O(np) flops to solve Ly = b (c) O(nq) flops to solve Ux = y Beweis: (Exercise) Prove (i) for the special case of a tridiagonal matrix, i.e., p = q = 1. To that end, proceed by induction on the matrix size n: • n =1 X • for the induction step n → n+1 make the ansatz 0 . . . ! Ln 0 Un u A = An . = 0 l⊤ 1 0 ρ an,n +1 0 ··· ··· 0 a a n+1,n n+1,n+1 ⊤ and compute l , u, and ρ. Use the structure of Ln, Un given by the induction hypothesis. ✷ Folie 24 4.3.3 Cholesky-factorization A particularly important class of matrices A is that of symmetric positive definite (SPD) matrices: • A is symmetric, i.e., Aij = Aji for all i, j • A is positive definite, i.e., x⊤Ax > 0 for all x =6 0. Bemerkung 4.17 An alternative criterion for positive definiteness of a symmetric matrix is that all its eigenvalue are positive. 44 For SPD matrices, one typically employs a variant of the LU-factorization, namely, the Cholesky- factorization, i.e., A = CC⊤, (4.10) where the Cholesky factor C is lower triangular (but not normalized, i.e., the entries Cii are not necessarily 1). Ubung¨ 4.18 Formulate an algorithm to compute C. Hint: Proceed as in Crout’s method for the LU-factorization. Bemerkung 4.19 If an SPD matrix A is banded with bandwidth p = q, then the Cholesky factor C is also banded with the same bandwidth. Bemerkung 4.20 The cost of a Cholesky factorization (of either a full matrix or a banded matrix) is about half of that of the corresponding LU-factorization since only half the entries need to be computed. Bemerkung 4.21 A Cholesky factorization is computed in matlab with chol. Folie 25 4.3.4 skyline matrices Folie 26 Banded matrices are a particular case of sparse matrices, i.e., matrices with “few” non-zero entries. We note that the LU-factors have the same sparsity pattern, i.e., the zeros of A outside the band are inherited by the factors L, U. Another important special case of sparse matrices are so-called skyline matrices as depicted on the left side of Fig. 4.4. More formally, a matrix A ∈ Rn×n is called a skyline matrix, if for i =1,...,n there are numbers pi, qi ∈ N0 such that aij = 0 if j < i − pi or i < j − qj. (4.11) We have without proof: n×n Satz 4.22 Let A ∈ R be a skyline matrix, i.e., there are pi, qi with (4.11). Let A have an LU-factorization A = LU. Then the matrices L, U satisfy: lij =0 for j < i − pi, uij =0 for i < j − qj. Theorem 4.22 states that the factors L and U have the same sparsity pattern as A. Figure 4.5 illustrates this for a simple example. Obviously, this can be exploited algorithmically to econo- mize on memory requirement and computing time by simply computing the non-zero entries of L and U. Note that the matrices in Fig. 4.4 should not be treated as banded matrices as then the bands p, q would be n. The right example in Fig. 4.4 is not a skyline matrix, and the sparsity pattern of A is lost in the course of the LU-factorization: L ist in general a fully populated lower triangular matrix and U a fully populated upper triangular matrix.
Load more

Recommended publications
  • November 1960 Table of Contents
    AMERICAN MATHEMATICAL SOCIETY VOLUME 7, NUMBER 6 ISSUE NO. 49 NOVEMBER 1960 AMERICAN MATHEMATICAL SOCIETY Nottces Edited by GORDON L. WALKER Contents MEETINGS Calendar of Meetings ••••••••••.••••••••••••.••• 660 Program of the November Meeting in Nashville, Tennessee . 661 Abstracts for Meeting on Pages 721-732 Program of the November Meeting in Pasadena, California • 666 Abstracts for Meeting on Pages 733-746 Program of the November Meeting in Evanston, Illinois . • • 672 Abstracts for Meeting on Pages 747-760 PRELIMINARY ANNOUNCEMENT OF MEETINGS •.•.••••• 677 NEWS AND COMMENT FROM THE CONFERENCE BOARD OF THE MATHEMATICAL SCIENCES ••••••••••••.••• 680 FROM THE AMS SECRETARY •...•••.••••••••.•••.• 682 NEWS ITEMS AND ANNOUNCEMENTS .•••••.•••••••••• 683 FEATURE ARTICLES The Sino-American Conference on Intellectual Cooperation .• 689 National Academy of Sciences -National Research Council .• 693 International Congress of Applied Mechanics ..••••••••. 700 PERSONAL ITEMS ••.•.••.•••••••••••••••••••••• 702 LETTERS TO THE EDITOR.. • • • • • • • . • . • . 710 MEMORANDA TO MEMBERS The Employment Register . • . • • . • • • • • . • • • • 712 Employment of Retired Mathematicians ••••••.••••..• 712 Abstracts of Papers by Title • • . • . • • • . • . • • . • . • • . • 713 Reciprocity Agreement with the Societe Mathematique de Belgique .••.•••.••.••.•.•••••..•••••.•. 713 NEW PUBLICATIONS ..•..•••••••••.•••.•••••••••• 714 ABSTRACTS OF CONTRIBUTED PAPERS •.•••••••.••..• 715 RESERVATION FORM .•...•.•.•••••.••••..•••...• 767 MEETINGS CALENDAR OF MEETINGS Note: This Calendar lists all of the meetings which have been approved by the Council up to the date at which this issue of the NOTICES was sent to press. The summer and annual meetings are joint meetings of the Mathematical Asso­ ciation of America and the American Mathematical Society. The meeting dates which fall rather far in the future are subject to change. This is particularly true of the meetings to which no numbers have yet been assigned. Meet­ Deadline ing Date Place for No.
    [Show full text]
  • REPORTS in INFORMATICS Department of Informatics
    REPORTS IN INFORMATICS ISSN 0333-3590 Sparsity in Higher Order Methods in Optimization Geir Gundersen and Trond Steihaug REPORT NO 327 June 2006 Department of Informatics UNIVERSITY OF BERGEN Bergen, Norway This report has URL http://www.ii.uib.no/publikasjoner/texrap/ps/2006-327.ps Reports in Informatics from Department of Informatics, University of Bergen, Norway, is available at http://www.ii.uib.no/publikasjoner/texrap/. Requests for paper copies of this report can be sent to: Department of Informatics, University of Bergen, Høyteknologisenteret, P.O. Box 7800, N-5020 Bergen, Norway Sparsity in Higher Order Methods in Optimization Geir Gundersen and Trond Steihaug Department of Informatics University of Bergen Norway fgeirg,[email protected] 29th June 2006 Abstract In this paper it is shown that when the sparsity structure of the problem is utilized higher order methods are competitive to second order methods (Newton), for solving unconstrained optimization problems when the objective function is three times continuously differentiable. It is also shown how to arrange the computations of the higher derivatives. 1 Introduction The use of higher order methods using exact derivatives in unconstrained optimization have not been considered practical from a computational point of view. We will show when the sparsity structure of the problem is utilized higher order methods are competitive compared to second order methods (Newton). The sparsity structure of the tensor is induced by the sparsity structure of the Hessian matrix. This is utilized to make efficient algorithms for Hessian matrices with a skyline structure. We show that classical third order methods, i.e Halley's, Chebyshev's and Super Halley's method, can all be regarded as two step Newton like methods.
    [Show full text]
  • Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods1
    Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods1 Richard Barrett2, Michael Berry3, Tony F. Chan4, James Demmel5, June M. Donato6, Jack Dongarra3,2, Victor Eijkhout7, Roldan Pozo8, Charles Romine9, and Henk Van der Vorst10 This document is the electronic version of the 2nd edition of the Templates book, which is available for purchase from the Society for Industrial and Applied Mathematics (http://www.siam.org/books). 1This work was supported in part by DARPA and ARO under contract number DAAL03-91-C-0047, the National Science Foundation Science and Technology Center Cooperative Agreement No. CCR-8809615, the Applied Mathematical Sciences subprogram of the Office of Energy Research, U.S. Department of Energy, under Contract DE-AC05-84OR21400, and the Stichting Nationale Computer Faciliteit (NCF) by Grant CRG 92.03. 2Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN 37830- 6173. 3Department of Computer Science, University of Tennessee, Knoxville, TN 37996. 4Applied Mathematics Department, University of California, Los Angeles, CA 90024-1555. 5Computer Science Division and Mathematics Department, University of California, Berkeley, CA 94720. 6Science Applications International Corporation, Oak Ridge, TN 37831 7Texas Advanced Computing Center, The University of Texas at Austin, Austin, TX 78758 8National Institute of Standards and Technology, Gaithersburg, MD 9Office of Science and Technology Policy, Executive Office of the President 10Department of Mathematics, Utrecht University, Utrecht, the Netherlands. ii How to Use This Book We have divided this book into five main chapters. Chapter 1 gives the motivation for this book and the use of templates. Chapter 2 describes stationary and nonstationary iterative methods.
    [Show full text]
  • The Astrometric Core Solution for the Gaia Mission Overview of Models, Algorithms and Software Implementation
    Astronomy & Astrophysics manuscript no. aa17905-11 c ESO 2018 October 30, 2018 The astrometric core solution for the Gaia mission Overview of models, algorithms and software implementation L. Lindegren1, U. Lammers2, D. Hobbs1, W. O’Mullane2, U. Bastian3, and J. Hernandez´ 2 1 Lund Observatory, Lund University, Box 43, SE-22100 Lund, Sweden e-mail: Lennart.Lindegren, [email protected] 2 European Space Agency (ESA), European Space Astronomy Centre (ESAC), P.O. Box (Apdo. de Correos) 78, ES-28691 Villanueva de la Canada,˜ Madrid, Spain e-mail: Uwe.Lammers, William.OMullane, [email protected] 3 Astronomisches Rechen-Institut, Zentrum fur¨ Astronomie der Universitat¨ Heidelberg, Monchhofstr.¨ 12–14, DE-69120 Heidelberg, Germany e-mail: [email protected] Received 17 August 2011 / Accepted 25 November 2011 ABSTRACT Context. The Gaia satellite will observe about one billion stars and other point-like sources. The astrometric core solution will determine the astrometric parameters (position, parallax, and proper motion) for a subset of these sources, using a global solution approach which must also include a large number of parameters for the satellite attitude and optical instrument. The accurate and efficient implementation of this solution is an extremely demanding task, but crucial for the outcome of the mission. Aims. We aim to provide a comprehensive overview of the mathematical and physical models applicable to this solution, as well as its numerical and algorithmic framework. Methods. The astrometric core solution is a simultaneous least-squares estimation of about half a billion parameters, including the astrometric parameters for some 100 million well-behaved so-called primary sources.
    [Show full text]
  • Object Oriented Design Philosophy for Scientific Computing
    Mathematical Modelling and Numerical Analysis ESAIM: M2AN Mod´elisation Math´ematique et Analyse Num´erique M2AN, Vol. 36, No 5, 2002, pp. 793–807 DOI: 10.1051/m2an:2002041 OBJECT ORIENTED DESIGN PHILOSOPHY FOR SCIENTIFIC COMPUTING Philippe R.B. Devloo1 and Gustavo C. Longhin1 Abstract. This contribution gives an overview of current research in applying object oriented pro- gramming to scientific computing at the computational mechanics laboratory (LABMEC) at the school of civil engineering – UNICAMP. The main goal of applying object oriented programming to scien- tific computing is to implement increasingly complex algorithms in a structured manner and to hide the complexity behind a simple user interface. The following areas are current topics of research and documented within the paper: hp-adaptive finite elements in one-, two- and three dimensions with the development of automatic refinement strategies, multigrid methods applied to adaptively refined finite element solution spaces and parallel computing. Mathematics Subject Classification. 65M60, 65G20, 65M55, 65Y99, 65Y05. Received: 3 December, 2001. 1. Introduction Finite element programming has been a craft since the decade of 1960. Ever since, finite element programs are considered complex, especially when compared to their rival numerical approximation technique, the finite difference method. Essential elements of complexity of the finite element method are: • Meshes are generally unstructured, leading to the necessity of node renumbering schemes and complex sparcity structures of the tangent
    [Show full text]
  • Mathematical Methods for Physicists: a Concise Introduction
    Mathematical Methods for Physicists: A concise introduction TAI L. CHOW CAMBRIDGE UNIVERSITY PRESS Mathematical Methods for Physicists A concise introduction This text is designed for an intermediate-level, two-semester undergraduate course in mathematical physics. It provides an accessible account of most of the current, important mathematical tools required in physics these days. It is assumed that the reader has an adequate preparation in general physics and calculus. The book bridges the gap between an introductory physics course and more advanced courses in classical mechanics, electricity and magnetism, quantum mechanics, and thermal and statistical physics. The text contains a large number of worked examples to illustrate the mathematical techniques developed and to show their relevance to physics. The book is designed primarily for undergraduate physics majors, but could also be used by students in other subjects, such as engineering, astronomy and mathematics. TAI L. CHOW was born and raised in China. He received a BS degree in physics from the National Taiwan University, a Masters degree in physics from Case Western Reserve University, and a PhD in physics from the University of Rochester. Since 1969, Dr Chow has been in the Department of Physics at California State University, Stanislaus, and served as department chairman for 17 years, until 1992. He served as Visiting Professor of Physics at University of California (at Davis and Berkeley) during his sabbatical years. He also worked as Summer Faculty Research Fellow at Stanford University and at NASA. Dr Chow has published more than 35 articles in physics journals and is the author of two textbooks and a solutions manual.
    [Show full text]
  • SDT 5.2 Manual
    Structural Dynamics Toolbox FEMLink For Use with MATLAB r User’s Guide Etienne Balm`es Version 5.2 Jean-Michel Lecl`ere How to Contact SDTools 33 +1 41 13 13 57 Phone 33 +6 77 17 29 99 Fax SDTools Mail 44 rue Vergniaud 75013 Paris (France) http://www.sdtools.com Web comp.soft-sys.matlab Newsgroup http://www.openfem.net An Open-Source Finite Element Toolbox [email protected] Technical support [email protected] Product enhancement suggestions [email protected] Sales, pricing, and general information Structural Dynamics Toolbox User’s Guide on May 27, 2005 c Copyright 1991-2005 by SDTools The software described in this document is furnished under a license agreement. The software may be used or copied only under the terms of the license agreement. No part of this manual in its paper, PDF and HTML versions may be copied, printed, photocopied or reproduced in any form without prior written consent from SDTools. Structural Dynamics Toolbox is a registered trademark of SDTools OpenFEM is a registered trademark of INRIA and SDTools MATLAB is a registered trademark of The MathWorks, Inc. Other products or brand names are trademarks or registered trademarks of their respective holders. Contents 1 Preface 9 1.1 Getting started . 10 1.2 Understanding the Toolbox architecture . 12 1.2.1 Layers of code . 12 1.2.2 Global variables . 13 1.3 Typesetting conventions and scientific notations . 14 1.4 Release notes for SDT 5.2 and FEMLink 3.1 . 17 1.4.1 Key features . 17 1.4.2 Detail by function .
    [Show full text]
  • Finite Element Analysis of Emi in a Multi-Conductor Connector
    FINITE ELEMENT ANALYSIS OF EMI IN A MULTI-CONDUCTOR CONNECTOR A Thesis Presented to The Graduate Faculty of The University of Akron In Partial Fulfillment of the Requirements for the Degree Master of Science Mohammed Zafaruddin May, 2013 FINITE ELEMENT ANALYSIS OF EMI IN A MULTI-CONDUCTOR CONNECTOR Mohammed Zafaruddin Thesis Approved: Accepted: _______________________________ _______________________________ Advisor Department Chair Dr. Nathan Ida Dr. Jose Alexis De Abreu Garcia _______________________________ _______________________________ Committee Member Dean of the College Dr. George C. Giakos Dr. George K. Haritos _______________________________ _______________________________ Committee Member Dean of the Graduate School Dr. Hamid Bahrami Dr. George R. Newkome _______________________________ Date ii ABSTRACT This thesis discusses the numerical analysis of electrical multi-conductor connectors intended for operation at high frequencies. The analysis is based on a Finite Element Tool and looks at the effect of conductors on each other with a view to design for electromagnetic compatibility of connectors. When there is an electrically excited conductor in a medium, it acts as an antenna at high frequencies and radiates electromagnetic power. If there are any conductors in its vicinity they too act as antennas and receive a part of the EM power. Electromagnetic Interference (EMI) from nearby excited conductors causes induced currents, according to Faraday‘s law, which is considered as noise for other conductors. This noise is affected by factors such as distance between the conductors, strength and frequency of currents, permittivity, permeability and conductivity of the medium between the conductors. To reduce the effects of EMI in a shielded multi-conductor connector, values of induced currents at various distances between the conductors have been calculated and analyzed.
    [Show full text]
  • Aladdin : a Computational Toolkit for Interactive Engineering Matrix And
    ALADDIN A COMPUTATIONAL TOOLKIT FOR INTERACTIVE ENGINEERING MATRIX AND FINITE ELEMENT ANALYSIS Mark Austin Xiaoguang Chen and WaneJang Lin Institute for Systems Research and Department of Civil Engineering University of Maryland College Park MD Novemb er Abstract This rep ort describ es Version of ALADDIN an interactive computational to olkit for the matrix and nite element analysis of engineering systems The ALADDIN package is designed around a language sp ecication that includes quantities with physical units branching constructs and lo oping constructs The basic language functionality is enhanced with external libraries of matrix and nite element functions ALADDINs problem solving capabilities are demonstrated via the solution to a series of matrix and numerical analysis problems ALADDIN is employed in the nite element analysis of two building structures and two highway bridge structures Contents I INTRODUCTION TO ALADDIN Intro duction to ALADDIN Problem Statement ALADDIN Comp onents Scop e of this Rep ort II MATRIX LIBRARY Command Language for Quantity and Matrix Op erations How to Start and Stop ALADDIN Format of General Command Language Physical Quantities Denition and Printing of Quantities Formatting of Quantity Output Quantity Arithmetic Making a Quantity Dimensionless
    [Show full text]
  • 4 Gaussian Elimination 4.1 Lower and Upper Triangular Matrices
    ∗ ∗∗∗∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗∗∗∗ ∗ Figure 4.1: schematic representation of lower (left) and upper (right) matrices (n = 4); blank spaces represent a 0 4 Gaussian elimination goal: solve, for given A ∈ Rn×n and b ∈ Rn, the linear system of equations Ax = b. (4.1) In the sequel, we will often denote the entries of matrices by lower case letters, e.g., the entries of A are (A)ij = aij. Likewise for vectors, we sometimes write xi = xi. Remark 4.1 In matlab, the solution of (4.1) is realized by x = A\b. In python, the function numpy.linalg.solve performs this. In both cases, a routine from lapack1 realizes the actual computation. The matlab realization of the backslash operator \ is in fact very complex. A very good discussion of many aspects of the realization of \ can be found in [1]. 4.1 lower and upper triangular matrices A matrix A ∈ Rn×n is • an upper triangular matrix if Aij = 0 for j < i; • a lower triangular matrix if Aij = 0 for j > i. • a normalized lower triangular matrix if, in addition to being lower triangular, it satisfies Aii = 1 for i =1,...,n. Linear systems where A is a lower or upper triangular matrix are easily solved by “forward substitution” or “back substitution”: Algorithm 4.2 (solve Lx = b using forward substitution) Input: L ∈ Rn×n lower triangular, invertible, b ∈ Rn Output: solution x ∈ Rn of Lx = b for j = 1:n do j−1 xj := bj − ljkxk ljj J convention: empty sum = 0 K k=1 end for P . 1linear algebra package, see en.wikipedia.org/wiki/LAPACK 49 Algorithm 4.3 (solution of Ux = b using back substitution) Input: U ∈ Rn×n upper triangular, invertible, b ∈ Rn Output: solution x ∈ Rn of Ux = b for j = n:-1:1 do n xj := bj − ujkxk ujj k=j+1 ! end for P .
    [Show full text]
  • Stiffness Matrix for a Bar Element
    CIVL 7/8117 Chapter 3 - Truss Equations - Part 2 1/44 Chapter 3b – Development of Truss Equations Learning Objectives • To derive the stiffness matrix for a bar element. • To illustrate how to solve a bar assemblage by the direct stiffness method. • To introduce guidelines for selecting displacement functions. • To describe the concept of transformation of vectors in two different coordinate systems in the plane. • To derive the stiffness matrix for a bar arbitrarily oriented in the plane. • To demonstrate how to compute stress for a bar in the plane. • To show how to solve a plane truss problem. • To develop the transformation matrix in three- dimensional space and show how to use it to derive the stiffness matrix for a bar arbitrarily oriented in space. • To demonstrate the solution of space trusses. Stiffness Matrix for a Bar Element Inclined, or Skewed Supports If a support is inclined, or skewed, at some angle for the global x axis, as shown below, the boundary conditions on the displacements are not in the global x-y directions but in the x’-y’ directions. CIVL 7/8117 Chapter 3 - Truss Equations - Part 2 2/44 Stiffness Matrix for a Bar Element Inclined, or Skewed, Supports We must transform the local boundary condition of v’3 = 0 (in local coordinates) into the global x-y system. Stiffness Matrix for a Bar Element Inclined, or Skewed, Supports Therefore, the relationship between of the components of the displacement in the local and the global coordinate systems at node 3 is: uu'33cos sin vv'33sin cos We can rewrite the above expression as: cos sin t dtd'[]333 3 sin cos We can apply this sort of transformation to the entire displacement vector as: T dTdordTd'[] 11 []' CIVL 7/8117 Chapter 3 - Truss Equations - Part 2 3/44 Stiffness Matrix for a Bar Element Inclined, or Skewed, Supports T Where the matrix [T1] is: []I [0] [0] []TIT [0][][0] 1 [0] [0] [t3 ] Both the identity matrix [I] and the matrix [t3] are 2 x 2 matrices.
    [Show full text]
  • Linear Algebra Libraries Claire Mouton
    Linear Algebra Libraries Claire Mouton To cite this version: Claire Mouton. Linear Algebra Libraries. [Technical Report] 2009, pp.35. inria-00576469 HAL Id: inria-00576469 https://hal.inria.fr/inria-00576469 Submitted on 15 Mar 2011 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Linear Algebra Libraries Claire Mouton [email protected] March 2009 Contents I Requirements 3 II CPPLapack 4 III Eigen 5 IV Flens 6 V Gmm++ 7 VI GNU Scientific Library (GSL) 8 VII IT++ 9 VIII Lapack++ 10 IX Matrix Template Library (MTL) 11 X PETSc 13 XI Seldon 14 XII SparseLib++ 15 XIII Template Numerical Toolkit (TNT) 16 XIV Trilinos 17 XV uBlas 19 1 XVI Other Libraries 20 XVII Links and Benchmarks 22 1 Links 22 2 Benchmarks 22 2.1 Benchmarks for Linear Algebra Libraries . ...... 22 2.2 BenchmarksincludingSeldon . 23 2.2.1 BenchmarksforDenseMatrix. 23 2.2.2 BenchmarksforSparseMatrix . 26 XVIII Appendix 27 3 Flens Overloaded Operator Performance Compared to Seldon 27 4 Flens, Seldon and Trilinos Content Comparisons 29 4.1 Available Matrix Types from Blas (Flens and Seldon) . ....... 29 4.2 Available Interfaces to Blas and Lapack Routines (Flens and Seldon) .
    [Show full text]