Part B. Linear Algebra, Vector Calculus Chap. 6

Total Page:16

File Type:pdf, Size:1020Kb

Part B. Linear Algebra, Vector Calculus Chap. 6 Part B. Linear Algebra, Vector Calculus Chap. 6: Linear Algebra; Matrices, Vectors, Determinants, Linear Systems of Equations - Theory and application of linear systems of equations, linear transformations, and eigenvalue problems. - Vectors, matrices, determinants, … 6.1. Basic concepts - Basic concepts and rules of matrix and vector algebra - Matrix: rectangular array of numbers (or functions) elements or entries Reference: “Matrix Computations” by G.H. Golub, C.F. Van Loan (1996) column Ex. 1) 5x – 2y + z = 0 3x + 4z = 0 2 0.4 8 row − 5 − 32 0 Coefficient matrix: 5 2 1 3 0 4 Ch. 6: Linear Algebra 화공수학 = + + + = f1(x1,x 2 ,...,x n ) 0 a11x1 a12x 2 a1n x n b1 = + + + = f2 (x1,x 2 ,...,x n ) 0 a 21x1 a 22x 2 a 2n x n b2 = + + + = fn (x1,x 2 ,...,x n ) 0 a n1x1 a n2x 2 a nn x n bn a11 a12 a1n x1 b1 a a a x b 21 22 2n 2 = 2 Ax = b a n1 a n2 a nn x n bn m x n matrix General Notations and Concepts m = n: square matrix aii: principal or main diagonal Matrix : A, B a11 a12 a1n of the matrix. a a a Vector : a, b = []= 21 22 2n (important for simultaneous A a jk linear equations) Row (Eqn.) a m1 a m2 a mn A or a - rectangular matrix that is not ij square Column (Variable) Ch. 6: Linear Algebra 화공수학 Vectors b1 Row vector: b = []b ,...,b T = 1 m b Transpose b Column vector: m c1 = c cm Transposition A (m × n) AT (n × m) T = T = Symmetric matrices: A A (aij aij ) a11 a 21 a m1 T T a a a Skew-symmetric matrices: A = −A (a = −a ) T = []= 12 22 m2 ij ij A a kj Square matrices a1n a 2n a mn Properties of transpose: T ()AT = A, ()A + B T = AT + BT , ()AB T = BT AT , ()kA T = kAT , ()ABC T = CT BT AT Ch. 6: Linear Algebra 화공수학 = ( = ) Equalities of Matrices: A B aij bij same size = + ( = + ) Matrix Addition: C A B cij aij bij same size Scalar Multiplication: (−k)A = −kA A + B = B + A c(A + B)= cA + cB ()U + V + W = U + ()V + W ()c + k A = cA + kA A + 0 = A c()kA = ()ck A A + ()− A = 0 6.2. Matrix Multiplication - Multiplication of matrices by matrices m A B = C C = a b n×m m×l n×l ij ik kj k=1 (number of columns of 1st factor A = number of rows of 2nd factor B) Ch. 6: Linear Algebra 화공수학 Difference from Multiplication of Numbers - Matrix multiplication is not commutative in general: AB ≠ BA -AB = 0 does not necessarily imply A = 0 or B = 0 or BA = 0 -AC = AD does not necessarily imply C = D (even when A=0) (kA)B = k (AB)= A (kB) A ()BC = ()AB C ()A + B C = AC + BC Special Matrices Upper triangular matrix Lower triangular matrix Banded matrix Results of finite a a 0 difference solutions a11 a12 a1n a11 0 0 11 12 0 a a a a 0 a a 0 for PDE or ODE. 22 2n 21 22 21 22 a a a 0 0 a (especially, 0 0 amn m1 m2 mn mn tridiagonal) Matrix can be decomposed into Lower & Upper triangular matrices LU decomposition Ch. 6: Linear Algebra 화공수학 Special Matrices: ≠ = ≠ a ii 0, a ij 0 (i j) Diagonal matrix = = = ≠ aij a ji Symmetric matrix, I or Iii 1 (Iij 0, i j) Identity (or unit) matrix Inner Product of Vectors b1 b n a ⋅ b = []a a a 2 = a b 1 2 n k k k=1 bn A B = C Product in Terms of Row and Column Vectors: m×n n×p m×p = ⋅ c jk a j bk (jth first row of A).(kth first column of B) ⋅ ⋅ ⋅ a1 b1 a1 b2 a1 bp ⋅ ⋅ ⋅ a 2 b1 a 2 b2 a 2 bp AB = ⋅ ⋅ ⋅ a m b1 a m b2 a m bp Ch. 6: Linear Algebra 화공수학 Linear Transformations y = Ax, x = Bw y = ABw = Cw 6.3. Linear Systems of Equations: Gauss Elimination - The most important practical use of matrices: the solution of linear systems of equations Linear System, Coefficient Matrix, Augmented Matrix a x + a x + + a x = b 11 1 12 2 1n n 1 a11 a12 a1n x1 b1 + + + = a 21x1 a 22x 2 a 2n x n b2 a a a x b 21 22 2n 2 = 2 a x + a x + + a x = b m1 1 m2 2 mn n m a m1 a m2 a mn x n bm Ax = b b = 0: homogeneous system (this has at least one solution, i.e., x = 0) b ≠ 0: nonhomogeneous system a11 a12 a1n b1 a a a b Augmented matrix 21 22 2n 2 a m1 a m2 a mn bm Ch. 6: Linear Algebra 화공수학 Ex. 1) Geometric interpretation: Existence of solutions x2 Precisely one solution x1 Same slope Infinite solutions Very close to singular Different intercept ill-conditioned No solution - difficult to identify the solution - extremely sensitive to round-off error Singular Ch. 6: Linear Algebra 화공수학 Gauss Elimination - Standard method for solving linear systems - The elimination of unknowns can be extended to large sets of equations. (Forward elimination of unknowns & solution through back substitution) 1 a'12 a'13 a'14 x1 b'1 1 a'12 a'13 a'14 x1 b'1 a a a a x b 0 a' a' a' x b' 21 22 23 24 2 = 2 22 23 24 2 = 2 − − − − − − − − x3 b3 x3 b3 − − − − a41 a44 x4 b4 a41 a44 x4 b4 During this operations the first row: pivot row (a11: pivot element) And then second row becomes pivot row: a’22 pivot element 1 a'12 a'13 a'14 x1 b'1 = + = → = − x4 b'4 , x3 a'34 x4 b'3 x3 b'3 a'34 x4 0 1 a' a' x b' 23 24 2 = 2 N − x = b' − a' x 0 1 a'34 x3 b'3 i i ij j = + − − j i 1 0 1 x4 b'4 Repeat back substitution, moving upward Upper triangular form Ch. 6: Linear Algebra 화공수학 Elementary Row Operation: Row-Equivalent Systems - Interchange of two rows - Addition of a constant multiple of one row to another row - Multiplication of a row by a nonzero constant c Overdetermined: equations > unknowns Determined: equations = unknowns Underdetermined: equations < unknowns Consistent: system has at least one solution. Inconsistent: system has no solutions at all. = A(x + x )= Ax + Ax = 0 + b = b Homogeneous solution: xh Ax 0 h p h p = Nonhomogeneous solution: xp Ax b xp+xh is also a solutions of the nonhomogeneous systems Homogeneous systems: always consistent (why? trivial solution exists, x=0) Theorem: A homogeneous system possess nontrivial solutions if the number of m of equations is less than the number of n of unknowns (m < n) Ch. 6: Linear Algebra 화공수학 Echelon Form: Information Resulting from It 3 2 1 3 2 1 3 − − − 0 1/3 1/3 and 0 1/3 1/3 2 0 0 0 0 0 0 12 + + + = a11x1 a12x 2 a1n x n b1 (a) No solution: if r < m and one of the numbers + + = * c22x 2 c2n x n b2 ~ ~ br+1,..., bm is not zero. (b) Precisely one solution: if r=n and + + = ~ crr x r crn x n br ~ ~ ~ br+1,..., bm , if present, are zero. 0 = b + r 1 (c) Infinitely many solutions: if r < n and ~ ~ b ,..., b , if present, are zero. = ~ r+1 m 0 bm Existence and uniqueness of the solutions Next issue Ch. 6: Linear Algebra 화공수학 Gauss-Jordan elimination: particularly well suited to digital computation 1 a'12 a'13 a'14 x1 b'1 0 1 a' a' x b' 23 24 2 = 2 Multiplying the second row by a’12 and − subtracting the second row from the first 0 1 a'34 x3 b'3 − − 0 1 x4 b'4 1 0 a'' a'' x b'' 1 0 0 0 x b'' = 13 14 1 1 1 1 x1 b''1 0 1 a' a' x b' 0 1 0 0 x b'' = 23 24 2 = 2 2 = 2 x2 b''2 − 0 1 a'34 x3 b'3 0 0 1 0 x3 b''3 x = b'' 3 3 0 − − 1 x b' 0 0 0 1 x b'' = 4 4 4 4 x4 b''4 - The most efficient approach is to eliminate all elements both above and below the pivot element in order to clear to zero the entire column containing the pivot element, except of course for the 1 in the pivot position on the main diagonal. Ch. 6: Linear Algebra 화공수학 LU-Decomposition Gauss elimination: - Forward elimination + back-substitution (computation effort ↑) - Inefficient when solving equations with the same coefficient A, but with different rhs constants B LU Decomposition: - Well suited for those situations where many rhs B must be evaluated for a single value of A Elimination step can be formulated so that it involves only operations on the matrix of coefficient A. - Provides an efficient means to compute the matrix inverse. (1) LU Decomposition Ax = B - LU decomposition separates the time-consuming elimination of A from the manipulations of rhs B. once A has been “decomposed”, multiple rhs vectors can be evaluated effectively. • Overview of LU Decomposition Ax − B = 0 -Upper triangular form: u u u x d 11 12 13 1 1 = Ux − D = 0 0 u 22 u 23 x 2 d2 0 0 u33 x3 d3 1 0 0 = - Assume lower diagonal matrix with 1’s on the diagonal: L l21 1 0 l31 l32 1 Ch.
Recommended publications
  • Final Exam Outline 1.1, 1.2 Scalars and Vectors in R N. the Magnitude
    Final Exam Outline 1.1, 1.2 Scalars and vectors in Rn. The magnitude of a vector. Row and column vectors. Vector addition. Scalar multiplication. The zero vector. Vector subtraction. Distance in Rn. Unit vectors. Linear combinations. The dot product. The angle between two vectors. Orthogonality. The CBS and triangle inequalities. Theorem 1.5. 2.1, 2.2 Systems of linear equations. Consistent and inconsistent systems. The coefficient and augmented matrices. Elementary row operations. The echelon form of a matrix. Gaussian elimination. Equivalent matrices. The reduced row echelon form. Gauss-Jordan elimination. Leading and free variables. The rank of a matrix. The rank theorem. Homogeneous systems. Theorem 2.2. 2.3 The span of a set of vectors. Linear dependence. Linear dependence and independence. Determining n whether a set {~v1, . ,~vk} of vectors in R is linearly dependent or independent. 3.1, 3.2 Matrix operations. Scalar multiplication, matrix addition, matrix multiplication. The zero and identity matrices. Partitioned matrices. The outer product form. The standard unit vectors. The transpose of a matrix. A system of linear equations in matrix form. Algebraic properties of the transpose. 3.3 The inverse of a matrix. Invertible (nonsingular) matrices. The uniqueness of the solution to Ax = b when A is invertible. The inverse of a nonsingular 2 × 2 matrix. Elementary matrices and EROs. Equivalent conditions for invertibility. Using Gauss-Jordan elimination to invert a nonsingular matrix. Theorems 3.7, 3.9. n n n 3.5 Subspaces of R . {0} and R as subspaces of R . The subspace span(v1,..., vk). The the row, column and null spaces of a matrix.
    [Show full text]
  • Introduction to MATLAB®
    Introduction to MATLAB® Lecture 2: Vectors and Matrices Introduction to MATLAB® Lecture 2: Vectors and Matrices 1 / 25 Vectors and Matrices Vectors and Matrices Vectors and matrices are used to store values of the same type A vector can be either column vector or a row vector. Matrices can be visualized as a table of values with dimensions r × c (r is the number of rows and c is the number of columns). Introduction to MATLAB® Lecture 2: Vectors and Matrices 2 / 25 Vectors and Matrices Creating row vectors Place the values that you want in the vector in square brackets separated by either spaces or commas. e.g 1 >> row vec=[1 2 3 4 5] 2 row vec = 3 1 2 3 4 5 4 5 >> row vec=[1,2,3,4,5] 6 row vec= 7 1 2 3 4 5 Introduction to MATLAB® Lecture 2: Vectors and Matrices 3 / 25 Vectors and Matrices Creating row vectors - colon operator If the values of the vectors are regularly spaced, the colon operator can be used to iterate through these values. (first:last) produces a vector with all integer entries from first to last e.g. 1 2 >> row vec = 1:5 3 row vec = 4 1 2 3 4 5 Introduction to MATLAB® Lecture 2: Vectors and Matrices 4 / 25 Vectors and Matrices Creating row vectors - colon operator A step value can also be specified with another colon in the form (first:step:last) 1 2 >>odd vec = 1:2:9 3 odd vec = 4 1 3 5 7 9 Introduction to MATLAB® Lecture 2: Vectors and Matrices 5 / 25 Vectors and Matrices Exercise In using (first:step:last), what happens if adding the step value would go beyond the range specified by last? e.g: 1 >>v = 1:2:6 Introduction to MATLAB® Lecture 2: Vectors and Matrices 6 / 25 Vectors and Matrices Exercise Use (first:step:last) to generate the vector v1 = [9 7 5 3 1 ]? Introduction to MATLAB® Lecture 2: Vectors and Matrices 7 / 25 Vectors and Matrices Creating row vectors - linspace function linspace (Linearly spaced vector) 1 >>linspace(x,y,n) linspace creates a row vector with n values in the inclusive range from x to y.
    [Show full text]
  • Math 102 -- Linear Algebra I -- Study Guide
    Math 102 Linear Algebra I Stefan Martynkiw These notes are adapted from lecture notes taught by Dr.Alan Thompson and from “Elementary Linear Algebra: 10th Edition” :Howard Anton. Picture above sourced from (http://i.imgur.com/RgmnA.gif) 1/52 Table of Contents Chapter 3 – Euclidean Vector Spaces.........................................................................................................7 3.1 – Vectors in 2-space, 3-space, and n-space......................................................................................7 Theorem 3.1.1 – Algebraic Vector Operations without components...........................................7 Theorem 3.1.2 .............................................................................................................................7 3.2 – Norm, Dot Product, and Distance................................................................................................7 Definition 1 – Norm of a Vector..................................................................................................7 Definition 2 – Distance in Rn......................................................................................................7 Dot Product.......................................................................................................................................8 Definition 3 – Dot Product...........................................................................................................8 Definition 4 – Dot Product, Component by component..............................................................8
    [Show full text]
  • Lesson 1 Introduction to MATLAB
    Math 323 Linear Algebra and Matrix Theory I Fall 1999 Dr. Constant J. Goutziers Department of Mathematical Sciences [email protected] Lesson 1 Introduction to MATLAB MATLAB is an interactive system whose basic data element is an array that does not require dimensioning. This allows easy solution of many technical computing problems, especially those with matrix and vector formulations. For many colleges and universities MATLAB is the Linear Algebra software of choice. The name MATLAB stands for matrix laboratory. 1.1 Row and Column vectors, Formatting In linear algebra we make a clear distinction between row and column vectors. • Example 1.1.1 Entering a row vector. The components of a row vector are entered inside square brackets, separated by blanks. v=[1 2 3] v = 1 2 3 • Example 1.1.2 Entering a column vector. The components of a column vector are also entered inside square brackets, but they are separated by semicolons. w=[4; 5/2; -6] w = 4.0000 2.5000 -6.0000 • Example 1.1.3 Switching between a row and a column vector, the transpose. In MATLAB it is possible to switch between row and column vectors using an apostrophe. The process is called "taking the transpose". To illustrate the process we print v and w and generate the transpose of each of these vectors. Observe that MATLAB commands can be entered on the same line, as long as they are separated by commas. v, vt=v', w, wt=w' v = 1 2 3 vt = 1 2 3 w = 4.0000 2.5000 -6.0000 wt = 4.0000 2.5000 -6.0000 • Example 1.1.4 Formatting.
    [Show full text]
  • Linear Algebra I: Vector Spaces A
    Linear Algebra I: Vector Spaces A 1 Vector spaces and subspaces 1.1 Let F be a field (in this book, it will always be either the field of reals R or the field of complex numbers C). A vector space V D .V; C; o;˛./.˛2 F// over F is a set V with a binary operation C, a constant o and a collection of unary operations (i.e. maps) ˛ W V ! V labelled by the elements of F, satisfying (V1) .x C y/ C z D x C .y C z/, (V2) x C y D y C x, (V3) 0 x D o, (V4) ˛ .ˇ x/ D .˛ˇ/ x, (V5) 1 x D x, (V6) .˛ C ˇ/ x D ˛ x C ˇ x,and (V7) ˛ .x C y/ D ˛ x C ˛ y. Here, we write ˛ x and we will write also ˛x for the result ˛.x/ of the unary operation ˛ in x. Often, one uses the expression “multiplication of x by ˛”; but it is useful to keep in mind that what we really have is a collection of unary operations (see also 5.1 below). The elements of a vector space are often referred to as vectors. In contrast, the elements of the field F are then often referred to as scalars. In view of this, it is useful to reflect for a moment on the true meaning of the axioms (equalities) above. For instance, (V4), often referred to as the “associative law” in fact states that the composition of the functions V ! V labelled by ˇ; ˛ is labelled by the product ˛ˇ in F, the “distributive law” (V6) states that the (pointwise) sum of the mappings labelled by ˛ and ˇ is labelled by the sum ˛ C ˇ in F, and (V7) states that each of the maps ˛ preserves the sum C.
    [Show full text]
  • Week 1 – Vectors and Matrices
    Week 1 – Vectors and Matrices Richard Earl∗ Mathematical Institute, Oxford, OX1 2LB, October 2003 Abstract Algebra and geometry of vectors. The algebra of matrices. 2x2 matrices. Inverses. Determinants. Simultaneous linear equations. Standard transformations of the plane. Notation 1 The symbol R2 denotes the set of ordered pairs (x, y) – that is the xy-plane. Similarly R3 denotes the set of ordered triples (x, y, z) – that is, three-dimensional space described by three co-ordinates x, y and z –andRn denotes a similar n-dimensional space. 1Vectors A vector can be thought of in two different ways. Let’s for the moment concentrate on vectors in the xy-plane. From one point of view a vector is just an ordered pair of numbers (x, y). We can associate this • vector with the point in R2 which has co-ordinates x and y. We call this vector the position vector of the point. From the second point of view a vector is a ‘movement’ or translation. For example, to get from • the point (3, 4) to the point (4, 5) we need to move ‘one to the right and one up’; this is the same movement as is required to move from ( 2, 3) to ( 1, 2) or from (1, 2) to (2, 1) . Thinking about vectors from this second point of− view,− all three− of− these movements− are the− same vector, because the same translation ‘one right, one up’ achieves each of them, even though the ‘start’ and ‘finish’ are different in each case. We would write this vector as (1, 1) .
    [Show full text]
  • Linear Algebra: Matrices, Vectors, Determinants. Linear Systems
    c07.qxd 10/28/10 7:30 PM Page 256 CHAPTER 7 Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra is a fairly extensive subject that covers vectors and matrices, determinants, systems of linear equations, vector spaces and linear transformations, eigenvalue problems, and other topics. As an area of study it has a broad appeal in that it has many applications in engineering, physics, geometry, computer science, economics, and other areas. It also contributes to a deeper understanding of mathematics itself. Matrices, which are rectangular arrays of numbers or functions, and vectors are the main tools of linear algebra. Matrices are important because they let us express large amounts of data and functions in an organized and concise form. Furthermore, since matrices are single objects, we denote them by single letters and calculate with them directly. All these features have made matrices and vectors very popular for expressing scientific and mathematical ideas. The chapter keeps a good mix between applications (electric networks, Markov processes, traffic flow, etc.) and theory. Chapter 7 is structured as follows: Sections 7.1 and 7.2 provide an intuitive introduction to matrices and vectors and their operations, including matrix multiplication. The next block of sections, that is, Secs. 7.3–7.5 provide the most important method for solving systems of linear equations by the Gauss elimination method. This method is a cornerstone of linear algebra, and the method itself and variants of it appear in different areas of mathematics and in many applications. It leads to a consideration of the behavior of solutions and concepts such as rank of a matrix, linear independence, and bases.
    [Show full text]
  • Chapter 9 Matrices and Determinants
    Chapter 9 222 Matrices and Determinants Chapter 9 Matrices and Determinants 9.1 Introduction: In many economic analysis, variables are assumed to be related by sets of linear equations. Matrix algebra provides a clear and concise notation for the formulation and solution of such problems, many of which would be complicated in conventional algebraic notation. The concept of determinant and is based on that of matrix. Hence we shall first explain a matrix. 9.2 Matrix: A set of mn numbers (real or complex), arranged in a rectangular formation (array or table) having m rows and n columns and enclosed by a square bracket [ ] is called mn matrix (read “m by n matrix”) . An mn matrix is expressed as a11 a 12 a 1n a21 a 22 a 2n A= am1 a m2 a mn The letters aij stand for real numbers. Note that aij is the element in the ith row and jth column of the matrix .Thus the matrix A is sometimes denoted by simplified form as (aij) or by {aij} i.e., A = (aij) Matrices are usually denoted by capital letters A, B, C etc and its elements by small letters a, b, c etc. Order of a Matrix: The order or dimension of a matrix is the ordered pair having as first component the number of rows and as second component the number of columns in the matrix. If there are 3 rows and 2 columns in a matrix, then its order is written as (3, 2) or (3 x 2) read as three by two.
    [Show full text]
  • Quantum Algorithms Via Linear Algebra: a Primer / Richard J
    QUANTUM ALGORITHMS VIA LINEAR ALGEBRA A Primer Richard J. Lipton Kenneth W. Regan The MIT Press Cambridge, Massachusetts London, England c 2014 Massachusetts Institute of Technology All rights reserved. No part of this book may be reproduced in any form or by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher. MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please email special [email protected]. This book was set in Times Roman and Mathtime Pro 2 by the authors, and was printed and bound in the United States of America. Library of Congress Cataloging-in-Publication Data Lipton, Richard J., 1946– Quantum algorithms via linear algebra: a primer / Richard J. Lipton and Kenneth W. Regan. p. cm. Includes bibliographical references and index. ISBN 978-0-262-02839-4 (hardcover : alk. paper) 1. Quantum computers. 2. Computer algorithms. 3. Algebra, Linear. I. Regan, Kenneth W., 1959– II. Title QA76.889.L57 2014 005.1–dc23 2014016946 10987654321 We dedicate this book to all those who helped create and nourish the beautiful area of quantum algorithms, and to our families who helped create and nourish us. RJL and KWR Contents Preface xi Acknowledgements xiii 1 Introduction 1 1.1 The Model 2 1.2 The Space and the States 3 1.3 The Operations 5 1.4 Where Is the Input? 6 1.5 What Exactly Is the Output? 7 1.6 Summary and Notes 8 2 Numbers and Strings 9 2.1 Asymptotic Notation
    [Show full text]
  • Computational Foundations of Cognitive Science Lecture 11: Matrices in Matlab
    Basic Matrix Operations Special Matrices Matrix Products Transpose, Inner and Outer Product Computational Foundations of Cognitive Science Lecture 11: Matrices in Matlab Frank Keller School of Informatics University of Edinburgh [email protected] February 23, 2010 Frank Keller Computational Foundations of Cognitive Science 1 Basic Matrix Operations Special Matrices Matrix Products Transpose, Inner and Outer Product 1 Basic Matrix Operations Sum and Difference Size; Product with Scalar 2 Special Matrices Zero and Identity Matrix Diagonal and Triangular Matrices Block Matrices 3 Matrix Products Row and Column Vectors Mid-lecture Problem Matrix Product Product with Vector 4 Transpose, Inner and Outer Product Transpose Symmetric Matrices Inner and Outer Product Reading: McMahon, Ch. 2 Frank Keller Computational Foundations of Cognitive Science 2 Basic Matrix Operations Special Matrices Sum and Difference Matrix Products Size; Product with Scalar Transpose, Inner and Outer Product Sum and Difference In Matlab, matrices are input as lists of numbers; columns are separated by spaces or commas, rows by semicolons or newlines: > A = [2, 1, 0, 3; -1, 0, 2, 4; 4, -2, 7, 0]; > B = [-4, 3, 5, 1 2, 2, 0, -1 3, 2, -4, 5]; > C = [1 1; 2 2]; The sum and difference of two matrices can be computed using the operators + and -: > disp(A + B); -2 4 5 4 1 2 2 3 7 0 3 5 Frank Keller Computational Foundations of Cognitive Science 3 Basic Matrix Operations Special Matrices Sum and Difference Matrix Products Size; Product with Scalar Transpose, Inner and Outer Product
    [Show full text]
  • INTRODUCTION to MATRIX ALGEBRA 1.1. Definition of a Matrix
    INTRODUCTION TO MATRIX ALGEBRA 1. DEFINITION OF A MATRIX AND A VECTOR 1.1. Definition of a matrix. A matrix is a rectangular array of numbers arranged into rows and columns. It is written as a11 a12 ... a1n a a ... a 21 22 2n .. (1) .. .. am1 am2 ... amn The above array is called an m by n (m x n) matrix since it has m rows and n columns. Typically upper-case letters are used to denote a matrix and lower case letters with subscripts the elements. The matrix A is also often denoted A = kaijk (2) 1.2. Definition of a vector. A vector is a n-tuple of numbers. In R2 a vector would be an ordered 3 n pair of numbers {x, y}.InR a vector is a 3-tuple, i.e., {x1,x2,x3}. Similarly for R . Vectors are usually denoted by lower case letters such as a or b, or more formally ~a or ~b. 1.3. Row and column vectors. 1.3.1. Row vector. A matrix with one row and n columns (1xn) is called a row vector. It is usually written ~x 0 or 0 ~x = x1,x2,x3, ..., xn (3) The use of the prime 0 symbol indicates we are writing the n-tuple horizontally as if it were the row of a matrix. Note that each row of a matrix is a row vector. 1.3.2. Column vector. A matrix with one column and n rows (nx1) is called a column vector. It is written as x1 x 2 x3 ~x = .
    [Show full text]
  • 1.1. Elementary Matrices, Row and Column Transformations. We Have
    1. ROW OPERATION AND COLUMN OPERATIONS 1.1. Elementary Matrices, Row and Column Transformations. We have already studied in the last section that we can view the matrix multiplication as linear combi- nation of column vectors of the first matrix, or row vectors of the second matrix. And the coefficient of matrix multiplication is exactly given by other matrix. This shows that to understand matrix multiplication, we have to study the linear combination of row and column vectors. In this section, we will study the most basic linear combination of rows and columns, row and column transformation. 1.1.1. Elementary Row transformation. We have three types of row transformation. row switching This transformation swiches two row of matrix. 0 1 4 8 1 0 3 3 5 1 r1$r3 Switch the 1st and 3rd row of matrix @ 2 0 9 A −−−−! @ 2 0 9 A 3 3 5 1 4 8 row multiplying This transformation multiplies some row with a non-zero scalar λ 0 1 4 8 1 0 1 4 8 1 2×r2 Multiply the 2nd row of matrix by 2 : @ 2 0 9 A −−−! @ 4 0 18 A 3 3 5 3 3 5 row adding In this transformation, we multiply some row by a scalar, but add that into another row. 0 1 4 8 1 0 1 4 8 1 r3+2×r2 Add twice of the 2nd row to the 3rd row : @ 2 0 9 A −−−−−! @ 2 0 9 A 3 3 5 7 3 23 Caution: Write 2 × r instead of r × 2, the reason for that is simple, because scalar is 1 × 1 matrix.
    [Show full text]