Linear Algebra

Total Page:16

File Type:pdf, Size:1020Kb

Linear Algebra Linear Algebra Jonny Evans May 18, 2021 Contents 1 Week 1, Session 1: Matrices and transformations 5 1.1 Matrices . .5 1.1.1 Vectors in the plane . .5 1.1.2 2-by-2 matrices . .6 1.1.3 Mnemonic . .7 1.2 Matrices: examples . .7 1.2.1 Vectors in the plane . .7 1.2.2 Example 1 . .8 1.2.3 Example 2 . .8 1.2.4 Useful lemma . .8 1.2.5 Example 3 . .9 1.2.6 Example 4 . .9 1.2.7 Example 5 . 10 1.2.8 Example 6 . 11 1.2.9 Outlook . 11 1.3 Bigger matrices . 11 1.3.1 Bigger matrices . 11 1.3.2 More examples . 13 2 Week 1, Session 2: Matrix algebra 15 2.1 Matrix multiplication, 1 . 15 2.1.1 Composing transformations . 15 2.1.2 Mnemonic . 15 2.2 Matrix multiplication, 2 . 16 2.2.1 Examples . 16 2.3 Matrix multiplication, 3 . 17 2.3.1 Multiplying bigger matrices . 17 2.4 Index notation . 18 2.4.1 Index notation . 18 2.4.2 Associativity of matrix multiplication . 19 2.5 Other operations . 19 2.5.1 Matrix addition . 19 2.5.2 Special case: vector addition . 20 2.5.3 Rescaling . 20 1 2.5.4 Matrix exponentiation . 20 3 Week 2, Session 1: Dot products and rotations 22 3.1 Dot product . 22 3.2 Transposition . 23 3.3 Orthogonal matrices . 24 3.4 Rotations . 26 3.4.1 Example 1 . 26 3.4.2 Example 2 . 26 3.4.3 Example 3 . 27 4 Week 2, Session 2: Simultaneous equations 29 4.1 Simultaneous equations and row operations . 29 4.1.1 Simultaneous equations . 29 4.1.2 Solving these equations . 29 4.1.3 Row operations . 30 4.2 Echelon form . 31 4.3 Reduced echelon form . 32 4.3.1 Definition . 32 4.3.2 Reason for the definition . 33 4.3.3 Another example . 33 4.3.4 Strategy . 34 4.4 Echelon examples . 34 4.4.1 Example 1 . 34 4.4.2 Example 2 . 35 4.4.3 Example 3 . 36 5 Week 3, Session 1: Geometry of simultaneous equations and inverses 37 5.1 Geometric viewpoint on simultaneous equations, 1 . 37 5.1.1 2 variables . 37 5.1.2 Lines in the plane . 38 5.2 Geometric viewpoint on simultaneous equations, 2 . 39 5.2.1 3 variables . 39 5.2.2 Higher dimensions . 40 5.3 Subspaces . 41 5.3.1 Linear subspaces . 41 5.3.2 Affine subspaces . 41 5.3.3 More properties . 42 5.4 Inverses . 42 5.4.1 When can you “divide” by a matrix? . 42 5.4.2 Bigger matrices . 43 5.5 Inverses: examples . 44 5.5.1 Method for finding the inverse . 44 5.5.2 Examples . 44 6 Week 3, Session 2: Inverses and determinants 46 6.1 Elementary matrices, 1 . 46 6.1.1 Elementary matrices of type I . 46 6.1.2 Elementary matrices of type II . 47 2 6.2 Elementary matrices, 2 . 47 6.3 Determinants . 48 6.3.1 Definition . 48 6.3.2 Signs . 49 6.3.3 Index notation . 50 6.3.4 Examples . 50 6.4 Properties of determinants . 51 6.4.1 Type I row operations . 52 6.4.2 Type III row operations . 53 6.4.3 Type II row operations . 53 6.5 Determinants: examples . 53 7 Week 4, Session 1: More about determinants 55 7.1 Further properties of determinants . 55 7.1.1 Proof of the invertibility criterion . 55 7.1.2 Proof of multiplicativity of the determinant . 55 7.2 Cofactor expansion . 56 7.2.1 Signs . 57 7.2.2 Examples . 57 7.3 Geometry of determinants, 1 . 59 7.3.1 2-by-2 determinants and area . 59 7.3.2 Proof of theorem . 60 7.4 Geometry of determinants, 2 . 61 7.4.1 Higher dimensions . 61 7.4.2 Tetrahedra/simplices . 61 7.4.3 Determinant as scale factor for volumes . 63 8 Week 4, Session 2: Eigenvectors and eigenvalues 64 8.1 Eigenvectors and eigenvalues . 64 8.1.1 Eigenvectors and eigenvalues . 64 8.1.2 The eigenvector equation . 64 8.2 Finding eigenvalues . 65 8.2.1 Characteristic polynomial . 65 8.2.2 Examples . 66 8.2.3 Proof of theorem . 66 8.3 Eigenexamples . 67 8.4 Eigenspaces . 69 9 Week 5, Session 1: Eigenapplications 71 9.1 Differential equations . 71 9.1.1 Sketch of the idea . 71 9.1.2 An example in detail . 72 9.2 Ellipses . 73 9.2.1 General equation of an ellipse . 74 9.2.2 Normal form for ellipses . ..
Recommended publications
  • Refinements of the Weyl Tensor Classification in Five Dimensions
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Ghent University Academic Bibliography Home Search Collections Journals About Contact us My IOPscience Refinements of the Weyl tensor classification in five dimensions This article has been downloaded from IOPscience. Please scroll down to see the full text article. 2012 Class. Quantum Grav. 29 155016 (http://iopscience.iop.org/0264-9381/29/15/155016) View the table of contents for this issue, or go to the journal homepage for more Download details: IP Address: 157.193.53.227 The article was downloaded on 16/07/2012 at 16:13 Please note that terms and conditions apply. IOP PUBLISHING CLASSICAL AND QUANTUM GRAVITY Class. Quantum Grav. 29 (2012) 155016 (50pp) doi:10.1088/0264-9381/29/15/155016 Refinements of the Weyl tensor classification in five dimensions Alan Coley1, Sigbjørn Hervik2, Marcello Ortaggio3 and Lode Wylleman2,4,5 1 Department of Mathematics and Statistics, Dalhousie University, Halifax, Nova Scotia B3H 3J5, Canada 2 Faculty of Science and Technology, University of Stavanger, N-4036 Stavanger, Norway 3 Institute of Mathematics, Academy of Sciences of the Czech Republic, Zitnˇ a´ 25, 115 67 Prague 1, Czech Republic 4 Department of Mathematical Analysis EA16, Ghent University, 9000 Gent, Belgium 5 Department of Mathematics, Utrecht University, 3584 CD Utrecht, The Netherlands E-mail: [email protected], [email protected], [email protected] and [email protected] Received 31 March 2012, in final form 21 June 2012 Published 16 July 2012 Online at stacks.iop.org/CQG/29/155016 Abstract We refine the null alignment classification of the Weyl tensor of a five- dimensional spacetime.
    [Show full text]
  • Kinematics of Visually-Guided Eye Movements
    Kinematics of Visually-Guided Eye Movements Bernhard J. M. Hess*, Jakob S. Thomassen Department of Neurology, University Hospital Zurich, Zurich, Switzerland Abstract One of the hallmarks of an eye movement that follows Listing’s law is the half-angle rule that says that the angular velocity of the eye tilts by half the angle of eccentricity of the line of sight relative to primary eye position. Since all visually-guided eye movements in the regime of far viewing follow Listing’s law (with the head still and upright), the question about its origin is of considerable importance. Here, we provide theoretical and experimental evidence that Listing’s law results from a unique motor strategy that allows minimizing ocular torsion while smoothly tracking objects of interest along any path in visual space. The strategy consists in compounding conventional ocular rotations in meridian planes, that is in horizontal, vertical and oblique directions (which are all torsion-free) with small linear displacements of the eye in the frontal plane. Such compound rotation-displacements of the eye can explain the kinematic paradox that the fixation point may rotate in one plane while the eye rotates in other planes. Its unique signature is the half-angle law in the position domain, which means that the rotation plane of the eye tilts by half-the angle of gaze eccentricity. We show that this law does not readily generalize to the velocity domain of visually-guided eye movements because the angular eye velocity is the sum of two terms, one associated with rotations in meridian planes and one associated with displacements of the eye in the frontal plane.
    [Show full text]
  • Local Stability
    Chapter 4 Local stability It does not say in the Bible that all laws of nature are ex- pressible linearly. — Enrico Fermi (R. Mainieri and P. Cvitanovic)´ o far we have concentrated on describing the trajectory of a single initial point. Our next task is to define and determine the size of a neighborhood S of x(t). We shall do this by assuming that the flow is locally smooth and by describing the local geometry of the neighborhood by studying the flow linearized around x(t). Nearby points aligned along the stable (contracting) directions remain t in the neighborhood of the trajectory x(t) = f (x0); the ones to keep an eye on are the points which leave the neighborhood along the unstable directions. As we shall demonstrate in chapter 21, the expanding directions matter in hyperbolic systems. The repercussions are far-reaching. As long as the number of unstable directions is finite, the same theory applies to finite-dimensional ODEs, state space volume preserving Hamiltonian flows, and dissipative, volume contracting infinite-dim- ensional PDEs. In order to streamline the exposition, in this chapter all examples are collected in sect. 4.8. We strongly recommend that you work through these examples: you can get to them and back to the text by clicking on the [example] links, such as example 4.8 p. 96 4.1 Flows transport neighborhoods As a swarm of representative points moves along, it carries along and distorts neighborhoods. The deformation of an infinitesimal neighborhood is best un- derstood by considering a trajectory originating near x0 = x(0), with an initial 82 CHAPTER 4.
    [Show full text]
  • A Unified Canonical Form with Applications to Conformal Geometry
    Skew-symmetric endomorphisms in M1,3: A unified canonical form with applications to conformal geometry Marc Mars and Carlos Pe´on-Nieto Instituto de F´ısica Fundamental y Matem´aticas, Universidad de Salamanca Plaza de la Merced s/n 37008, Salamanca, Spain Abstract We derive a canonical form for skew-symmetric endomorphisms F in Lorentzian vector spaces of dimension three and four which covers all non-trivial cases at once. We analyze its invariance group, as well as the connection of this canonical form with duality rotations of two-forms. After reviewing the relation between these endomorphisms and the algebra of 2 2 2 conformal Killing vectors of S , CKill S , we are able to also give a canonical form for an arbitrary element ξ ∈ CKill S along with its invariance group. The construction allows us to obtain explicitly the change of basis that transforms any given F into its canonical form. For any non-trivial ξ we construct, via its canonical form, adapted coordinates that allow us to study its properties in depth. Two applications are worked out: we determine explicitly for which metrics, among a natural class of spaces of constant curvature, a given ξ is a Killing vector and solve all local TT (traceless and transverse) tensors that satisfy the Killing Initial Data equation for ξ. In addition to their own interest, the present results will be a basic ingredient for a subsequent generalization to arbitrary dimensions. 1 Introduction Finding a canonical form for the elements of a certain set is often an interesting problem to solve, since it is a powerful tool for both computations and mathematical analysis.
    [Show full text]
  • The E8 Geometry from a Clifford Perspective
    Adv. Appl. Clifford Algebras c The Author(s) This article is published with open access at Springerlink.com 2016 Advances in DOI 10.1007/s00006-016-0675-9 Applied Clifford Algebras The E8 Geometry from a Clifford Perspective Pierre-Philippe Dechant * Abstract. This paper considers the geometry of E8 from a Clifford point of view in three complementary ways. Firstly, in earlier work, I had shown how to construct the four-dimensional exceptional root systems from the 3D root systems using Clifford techniques, by constructing them in the 4D even subalgebra of the 3D Clifford algebra; for instance the icosahedral root system H3 gives rise to the largest (and therefore ex- ceptional) non-crystallographic root system H4. Arnold’s trinities and the McKay correspondence then hint that there might be an indirect connection between the icosahedron and E8. Secondly, in a related con- struction, I have now made this connection explicit for the first time: in the 8D Clifford algebra of 3D space the 120 elements of the icosahedral group H3 are doubly covered by 240 8-component objects, which en- dowed with a ‘reduced inner product’ are exactly the E8 root system. It was previously known that E8 splits into H4-invariant subspaces, and we discuss the folding construction relating the two pictures. This folding is a partial version of the one used for the construction of the Coxeter plane, so thirdly we discuss the geometry of the Coxeter plane in a Clif- ford algebra framework. We advocate the complete factorisation of the Coxeter versor in the Clifford algebra into exponentials of bivectors de- scribing rotations in orthogonal planes with the rotation angle giving the correct exponents, which gives much more geometric insight than the usual approach of complexification and search for complex eigenval- ues.
    [Show full text]
  • The E8 Geometry from a Clifford Perspective
    Adv. Appl. Clifford Algebras c The Author(s) This article is published with open access at Springerlink.com 2016 Advances in DOI 10.1007/s00006-016-0675-9 Applied Clifford Algebras The E8 Geometry from a Clifford Perspective Pierre-Philippe Dechant * Abstract. This paper considers the geometry of E8 from a Clifford point of view in three complementary ways. Firstly, in earlier work, I had shown how to construct the four-dimensional exceptional root systems from the 3D root systems using Clifford techniques, by constructing them in the 4D even subalgebra of the 3D Clifford algebra; for instance the icosahedral root system H3 gives rise to the largest (and therefore ex- ceptional) non-crystallographic root system H4. Arnold’s trinities and the McKay correspondence then hint that there might be an indirect connection between the icosahedron and E8. Secondly, in a related con- struction, I have now made this connection explicit for the first time: in the 8D Clifford algebra of 3D space the 120 elements of the icosahedral group H3 are doubly covered by 240 8-component objects, which en- dowed with a ‘reduced inner product’ are exactly the E8 root system. It was previously known that E8 splits into H4-invariant subspaces, and we discuss the folding construction relating the two pictures. This folding is a partial version of the one used for the construction of the Coxeter plane, so thirdly we discuss the geometry of the Coxeter plane in a Clif- ford algebra framework. We advocate the complete factorisation of the Coxeter versor in the Clifford algebra into exponentials of bivectors de- scribing rotations in orthogonal planes with the rotation angle giving the correct exponents, which gives much more geometric insight than the usual approach of complexification and search for complex eigenval- ues.
    [Show full text]
  • The E8 Geometry from a Clifford Perspective
    This is a repository copy of The E8 geometry from a Clifford perspective. White Rose Research Online URL for this paper: https://eprints.whiterose.ac.uk/96267/ Version: Published Version Article: Dechant, Pierre-Philippe orcid.org/0000-0002-4694-4010 (2017) The E8 geometry from a Clifford perspective. Advances in Applied Clifford Algebras. 397–421. ISSN 1661-4909 https://doi.org/10.1007/s00006-016-0675-9 Reuse This article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: https://creativecommons.org/licenses/ Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing [email protected] including the URL of the record and the reason for the withdrawal request. [email protected] https://eprints.whiterose.ac.uk/ Adv. Appl. Clifford Algebras c The Author(s) This article is published with open access at Springerlink.com 2016 Advances in DOI 10.1007/s00006-016-0675-9 Applied Clifford Algebras The E8 Geometry from a Clifford Perspective Pierre-Philippe Dechant * Abstract. This paper considers the geometry of E8 from a Clifford point of view in three complementary ways. Firstly, in earlier work, I had shown how to construct the four-dimensional exceptional root systems from the 3D root systems using Clifford techniques, by constructing them in the 4D even subalgebra of the 3D Clifford algebra; for instance the icosahedral root system H3 gives rise to the largest (and therefore ex- ceptional) non-crystallographic root system H4.
    [Show full text]
  • Chapter 4. EIGENVALUES to Prove the Cauchy–Schwarz Inequality, Note That It Suffices to Consider the Case W = 1
    Chapter 4 Eigenvalues 1 The Spectral Theorem Hermitian Spaces Given a C-vector space , an Hermitian inner product in is defined as a Hermitian symmetricV sesquilinear form such thatVthe corresponding Hermitian quadratic form is positive definite. A space equipped with an Hermitian inner product , is called a Her- mitianV space.1 h· ·i The inner square z, z is interpreted as the square of the length z of the vector z. Respectively,h i the distance between two points z and| | w in an Hermitian space is defined as z w . Since the Hermitian inner product is positive, distance is well-defined,| − | symmetric, and positive (unless z = w). In fact it satisfies the triangle inequality2: z w z + w . | − | ≤ | | | | This follows from the Cauchy – Schwarz inequality: z, w 2 z, z w, w , |h i| ≤ h i h i where the equality holds if and only if z and w are linearly dependent. To derive the triangle inequality, write: z w 2 = z w, z w = z, z z, w w, z + w, w | − | h − − i h i − h i − h i h i z 2 + 2 z w + w 2 = ( z + w )2. ≤ | | | || | | | | | | | 1Other terms used are unitary space and finite dimensional Hilbert space. 2This makes a Hermitian space a metric space. 135 136 Chapter 4. EIGENVALUES To prove the Cauchy–Schwarz inequality, note that it suffices to consider the case w = 1. Indeed, when w = 0, both sides vanish, and when w =| |0, both sides scale the same way when w is normalized to the6 unit length. So, assuming w = 1, we put λ := w, z and consider the projection λw of| the| vector z to the lineh spannedi by w.
    [Show full text]
  • Eigenvalue, Eigenvector and Eigenspace
    http://en.wikipedia.org/wiki/Eigenvector Eigenvalue, eigenvector and eigenspace FromWikipedia,thefreeencyclopedia (RedirectedfromEigenvector) Inmathematics,an eigenvector ofatransformation[1]isa nonnull vectorwhosedirectionisunchangedbythattransformation. Thefactorbywhichthemagnitudeisscalediscalledthe eigenvalue ofthatvector.(SeeFig.1.)Often,atransformationis completelydescribedbyitseigenvaluesandeigenvectors.An eigenspaceisasetofeigenvectorswithacommoneigenvalue. Theseconceptsplayamajorroleinseveralbranchesofbothpure andappliedmathematics—appearingprominentlyinlinearalgebra, functionalanalysis,andtoalesserextentinnonlinearsituations. Itiscommontoprefixanynaturalnameforthesolutionwitheigen Fig.1.InthissheartransformationoftheMona insteadofsayingeigenvector.Forexample,eigenfunctionifthe Lisa,thepicturewasdeformedinsuchaway eigenvectorisafunction,eigenmodeiftheeigenvectorisaharmonic thatitscentralverticalaxis(redvector)was notmodified,butthediagonalvector(blue)has mode,eigenstateiftheeigenvectorisaquantumstate,andsoon changeddirection.Hencetheredvectorisan (e.g.theeigenfaceexamplebelow).Similarlyfortheeigenvalue,e.g. eigenvectorofthetransformationandtheblue eigenfrequencyiftheeigenvalueis(ordetermines)afrequency. vectorisnot.Sincetheredvectorwasneither stretchednorcompressed,itseigenvalueis1. Allvectorsalongthesameverticallinearealso eigenvectors,withthesameeigenvalue.They formtheeigenspaceforthiseigenvalue. 1 of 14 16/Oct/06 5:01 PM http://en.wikipedia.org/wiki/Eigenvector Contents 1 History 2 Definitions 3 Examples 4 Eigenvalueequation
    [Show full text]
  • Visualization of 4D Vector Field Topology
    Author's copy. To appear in Computer Graphics Forum. Eurographics Conference on Visualization (EuroVis) 2018 Volume 37 (2018), Number 3 J. Heer, H. Leitte, and T. Ropinski (Guest Editors) Visualization of 4D Vector Field Topology Lutz Hofmann, Bastian Rieck, and Filip Sadlo Heidelberg University, Germany Figure 1: 3D projection of topological structures of a 4D vector field, with critical points depicted by 4D glyphs, their stable and unstable invariant manifolds (blue and red, respectively) by volumes in 4D, together with 4D streamlines for context. The 4D camera moves in 4D space along a selected streamline (striped red–white), while maintaining a view which minimizes the amount of clutter in the 3D projection. Abstract In this paper, we present an approach to the topological analysis of four-dimensional vector fields. In analogy to traditional 2D and 3D vector field topology, we provide a classification and visual representation of critical points, together with a technique for extracting their invariant manifolds. For effective exploration of the resulting four-dimensional structures, we present a 4D camera that provides concise representation by exploiting projection degeneracies, and a 4D clipping approach that avoids self-intersection in the 3D projection. We exemplify the properties and the utility of our approach using specific synthetic cases. CCS Concepts •Human-centered computing → Visualization techniques; •Applied computing → Mathematics and statistics; 1. Introduction of concentration of four substances due to chemical reactions, or Many physical phenomena in our everyday life, that involve force the evolution of four competing species. It is, however, nowadays or motion, are accessible by the concept of a two-dimensional or often the case that such problems are investigated by only a few three-dimensional time-independent vector field.
    [Show full text]
  • Asimov (Notes on the Topology of Vector Fields)
    Notes on the Topology of Vector Fields and Flows Daniel Asimov Visualization ′93 San José, California October 1993 Vector fields are ubiquitous in science and Figure 1: Vector Field (unnormalized) mathematics, and perhaps nowhere as much as in computational fluid dynamics (CFD). In order to make sense of the vast amount of information that a vector field can carry, we present in these notes some important topological features and con- cepts that can be used to get a glimpse of “what a vector field is doing.” 1 Vector Fields A vector field arises in a situation where, for some reason, there is a direction and magnitude assigned to each point of space. The classic example of a vector field in the real world is the velocity of a steady wind. We will draw a vector field as having its point of origin at the point x to which it is assigned. In this way a vector field resem- bles a hairdo, with all the hair being per- fectly straight A vector field is, mathematically, the choice of a vector for each point of a region of space. In general, let U denote an open set of Euclidean space Rn. (We will usu- 1 of 21 ally be interested in the cases n = 2 and 2 Differential Equations and Solu- n = 3.) Then a vector field on U is given by tion Curves a function f : U → Rn. We will assume that a vector field f is at least once continu- A differential equation (or more pre- ously differentiable, denoted C1.
    [Show full text]
  • Geometric Algebra in Euclidean Space 44 6.1 Twodimensionsandcomplexnumbers
    May 29, 2012 Geometric Algebra Eric Chisolm Abstract This is an introduction to geometric algebra, an alternative to traditional vector algebra that expands on it in two ways: 1. In addition to scalars and vectors, it defines new objects representing subspaces of any dimension. 2. It defines a product that’s strongly motivated by geometry and can be taken between any two objects. For example, the product of two vectors taken in a certain way represents their common plane. This system was invented by William Clifford and is more commonly known as Clifford algebra. It’s actually older than the vector algebra that we use today (due to Gibbs) and includes it as a subset. Over the years, various parts of Clifford algebra have been reinvented independently by many people who found they needed it, often not realizing that all those parts belonged in one system. This suggests that Clifford had the right idea, and that geometric algebra, not the reduced version we use today, deserves to be the standard “vector algebra.” My goal in these notes is to describe geometric algebra from that standpoint and illustrate its usefulness. The notes are work in progress; I’ll keep adding new topics as I learn them myself. Contents 1 Introduction 3 1.1 Motivation ......................................... ..... 3 1.2 Simple applications . ...... 5 1.3 Wherenow?........................................ ...... 8 1.4 Referencesandcomments .. .. .. .. .. .. .. .. .. .. .. .. .......... 9 2 Definitions and axioms 10 3 The contents of a geometric algebra 13 arXiv:1205.5935v1 [math-ph] 27 May 2012 4 The inner, outer, and geometric products 16 4.1 The inner, outer, and geometric products of a vector with anything..............
    [Show full text]