DOCSLIB.ORG

Singular Value Decomposition

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Singular Value Decomposition Optimization Models EECS 127 / EECS 227AT Laurent El Ghaoui EECS department UC Berkeley Fall 2018 Fa18 1 / 32 LECTURE 6 Singular Value Decomposition The license plate of Gene Golub (1932{2007). Fa18 2 / 32 Outline 1 The singular value decomposition (SVD) Motivation Dyads SVD theorem 2 Matrix properties via SVD Rank, nullspace and range Matrix norms, pseudo-inverses Projectors 3 Low-rank matrix approximation 4 Link with PCA 5 Generalized low-rank models Fa18 3 / 32 Motivation Figure: Votes of US Senators, 2002-2004. The plot is impossible to read. Can we make sense of this data? For example, do the two political parties emerge from the data alone? Could we further provide a \political spectrum score" for each Senator? Fa18 4 / 32 Dyads m;n A matrix A 2 R is called a dyad if it can be written as A = pq> m n for some vectors p 2 R , q 2 R . Element-wise the above reads Aij = pi qi ; 1 ≤ i ≤ m; 1 ≤ j ≤ n: Interpretation: The columns of A are scaled copies the same column p, with scaling factors given in vector q. The rows of A are scaled copies the same row q>, with scaling factors given in vector p. Fa18 5 / 32 Dyads Example: video frames We are given a set of image frames representing a video. Assuming that each image is represented by a row vector of pixels, we can represent the whole video sequence as a matrix A. Each row is an image. ::: Figure: Row vector representation of an image. If the video shows a scene where no movement occurs, then the matrix A is a dyad. Fa18 6 / 32 Sums of dyads The singular value decomposition theorem, seen next, states that any matrix can be written as a sum of dyads: r X > A = pi qi i=1 for vectors pi ; qi that are mutually orthogonal. This allows to intepret data matrices as sums of \simpler" matrices (dyads). Fa18 7 / 32 The singular value decomposition (SVD) SVD theorem The singular value decomposition (SVD) of a matrix provides a three-term factorization which is similar to the spectral factorization, but holds for any, possibly non-symmetric m;n and rectangular, matrix A 2 R . Theorem 1 (SVD decomposition) m;n Any matrix A 2 R can be factored as A = UΣ~V > n;n m;m > > where V 2 R and U 2 R are orthogonal matrices (i.e., U U = Im, V V = In), ~ m;n : and Σ 2 R is a matrix having the first r = rank A diagonal entries (σ1; : : : ; σr ) positive and decreasing in magnitude, and all other entries zero: Σ 0r;n−r Σ~ = ; Σ = diag (σ1; : : : ; σr ) 0: 0m−r;r 0m−r;n−r Fa18 8 / 32 Compact-form SVD Corollary 1 (Compact-form SVD) m;n Any matrix A 2 R can be expressed as r X > > A = σi ui vi = Ur ΣVr i=1 > where r = rank A, Ur = [u1 ··· ur ] is such that Ur Ur = Ir , Vr = [v1 ··· vr ] is such > that Vr Vr = Ir , and σ1 ≥ σ2 ≥ · · · ≥ σr > 0. The positive numbers σi are called the singular values of A, vectors ui are called the left singular vectors of A, and vi the right singular vectors. These quantities satisfy > Avi = σi ui ; ui A = σi vi ; i = 1;:::; r: 2 > > Moreover, σi = λi (AA ) = λi (A A), i = 1;:::; r, and ui , vi are the eigenvectors of A>A and of AA>, respectively. Fa18 9 / 32 Interpretation The singular value decomposition theorem allows to write any matrix can be written as a sum of dyads: r X > A = σi ui vi i=1 where Vectors ui ; vi are normalized, with σi > 0 providing the \strength" of the corresponding dyad; The vectors ui , i = 1;:::; r (resp. vi , i = 1;:::; r) are mutually orthogonal. Fa18 10 / 32 Matrix properties via SVD Rank, nullspace and range The rank r of A is the cardinality of the nonzero singular values, that is the number of nonzero entries on the diagonal of Σ.~ Since r = rank A, by the fundamental theorem of linear algebra the dimension of the nullspace of A is dim N (A) = n − r. An orthonormal basis spanning N (A) is given by the last n − r columns of V , i.e. : N (A) = R(Vnr ); Vnr = [vr+1 ··· vn]: Similarly, an orthonormal basis spanning the range of A is given by the first r columns of U, i.e. : R(A) = R(Ur ); Ur = [u1 ··· ur ]: Fa18 11 / 32 Matrix properties via SVD Matrix norms m;n The squared Frobenius matrix norm of a matrix A 2 R can be defined as n n 2 > X > X 2 kAkF = trace A A = λi (A A) = σi ; i=1 i=1 where σi are the singular values of A. Hence the squared Frobenius norm is nothing but the sum of the squares of the singular values. 2 The squared spectral matrix norm kAk2 is equal to the maximum eigenvalue of A>A, therefore 2 2 kAk2 = σ1 ; i.e., the spectral norm of A coincides with the maximum singular value of A. The so-called nuclear norm of a matrix A is defined in terms of its singular values: r X kAk∗ = σi ; r = rank A: i=1 The nuclear norm appears in several problems related to low-rank matrix completion or rank minimization problems. Fa18 12 / 32 Matrix norm: proof We have 2 ~ > 2 2 kAxk2 kΣV xk2 > kAk2 = max 2 = max 2 (since U U = I ) x6=0 kxk2 x6=0 kxk2 ~ 2 kΣzk2 : > = max 2 (with z = V x) z6=0 kzk2 ~ 2 T = max kΣzk2 : z z = 1 z r X 2 2 T = max σi zi : z z = 1 z i=1 r X 2 : 2 = max σi pi (with pi = zi , i = 1;:::; r) 1>p=1; p≥0 i=1 2 ≤ max σi : 1≤i≤r In the last line the upper bound is attained for some feasible vector p, hence equality holds. Fa18 13 / 32 Matrix properties via SVD Condition number n;n The condition number of an invertible matrix A 2 R is defined as the ratio between the largest and the smallest singular value: σ1 −1 κ(A) = = kAk2 · kA k2: σn This number provides a quantitative measure of how close A is to being singular (the larger κ(A) is, the more close to singular A is). The condition number also provides a measure of the sensitivity of the solution of a system of linear equations to changes in the equation coefficients. Fa18 14 / 32 Matrix properties via SVD Matrix pseudo-inverses m;n y Given A 2 R , a pseudoiverse is a matrix A that satisfies AAyA = A AyAAy = Ay (AAy)> = AAy (AyA)> = AyA: A specific pseudoinverse is the so-called Moore-Penrose pseudoinverse: y y > n;m A = V Σ~ U 2 R where Σ−1 0 1 1 Σ~ y = r;m−r ; Σ−1 = diag ;:::; 0: 0n−r;r 0n−r;m−r σ1 σr Due to the zero blocks in Σ,~ Ay can be written compactly as y −1 > A = Vr Σ Ur : Fa18 15 / 32 Matrix properties via SVD Moore-Penrose pseudo-inverse: special cases If A is square and nonsingular, then Ay = A−1. m;n If A 2 R is full column rank, that is r = n ≤ m, then y > > A A = Vr Vr = VV = In; that is, Ay is a left inverse of A, and it has the explicit expression Ay = (A>A)−1A>: m;n If A 2 R is full row rank, that is r = m ≤ n, then y > > AA = Ur Ur = UU = Im; that is, Ay is a right inverse of A, and it has the explicit expression Ay = A>(AA>)−1: Fa18 16 / 32 Matrix properties via SVD Projectors : y > Matrix PR(A) = AA = Ur Ur is an orthogonal projector onto R(A). This means n that, for any y 2 R , the solution of problem min kz − yk2 z2R(A) ∗ is given by z = PR(A)y. : y Similarly, matrix PN (A>) = (Im − AA ) is an orthogonal projector onto R(A)? = N (A>). : y Matrix PN (A) = In − A A is an orthogonal projector onto N (A). : y ? > Matrix PN (A)? = A A is an orthogonal projector onto N (A) = R(A ). Fa18 17 / 32 Low-rank matrix approximation m;n Let A 2 R be a given matrix, with rank(A) = r > 0. We consider the problem of approximating A with a matrix of lower rank. In particular, we consider the following rank-constrained approximation problem 2 min kA − Ak k m;n F Ak 2R s.t.: rank(Ak ) = k; where 1 ≤ k ≤ r is given. Let r ~ > X > A = UΣV = σi ui vi i=1 be an SVD of A. An optimal solution of the above problem is simply obtained by truncating the previous summation to the k-th term, that is k X > Ak = σi ui vi : i=1 Fa18 18 / 32 Low-rank matrix approximation The ratio 2 2 2 kAk kF σ1 + ··· + σk ηk = 2 = 2 2 kAkF σ1 + ··· + σr indicates what fraction of the total variance (Frobenius norm) in A is explained by the rank k approximation of A. A plot of ηk as a function of k may give useful indications on a good rank level k at which to approximate A. ηk is related to the relative norm approximation error 2 2 2 kA − Ak kF σk+1 + ··· + σr ek = 2 = 2 2 = 1 − ηk : kAkF σ1 + ··· + σr Fa18 19 / 32 Minimum \distance" to rank deficiency m;n Suppose A 2 R , m ≥ n is full rank, i.e., rank(A) = n.
Load more

Recommended publications
  • New Algorithms in the Frobenius Matrix Algebra for Polynomial Root-Finding
    City University of New York (CUNY) CUNY Academic Works Computer Science Technical Reports CUNY Academic Works 2014 TR-2014006: New Algorithms in the Frobenius Matrix Algebra for Polynomial Root-Finding Victor Y. Pan Ai-Long Zheng How does access to this work benefit ou?y Let us know! More information about this work at: https://academicworks.cuny.edu/gc_cs_tr/397 Discover additional works at: https://academicworks.cuny.edu This work is made publicly available by the City University of New York (CUNY). Contact: [email protected] New Algoirthms in the Frobenius Matrix Algebra for Polynomial Root-finding ∗ Victor Y. Pan[1,2],[a] and Ai-Long Zheng[2],[b] Supported by NSF Grant CCF-1116736 and PSC CUNY Award 64512–0042 [1] Department of Mathematics and Computer Science Lehman College of the City University of New York Bronx, NY 10468 USA [2] Ph.D. Programs in Mathematics and Computer Science The Graduate Center of the City University of New York New York, NY 10036 USA [a] [email protected] http://comet.lehman.cuny.edu/vpan/ [b] [email protected] Abstract In 1996 Cardinal applied fast algorithms in Frobenius matrix algebra to complex root-finding for univariate polynomials, but he resorted to some numerically unsafe techniques of symbolic manipulation with polynomials at the final stages of his algorithms. We extend his work to complete the computations by operating with matrices at the final stage as well and also to adjust them to real polynomial root-finding. Our analysis and experiments show efficiency of the resulting algorithms. 2000 Math.
    [Show full text]
  • Subspace-Preserving Sparsification of Matrices with Minimal Perturbation
    Subspace-preserving sparsification of matrices with minimal perturbation to the near null-space. Part I: Basics Chetan Jhurani Tech-X Corporation 5621 Arapahoe Ave Boulder, Colorado 80303, U.S.A. Abstract This is the first of two papers to describe a matrix sparsification algorithm that takes a general real or complex matrix as input and produces a sparse output matrix of the same size. The non-zero entries in the output are chosen to minimize changes to the singular values and singular vectors corresponding to the near null-space of the input. The output matrix is constrained to preserve left and right null-spaces exactly. The sparsity pattern of the output matrix is automatically determined or can be given as input. If the input matrix belongs to a common matrix subspace, we prove that the computed sparse matrix belongs to the same subspace. This works with- out imposing explicit constraints pertaining to the subspace. This property holds for the subspaces of Hermitian, complex-symmetric, Hamiltonian, cir- culant, centrosymmetric, and persymmetric matrices, and for each of the skew counterparts. Applications of our method include computation of reusable sparse pre- conditioning matrices for reliable and efficient solution of high-order finite element systems. The second paper in this series [1] describes our open- arXiv:1304.7049v1 [math.NA] 26 Apr 2013 source implementation, and presents further technical details. Keywords: Sparsification, Spectral equivalence, Matrix structure, Convex optimization, Moore-Penrose pseudoinverse Email address: [email protected] (Chetan Jhurani) Preprint submitted to Computers and Mathematics with Applications October 10, 2018 1. Introduction We present and analyze a matrix-valued optimization problem formulated to sparsify matrices while preserving the matrix null-spaces and certain spe- cial structural properties.
    [Show full text]
  • Matrices and Linear Algebra
    Chapter 26 Matrices and linear algebra ap,mat Contents 26.1 Matrix algebra........................................... 26.2 26.1.1 Determinant (s,mat,det)................................... 26.2 26.1.2 Eigenvalues and eigenvectors (s,mat,eig).......................... 26.2 26.1.3 Hermitian and symmetric matrices............................. 26.3 26.1.4 Matrix trace (s,mat,trace).................................. 26.3 26.1.5 Inversion formulas (s,mat,mil)............................... 26.3 26.1.6 Kronecker products (s,mat,kron).............................. 26.4 26.2 Positive-definite matrices (s,mat,pd) ................................ 26.4 26.2.1 Properties of positive-definite matrices........................... 26.5 26.2.2 Partial order......................................... 26.5 26.2.3 Diagonal dominance.................................... 26.5 26.2.4 Diagonal majorizers..................................... 26.5 26.2.5 Simultaneous diagonalization................................ 26.6 26.3 Vector norms (s,mat,vnorm) .................................... 26.6 26.3.1 Examples of vector norms.................................. 26.6 26.3.2 Inequalities......................................... 26.7 26.3.3 Properties.......................................... 26.7 26.4 Inner products (s,mat,inprod) ................................... 26.7 26.4.1 Examples.......................................... 26.7 26.4.2 Properties.......................................... 26.8 26.5 Matrix norms (s,mat,mnorm) .................................... 26.8 26.5.1
    [Show full text]
  • A Logarithmic Minimization Property of the Unitary Polar Factor in The
    A logarithmic minimization property of the unitary polar factor in the spectral norm and the Frobenius matrix norm Patrizio Neff∗ Yuji Nakatsukasa† Andreas Fischle‡ October 30, 2018 Abstract The unitary polar factor Q = Up in the polar decomposition of Z = Up H is the minimizer over unitary matrices Q for both Log(Q∗Z) 2 and its Hermitian part k k sym (Log(Q∗Z)) 2 over both R and C for any given invertible matrix Z Cn×n and k * k ∈ any matrix logarithm Log, not necessarily the principal logarithm log. We prove this for the spectral matrix norm for any n and for the Frobenius matrix norm in two and three dimensions. The result shows that the unitary polar factor is the nearest orthogonal matrix to Z not only in the normwise sense, but also in a geodesic distance. The derivation is based on Bhatia’s generalization of Bernstein’s trace inequality for the matrix exponential and a new sum of squared logarithms inequality. Our result generalizes the fact for scalars that for any complex logarithm and for all z C 0 ∈ \ { } −iϑ 2 2 −iϑ 2 2 min LogC(e z) = log z , min Re LogC(e z) = log z . ϑ∈(−π,π] | | | | || ϑ∈(−π,π] | | | | || Keywords: unitary polar factor, matrix logarithm, matrix exponential, Hermitian part, minimization, unitarily invariant norm, polar decomposition, sum of squared logarithms in- equality, optimality, matrix Lie-group, geodesic distance arXiv:1302.3235v4 [math.CA] 2 Jan 2014 AMS 2010 subject classification: 15A16, 15A18, 15A24, 15A44, 15A45, 26Dxx ∗Corresponding author, Head of Lehrstuhl f¨ur Nichtlineare Analysis und Modellierung, Fakult¨at f¨ur Mathematik, Universit¨at Duisburg-Essen, Campus Essen, Thea-Leymann Str.
    [Show full text]
  • Perron–Frobenius Theorem for Matrices with Some Negative Entries
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Linear Algebra and its Applications 328 (2001) 57–68 www.elsevier.com/locate/laa Perron–Frobenius theorem for matrices with some negative entries Pablo Tarazaga a,∗,1, Marcos Raydan b,2, Ana Hurman c aDepartment of Mathematics, University of Puerto Rico, P.O. Box 5000, Mayaguez Campus, Mayaguez, PR 00681-5000, USA bDpto. de Computación, Facultad de Ciencias, Universidad Central de Venezuela, Ap. 47002, Caracas 1041-A, Venezuela cFacultad de Ingeniería y Facultad de Ciencias Económicas, Universidad Nacional del Cuyo, Mendoza, Argentina Received 17 December 1998; accepted 24 August 2000 Submitted by R.A. Brualdi Abstract We extend the classical Perron–Frobenius theorem to matrices with some negative entries. We study the cone of matrices that has the matrix of 1’s (eet) as the central ray, and such that any matrix inside the cone possesses a Perron–Frobenius eigenpair. We also find the maximum angle of any matrix with eet that guarantees this property. © 2001 Elsevier Science Inc. All rights reserved. Keywords: Perron–Frobenius theorem; Cones of matrices; Optimality conditions 1. Introduction In 1907, Perron [4] made the fundamental discovery that the dominant eigenvalue of a matrix with all positive entries is positive and also that there exists a correspond- ing eigenvector with all positive entries. This result was later extended to nonnegative matrices by Frobenius [2] in 1912. In that case, there exists a nonnegative dominant ∗ Corresponding author. E-mail addresses: [email protected] (P. Tarazaga), [email protected] (M.
    [Show full text]
  • Logarithmic Growth and Frobenius Filtrations for Solutions of P-Adic
    Logarithmic growth and Frobenius filtrations for solutions of p-adic differential equations Bruno Chiarellotto∗ Nobuo Tsuzuki† Version of October 24, 2006 Abstract For a ∇-module M over the ring K[[x]]0 of bounded functions we define the notion of special and generic log-growth filtrations. Moreover, if M admits also a ϕ-structure then it is endowed also with generic and special Frobenius slope filtrations. We will show that in the case of M a ϕ-∇-module of rank 2, the two filtrations coincide. We may then extend such a result also for a module defined on an open set of the projective line. This generalizes previous results of Dwork about the coincidences between the log-growth of the solutions of hypergeometric equations and the Frobenius slopes. Contents 1 Log-growth of solutions 7 2 ϕ-modules over a p-adically complete discrete valuation field 9 3 Log-growth filtration over E and E 15 4 Generic and special log-growth filtrations 19 5 Examples 21 6 Generic and special Frobenius slope filtrations 26 7 Comparison between log-growth filtration and Frobenius filtration. The rank 2 case 29 Introduction The meaningful connections in the p-adic setting are those with a good radius of conver- gence for their solutions or horizontal sections. In general this condition is referred as the condition of solvability and it is granted, for example, under the hypotheses of having a Frobenius structure. It has been noticed long time ago that the solutions do not have in ∗[email protected] †[email protected] 1 general the same growth in having their good radius of convergence.
    [Show full text]
  • Arxiv:1511.08154V1 [Math.NT] 25 Nov 2015 M-412.Tescn Uhrswr a Upre Yten the by Supported Was Work Author’S Second the DMS-1401224
    NOTES ON CARDINAL’S MATRICES JEFFREY C. LAGARIAS AND DAVID MONTAGUE ABSTRACT. These notes are motivated by the work of Jean-Paul Cardinal on certain symmetric matrices related to the Mertens function. He showed that certain norm bounds on his matrices implied the Riemann hypothesis. Using a different matrix norm we show an equivalence of the Riemann hypothesis to suitable norm bounds on his Mertens matrices in the new norm. We also specify a deformed version of his Mertens matrices that unconditionally satisfy a norm bound of the same strength as this Riemann hypothesis bound. 1. INTRODUCTION In 2010 Jean-Paul Cardinal [3] introduced for each n 1 two symmetric integer ≥ matrices n and n constructed using a set of “approximate divisors" of n, defined below. EachU of theseM matrices can be obtained from the other. Both matrices are s s matrices, where s = s(n) is about 2√n. Here s(n) counts the number of distinct values× taken by n when k runs from 1 to n. These values comprise the approximate divisors, ⌊ k ⌋ and we label them k1 =1,k2, ..., ks = n in increasing order. We start with defining Cardinal’s basic matrix n attached to an integer n. The (i, j)- n U th entry of n is . One can show that such matrices take value 1 on the anti- U ⌊ kikj ⌋ diagonal, and are 0 at all entries below the antidiagonal, consequently it has determinant 1. (The antidiagonal entries are the (i, j)-entries with i + j = s +1, numbering rows and± columns from 1 to s.) All entries above the antidiagonal are positive.
    [Show full text]
  • A Absolute Uncertainty Or Error, 414 Absorbing Markov Chains, 700
    Index Bauer–Fike bound, 528 A beads on a string, 559 Bellman, Richard, xii absolute uncertainty or error, 414 Beltrami, Eugenio, 411 absorbing Markov chains, 700 Benzi, Michele, xii absorbing states, 700 Bernoulli, Daniel, 299 addition, properties of, 82 Bessel, Friedrich W., 305 additive identity, 82 Bessel’s inequality, 305 additive inverse, 82 best approximate inverse, 428 adjacency matrix, 100 biased estimator, 446 adjoint, 84, 479 binary representation, 372 adjugate, 479 Birkhoff, Garrett, 625 affine functions, 89 Birkhoff’s theorem, 702 affine space, 436 bit reversal, 372 algebraic group, 402 bit reversing permutation matrix, 381 algebraic multiplicity, 496, 510 block diagonal, 261–263 amplitude, 362 rank of, 137 Anderson-Duffin formula, 441 using real arithmetic, 524 Anderson, Jean, xii block matrices, 111 Anderson, W. N., Jr., 441 determinant of, 475 angle, 295 linear operators, 392 canonical, 455 block matrix multiplication, 111 between complementary spaces, 389, 450 block triangular, 112, 261–263 maximal, 455 determinants, 467 principal, 456 eigenvalues of, 501 between subspaces, 450 Bolzano–Weierstrass theorem, 670 annihilating polynomials, 642 Boolean matrix, 679 aperiodic Markov chain, 694 bordered matrix, 485 Arnoldi’s algorithm, 653 eigenvalues of, 552 Arnoldi, Walter Edwin, 653 branch, 73, 204 associative property Brauer, Alfred, 497 of addition, 82 Bunyakovskii, Victor, 271 of matrix multiplication, 105 of scalar multiplication, 83 C asymptotic rate of convergence, 621 augmented matrix, 7 cancellation law, 97 Autonne, L., 411 canonical angles, 455 canonical form, reducible matrix, 695 B Cantor, Georg, 597 Cauchy, Augustin-Louis, 271 back substitution, 6, 9 determinant formula, 484 backward error analysis, 26 integral formula, 611 backward triangle inequality, 273 Cauchy–Bunyakovskii–Schwarz inequality, 272 band matrix, 157 Cauchy–Goursat theorem, 615 Bartlett, M.
    [Show full text]
  • Computing Zeta Functions of Nondegenerate Hypersurfaces with Few Monomials
    Submitted exclusively to the London Mathematical Society doi:10.1112/0000/000000 Computing zeta functions of nondegenerate hypersurfaces with few monomials Steven Sperber and John Voight Abstract Using the cohomology theory of Dwork, as developed by Adolphson and Sperber, we exhibit a deterministic algorithm to compute the zeta function of a nondegenerate hypersurface defined over a finite field. This algorithm is particularly well-suited to work with polynomials in small characteristic that have few monomials (relative to their dimension). Our method covers toric, affine, and projective hypersurfaces and also can be used to compute the L-function of an exponential sum. a Let p be prime and let Fq be a finite field with q = p elements. Let V be a variety defined over Fq, described by the vanishing of a finite set of polynomial equations with coefficients in Fq. We encode the number of points #V (Fqr ) on V over the extensions Fqr of Fq in an exponential generating series, called the zeta function of V : 1 ! X T r Z(V;T ) = exp #V ( r ) 2 1 + T [[T ]]: Fq r Z r=1 The zeta function Z(V;T ) is a rational function in T , a fact first proved using p-adic methods by Dwork [16, 17]. The algorithmic problem of computing Z(V;T ) efficiently is of significant foundational interest, owing to many practical and theoretical applications (see e.g. Wan [58] for a discussion). From a modern point of view, we consider Z(V;T ) cohomologically: we build a p-adic cohomology theory that functorially associates to V certain vector spaces Hi over a p-adic field K, each equipped with a (semi-)linear operator Frobi, such that Z(V;T ) is given by an i alternating product of the characteristic polynomials of Frobi acting on the spaces H .
    [Show full text]
  • A Simple Iterative Method for Exact Solution of Systems of Linear Algebraic Equations Albert Iskhakov1, Sergey Skovpen2
    American Research Journal of Mathematics ISSN: 2378-704X Volume 5, Issue 1, 3 Pages Research Article Open Access A Simple Iterative Method for Exact Solution of Systems of Linear Algebraic Equations Albert Iskhakov1, Sergey Skovpen2 2 1 Department of Innovation Development, ‘VNIIEM2 Corporation’ JC, Moscow, Russia. Department of Ship Electricity and1 Automatics, Northern (Arctic) Federal University, Severodvinsk, Russia. Abstract: [email protected], [email protected] We present for the first time a theorem (with proof) of solving a system of linear algebraic equations (SLAE) in a finite number of iterations with a stationary matrix. The system is transformed such that the spectrum of the matrix to be unit. Splitting the matrix gives a nilpotent matrix of the iteration system that generatesKeywords: an exact solution of SLAE for a number of iterations not exceeding the dimension of the system. Simple Iterative Method, System of Linear Algebraic Equations (SLAE), Exact Solution, Nilpotent Matrix,Introduction Unipotent Matrix, Stationary Matrix, Finite Iterative Process equation for solving a system of linear algebraic equations (SLAE) is approximate because it does not give the The mathematical community considers that a simple iterative method expressed as a linear difference exact answer for a finite number of iterations. The statements on this matter can be found in [1-4]. However, in control theory, for a linear discrete system described by the same equation, a method for transferring the system to a given state in a finite number of steps has been known for a long time [5-7]. A method to findthe exact solution of SLAE in a finite number of iterations is reported for the first time.
    [Show full text]
  • Quasi-Rational Canonical Forms of a Matrix Over a Number Field
    Advances in Linear Algebra & Matrix Theory, 2018, 8, 1-10 http://www.scirp.org/journal/alamt ISSN Online: 2165-3348 ISSN Print: 2165-333X Quasi-Rational Canonical Forms of a Matrix over a Number Field Zhudeng Wang*, Qing Wang, Nan Qin School of Mathematics and Statistics, Yancheng Teachers University, Yancheng, China How to cite this paper: Wang, Z.D., Wang, Abstract Q. and Qin, N. (2018) Quasi-Rational Ca- nonical Forms of a Matrix over a Number A matrix is similar to Jordan canonical form over the complex field and the Field. Advances in Linear Algebra & Matrix rational canonical form over a number field, respectively. In this paper, we fur- Theory, 8, 1-10. ther study the rational canonical form of a matrix over any number field. We https://doi.org/10.4236/alamt.2018.81001 firstly discuss the elementary divisors of a matrix over a number field. Then, we Received: October 28, 2017 give the quasi-rational canonical forms of a matrix by combining Jordan and Accepted: January 7, 2018 the rational canonical forms. Finally, we show that a matrix is similar to its Published: January 10, 2018 quasi-rational canonical forms over a number field. Copyright © 2018 by authors and Keywords Scientific Research Publishing Inc. This work is licensed under the Creative Matrix, Jordan Canonical Form, Rational Canonical Form, Commons Attribution International Quasi-Rational Canonical Form License (CC BY 4.0). http://creativecommons.org/licenses/by/4.0/ Open Access 1. Introduction A matrix is similar to Jordan canonical form over the complex field and the ra- tional canonical form over a number field, respectively.
    [Show full text]
  • The Computation of Matrix Function in Particular the Matrix Expotential
    The Computation of Matrix Functions in Particular, The Matrix Exponential By SYED MUHAMMAD GHUFRAN A thesis submitted to The University of Birmingham for the Degree of Master of Philosophy School of Mathematics The University of Birmingham October, 2009 University of Birmingham Research Archive e-theses repository This unpublished thesis/dissertation is copyright of the author and/or third parties. The intellectual property rights of the author or third parties in respect of this work are as defined by The Copyright Designs and Patents Act 1988 or as modified by any successor legislation. Any use made of information contained in this thesis/dissertation must be in accordance with that legislation and must be properly acknowledged. Further distribution or reproduction in any format is prohibited without the permission of the copyright holder. i Acknowledgements I am extremely grateful to my supervisor, Professor Roy Mathias, for sharing his knowledge, excellent guidance, patience and advice throughout this dissertation. Without his support it would not be possible in short span of time. I wish to thank Prof C.Parker , and Mrs J Lowe for their magnificent support, professional advice and experience to overcome my problems. I am grateful to my colleagues Ali Muhammad Farah, She Li and Dr. Jamal ud Din for their help and support, and my cousins Faqir Hussain, Faizan ur Rasheed and my uncle Haji Aziz and my close friend Shah Jehan for his kindness. I am also very grateful to my parents, brothers, sisters, my wife for their support and trust throughout these long hard times. Further I would like to thank my family and especially to my kids and my nephew Abdul Muqeet how missed me a lot.
    [Show full text]