Nonsmooth Riemannian Optimization for Matrix Completion and Eigenvalue Problems

Total Page:16

File Type:pdf, Size:1020Kb

Nonsmooth Riemannian Optimization for Matrix Completion and Eigenvalue Problems École polytechnique fédérale de Lausanne Master Project Nonsmooth Riemannian optimization for matrix completion and eigenvalue problems Author: Supervisor: Francesco Nobili Prof. Daniel Kressner June 23, 2017 2 Contents 1 Introduction 5 2 Geometrical background for Riemannian optimization 9 2.1 First order geometry . .9 2.2 Riemannian geometry . 13 2.2.1 Riemannian steepest descent . 14 2.3 Distances on manifolds and geodesics . 14 2.4 The exponential map and retractions . 16 2.4.1 Convergence Analysis . 18 2.5 Vectors Transport . 19 2.5.1 Riemannian conjugate gradients . 20 3 Geometric CG for Matrix Completion 23 3.1 Different formulations . 23 3.2 The manifold Mk ............................... 27 3.3 The proposed method . 29 3.3.1 Implementation aspects . 30 3.4 Error Analysis . 31 3.4.1 Numerical simulations . 31 4 Nonsmooth Riemannian Optimization 37 4.1 Overview . 37 4.1.1 Subdifferential for Convex functions . 38 4.1.2 Generalized gradients for Lipschitz functions . 40 4.2 Riemannian subgradients . 41 4.2.1 Convex and Lipschitz maps . 42 4.2.2 Approximating the subdifferential . 44 4.2.3 Implementation aspects . 45 4.3 -subdifferential method . 47 4.4 An example of optimization on Sn−1 .................... 48 4.4.1 Numerical Results . 50 3 5 Sparse Rayleigh quotient minimization 51 5.1 The eigenvalue problem . 51 5.2 Sparse eigenvectors . 55 5.2.1 Localized spectral projectors . 56 5.2.2 Generating process . 57 5.3 Weighted Rayleigh quotient sparse minimization . 58 n 5.3.1 The manifold Stp ........................... 59 5.3.2 Sparse eigenvector on Sn−1 ..................... 59 n 5.3.3 Sparse eigenvectors on Stp ...................... 61 5.4 Nonsmooth Matrix Completion . 65 5.4.1 Further work directions . 66 Bibliography 67 4 Chapter 1 Introduction In numerical linear algebra, optimization problems arise from very natural issue, such as solving a linear system or eigenvalue problems. In this Thesis, we focus on con- strained optimization problems where the constraints identify an Euclidean embedded submanifold. In such cases, assuming a Riemannian structure of the manifold M al- lows to switch to an unconstrained optimization problem whose active set becomes the whole set M. Smooth Riemannian optimization has been largely investigated by researchers in the recent years. The most important results are gathered, for instance, in the monograph [1]. The Riemannian approach is helpful when optimizing with con- straints difficult to deal with. Consider for example the cost functions defined on the matrix manifolds m×n n n×p > Mk := {X ∈ R : rank(X) = k}, Stp := {X ∈ R : X X = Ip}. (1.0.1) Nevertheless, a whole theoretical backup coming from Riemannian Geometry is needed in order to design optimization process for a map f : M → R. One can also ask how hard is to optimize convex or Lipschitz maps defined on Riemannian manifold. Re- cently, nonsmooth optimization on Riemannian manifolds has been investigated in [29, 13, 17, 19]. In this Thesis we deal closely with the sets (1.0.1) as they are the natural setting for many issues arising in Linear Algebra. We consider smooth and nonsmooth formula- tions of two main problems and propose algorithms and numerical simulations. Matrix Completion The matrix completion problem is a numerical linear algebra issue that consists in completing in a unique way a partially observed matrix. Suppose we observe a matrix A on a subset of its entries. The goal is to complete the unknown entries to recover uniquely the original matrix A. The challenge lies in the set’s size of the observed entries; incredibly, a whole matrix can be recovered from just a small knowledge of the original data. m×n Formally, let A be in R and suppose that we observe A on a subset Ω of the 5 complete set of entries {1, ..., m} × {1, ..., n}. We denote the cardinality of this set by |Ω|. It is convenient to define the orthogonal projector PΩ onto the set of indices Ω as following ( m×n m×n Xi,j, if (i, j) ∈ Ω, PΩ : R → R ,Xi,j 7→ 0, otherwise. We denote AΩ = PΩ(A) the known entries of the matrix A. The action of PΩ is schematized in Figure 1.1. The matrix completion problem consists in finding a matrix PΩ Figure 1.1: Matrix completion problem: the action of the projector operator PΩ. In black the entries set to zero. X satisfying PΩ(X) = AΩ. In this Thesis, we assume an a priori knowledge of the solution’s rank and we consider on Mk 1 2 min ||PΩ(X − A)||F . X∈Mk 2 The problem is robust but unfortunately it cannot deal with localized type of noise. This is often the case in application and one prefers to include convex penalties in the cost function to deal with the presence of outliers. For this purpose, we investigate a generalization proposed by [19, 17] in the nonsmooth Riemannian setting for the completion of matrices. The eigenvalue problem The eigenvalue problem is the cornerstone of every linear algebra course and, despite its age, it still occupies a central position in the ongoing numerical research. For a good introduction we refer to the monograph [16]. n×n Formally, given a matrix A ∈ R we are interested in the eigenpairs (λ, v) satisfying Av = λv. In the 20th century, for the first time iterative methods to approximate an eigenpair were proposed. The most basic are power method and inverse iteration for the biggest 6 and smallest eigenvalue, respectively. While, to approximate multiple eigenvectors at the same time, we can rely instead on subspace iterations. For a more efficient approach, one prefers to choose a Krylov subspace method building the set 2 r−1 Kr(A, b) = span{b, Ab, A v, ..., A b}, to then perform a Ritz extraction on a smaller size matrix and obtain the eigenpairs of A. In recent years, the bigger computational capacity has challenged researchers to design algorithms for higher order eigenvalue problem. In this Thesis, we approach the eigenvalue problem by means of the Riemannian op- timization of the Rayleigh quotient > > −1 ρA(X) = trace(X AX(X X) ). (1.0.2) We show how the local minima of the map are related to the eigenvectors of a symmetric matrix A. As a warm up, we consider a Riemannian steepest descent approach on n−1 the unit sphere S to approximate the smallest eigenpair (λmin, v). Finally, we investigate the eigenvalue problem for structured symmetric matrices A that admits localized basis of eigenvectors. The goal is to propose a penalized formulation of (1.0.2) X>AX λ|| X || min n trace( ) + vec( ) `1 X∈Stp to seek a sparse basis for p-eigenvectors with a nonsmooth Riemannian approach in n the manifold Stp . Outline of the Thesis The Thesis is structured as follows. In Chapter 2, we recall the most important tools in differential and Riemannian geom- etry. In Chapter 3, we propose a CG Riemannian method with a special emphasis on the matrix completion problem. Several numerical results are discussed for the com- pletion of different low-rank matrices and an application in computational imaging is proposed. In Chapter 4, we discuss the generalization of certain notions, coming from convex analysis, to the Riemannian setting. A numerical approach based on a subd- ifferential set is proposed. Finally, in Chapter 5, nonsmooth strategies are applied to the eigenvalue problem and numerical results are shown. We conclude the Thesis with some nonsmooth formulations for the matrix completion problem. All the numerical outputs of this work are obtained in MatLab. 7 8 Chapter 2 Geometrical background for Riemannian optimization n In this Chapter, we describe the properties of a manifold M ⊂ R in order to under- stand a Riemannian geometric descent method. We will not recall the basic ingredients of differential geometry such as charts, atlas or smooth maps except for the purpose of fixing notations with the reader. On the other hand, we introduce basic theory in differential and Riemannian geometry such as tangent spaces, Riemannian metric, geodesics and retractions. Throughout this part, we will denote by M, N general man- ifold, (U, ψ) a general chart and f : M → R a smooth map in the sense of manifolds. Moreover, we recall that a an embedded submanifold M ⊂ N is a immersed manifold for which the inclusion map M → N is a topological embedding, i.e. the subspace topology of M coincides with the manifold topology. 2.1 First order geometry The aim of this section is to introduce the ingredients of differential geometry to properly set the basis for a simple descent Riemannian optimization method. In un- constrained optimization, a function is minimized step by step looking for suitable line searches containing successive approximations: on manifolds, due to the lack of a lin- ear structure, descent directions live outside the active set. The natural environment to generalize these concepts is the tangent space. One way to introduce the tangent space of a manifold M at a point x is by means of smooth curves γ : R → M. Let Fx(M) be the set of smooth maps f : M → R around x. We define a tangent vector to the curve γ the mapping γ˙ (0) from Fx(M) to R df(γ(t)) γ˙ (0)f := , for every f ∈ Fx(M). dt t=0 9 We are ready to define a tangent vector to a manifold. Definition 2.1.1. We define a tangent vector at point x, denoted by ξx, the mapping Fx(M) → R such that there exists a curve γ on M with γ(0) = x satisfying df(γ(t)) ξxf :=γ ˙ (0)f = .
Recommended publications
  • Fast Singular Value Thresholding Without Singular Value Decomposition∗
    METHODS AND APPLICATIONS OF ANALYSIS. c 2013 International Press Vol. 20, No. 4, pp. 335–352, December 2013 002 FAST SINGULAR VALUE THRESHOLDING WITHOUT SINGULAR VALUE DECOMPOSITION∗ JIAN-FENG CAI† AND STANLEY OSHER‡ Abstract. Singular value thresholding (SVT) is a basic subroutine in many popular numerical schemes for solving nuclear norm minimization that arises from low-rank matrix recovery prob- lems such as matrix completion. The conventional approach for SVT is first to find the singular value decomposition (SVD) and then to shrink the singular values. However, such an approach is time-consuming under some circumstances, especially when the rank of the resulting matrix is not significantly low compared to its dimension. In this paper, we propose a fast algorithm for directly computing SVT for general dense matrices without using SVDs. Our algorithm is based on matrix Newton iteration for matrix functions, and the convergence is theoretically guaranteed. Numerical experiments show that our proposed algorithm is more efficient than the SVD-based approaches for general dense matrices. Key words. Low rank matrix, nuclear norm minimization, matrix Newton iteration. AMS subject classifications. 65F30, 65K99. 1. Introduction. Singular value thresholding (SVT) introduced in [7] is a key subroutine in many popular numerical schemes (e.g. [7, 12, 13, 52, 54, 66]) for solving nuclear norm minimization that arises from low-rank matrix recovery problems such as matrix completion [13–15,60]. Let Y Rm×n be a given matrix, and Y = UΣV T be its singular value decomposition (SVD),∈ where U and V are orthonormal matrices and Σ = diag(σ1, σ2,...,σs) is the diagonal matrix with diagonals being the singular values of Y .
    [Show full text]
  • A Simplex-Type Voronoi Algorithm Based on Short Vector Computations of Copositive Quadratic Forms
    Simons workshop Lattices Geometry, Algorithms and Hardness Berkeley, February 21st 2020 A simplex-type Voronoi algorithm based on short vector computations of copositive quadratic forms Achill Schürmann (Universität Rostock) based on work with Mathieu Dutour Sikirić and Frank Vallentin ( for Q n positive definite ) Perfect Forms 2 S>0 DEF: min(Q)= min Q[x] is the arithmetical minimum • x n 0 2Z \{ } Q is uniquely determined by min(Q) and Q perfect • , n MinQ = x Z : Q[x]=min(Q) { 2 } V(Q)=cone xxt : x MinQ is Voronoi cone of Q • { 2 } (Voronoi cones are full dimensional if and only if Q is perfect!) THM: Voronoi cones give a polyhedral tessellation of n S>0 and there are only finitely many up to GL n ( Z ) -equivalence. Voronoi’s Reduction Theory n t GLn(Z) acts on >0 by Q U QU S 7! Georgy Voronoi (1868 – 1908) Task of a reduction theory is to provide a fundamental domain Voronoi’s algorithm gives a recipe for the construction of a complete list of such polyhedral cones up to GL n ( Z ) -equivalence Ryshkov Polyhedron The set of all positive definite quadratic forms / matrices with arithmeticalRyshkov minimum Polyhedra at least 1 is called Ryshkov polyhedron = Q n : Q[x] 1 for all x Zn 0 R 2 S>0 ≥ 2 \{ } is a locally finite polyhedron • R is a locally finite polyhedron • R Vertices of are perfect forms Vertices of are• perfect R • R 1 n n ↵ (det(Q + ↵Q0)) is strictly concave on • 7! S>0 Voronoi’s algorithm Voronoi’s Algorithm Start with a perfect form Q 1.
    [Show full text]
  • Combinatorial Optimization, Packing and Covering
    Combinatorial Optimization: Packing and Covering G´erard Cornu´ejols Carnegie Mellon University July 2000 1 Preface The integer programming models known as set packing and set cov- ering have a wide range of applications, such as pattern recognition, plant location and airline crew scheduling. Sometimes, due to the spe- cial structure of the constraint matrix, the natural linear programming relaxation yields an optimal solution that is integer, thus solving the problem. Sometimes, both the linear programming relaxation and its dual have integer optimal solutions. Under which conditions do such integrality properties hold? This question is of both theoretical and practical interest. Min-max theorems, polyhedral combinatorics and graph theory all come together in this rich area of discrete mathemat- ics. In addition to min-max and polyhedral results, some of the deepest results in this area come in two flavors: “excluded minor” results and “decomposition” results. In these notes, we present several of these beautiful results. Three chapters cover min-max and polyhedral re- sults. The next four cover excluded minor results. In the last three, we present decomposition results. We hope that these notes will encourage research on the many intriguing open questions that still remain. In particular, we state 18 conjectures. For each of these conjectures, we offer $5000 as an incentive for the first correct solution or refutation before December 2020. 2 Contents 1Clutters 7 1.1 MFMC Property and Idealness . 9 1.2 Blocker . 13 1.3 Examples .......................... 15 1.3.1 st-Cuts and st-Paths . 15 1.3.2 Two-Commodity Flows . 17 1.3.3 r-Cuts and r-Arborescences .
    [Show full text]
  • Quadratic Forms and Their Applications
    Quadratic Forms and Their Applications Proceedings of the Conference on Quadratic Forms and Their Applications July 5{9, 1999 University College Dublin Eva Bayer-Fluckiger David Lewis Andrew Ranicki Editors Published as Contemporary Mathematics 272, A.M.S. (2000) vii Contents Preface ix Conference lectures x Conference participants xii Conference photo xiv Galois cohomology of the classical groups Eva Bayer-Fluckiger 1 Symplectic lattices Anne-Marie Berge¶ 9 Universal quadratic forms and the ¯fteen theorem J.H. Conway 23 On the Conway-Schneeberger ¯fteen theorem Manjul Bhargava 27 On trace forms and the Burnside ring Martin Epkenhans 39 Equivariant Brauer groups A. FrohlichÄ and C.T.C. Wall 57 Isotropy of quadratic forms and ¯eld invariants Detlev W. Hoffmann 73 Quadratic forms with absolutely maximal splitting Oleg Izhboldin and Alexander Vishik 103 2-regularity and reversibility of quadratic mappings Alexey F. Izmailov 127 Quadratic forms in knot theory C. Kearton 135 Biography of Ernst Witt (1911{1991) Ina Kersten 155 viii Generic splitting towers and generic splitting preparation of quadratic forms Manfred Knebusch and Ulf Rehmann 173 Local densities of hermitian forms Maurice Mischler 201 Notes towards a constructive proof of Hilbert's theorem on ternary quartics Victoria Powers and Bruce Reznick 209 On the history of the algebraic theory of quadratic forms Winfried Scharlau 229 Local fundamental classes derived from higher K-groups: III Victor P. Snaith 261 Hilbert's theorem on positive ternary quartics Richard G. Swan 287 Quadratic forms and normal surface singularities C.T.C. Wall 293 ix Preface These are the proceedings of the conference on \Quadratic Forms And Their Applications" which was held at University College Dublin from 5th to 9th July, 1999.
    [Show full text]
  • A Framework for Efficient Execution of Matrix Computations
    A Framework for Efficient Execution of Matrix Computations Doctoral Thesis May 2006 Jos´e Ram´on Herrero Advisor: Prof. Juan J. Navarro UNIVERSITAT POLITECNICA` DE CATALUNYA Departament D'Arquitectura de Computadors To Joan and Albert my children To Eug`enia my wife To Ram´on and Gloria my parents Stillicidi casus lapidem cavat Lucretius (c. 99 B.C.-c. 55 B.C.) De Rerum Natura1 1Continual dropping wears away a stone. Titus Lucretius Carus. On the nature of things Abstract Matrix computations lie at the heart of most scientific computational tasks. The solution of linear systems of equations is a very frequent operation in many fields in science, engineering, surveying, physics and others. Other matrix op- erations occur frequently in many other fields such as pattern recognition and classification, or multimedia applications. Therefore, it is important to perform matrix operations efficiently. The work in this thesis focuses on the efficient execution on commodity processors of matrix operations which arise frequently in different fields. We study some important operations which appear in the solution of real world problems: some sparse and dense linear algebra codes and a classification algorithm. In particular, we focus our attention on the efficient execution of the following operations: sparse Cholesky factorization; dense matrix multipli- cation; dense Cholesky factorization; and Nearest Neighbor Classification. A lot of research has been conducted on the efficient parallelization of nu- merical algorithms. However, the efficiency of a parallel algorithm depends ultimately on the performance obtained from the computations performed on each node. The work presented in this thesis focuses on the sequential execution on a single processor.
    [Show full text]
  • Zero-Error Slepian-Wolf Coding of Confined Correlated Sources With
    Zero-error Slepian-Wolf Coding of Confined- Correlated Sources with Deviation Symmetry Rick Ma∗and Samuel Cheng† October 31, 2018 Abstract In this paper, we use linear codes to study zero-error Slepian-Wolf coding of a set of sources with deviation symmetry, where the sources are generalization of the Hamming sources over an arbitrary field. We extend our previous codes, Generalized Hamming Codes for Multiple Sources, to Matrix Partition Codes and use the latter to efficiently compress the target sources. We further show that every perfect or linear-optimal code is a Matrix Partition Code. We also present some conditions when Matrix Partition Codes are perfect and/or linear-optimal. Detail discussions of Matrix Partition Codes on Hamming sources are given at last as examples. 1 Introduction Slepian-Wolf (SW) Coding or Slepian-Wolf problem refers to separate encod- ing of multiple correlated sources but joint lossless decoding of the sources [1]. Since then, many researchers have looked into ways to implement SW cod- ing efficiently. Noticeably, Wyner was the first who realized that linear coset codes can be used to tackle the problem [2]. Essentially, considering the source from each terminal as a column vector, the encoding output will simply be the multiple of a “fat”1 coding matrix and the input vector. The approach was popularized by Pradhan et al. more than two decades later [3]. Practical syndrome-based schemes for S-W coding using channel codes have been further studied in [4, 5, 6, 7, 8, 9, 10, 11, 12]. arXiv:1308.0632v1 [cs.IT] 2 Aug 2013 Unlike many prior works focusing on near-lossless compression, in this work we consider true lossless compression (zero-error reconstruction) in which sources are always recovered losslessly [13, 14, 15, 16, 17].
    [Show full text]
  • Contents September 1
    Contents September 1 : Examples 2 September 3 : The Gessel-Lindstr¨om-ViennotLemma 3 September 15 : Parametrizing totally positive unipotent matrices { Part 1 6 September 17 : Parametrizing totally positive unipotent matrices { part 2 7 September 22 : Introduction to the 0-Hecke monoid 9 September 24 : The 0-Hecke monoid continued 11 September 29 : The product has the correct ranks 12 October 1 : Bruhat decomposition 14 October 6 : A unique Bruhat decomposition 17 October 8: B−wB− \ N − + as a manifold 18 October 13: Grassmannians 21 October 15: The flag manifold, and starting to invert the unipotent product 23 October 20: Continuing to invert the unipotent product 28 October 22 { Continuing to invert the unipotent product 30 October 27 { Finishing the inversion of the unipotent product 32 October 29 { Chevalley generators in GLn(R) 34 November 5 { LDU decomposition, double Bruhat cells, and total positivity for GLn(R) 36 November 10 { Kasteleyn labelings 39 November 12 { Kasteleyn labellings continued 42 November 17 { Using graphs in a disc to parametrize the totally nonnegative Grassmannian 45 November 19 { cyclic rank matrices 45 December 1 { More on cyclic rank matrices 48 December 3 { Bridges and Chevalley generators 51 December 8 { finishing the proof 55 1 2 September 1 : Examples We write [m] = f1; 2; : : : ; mg. Given an m × n matrix M, and subsets I =⊆ [m] and I J ⊆ [n] with #(I) = #(J), we define ∆J (M) = det(Mij)i2I; j2J , where we keep the elements of I and the elements of J in the same order. For example, 13 M12 M15 ∆25(M) = det : M32 M35 I The ∆J (M) are called the minors of M.
    [Show full text]
  • MIT 18.06 Linear Algebra, Spring 2005 Transcript – Lecture 5
    MIT OpenCourseWare http://ocw.mit.edu 18.06 Linear Algebra, Spring 2005 Please use the following citation format: Gilbert Strang, 18.06 Linear Algebra, Spring 2005. (Massachusetts Institute of Technology: MIT OpenCourseWare). http://ocw.mit.edu (accessed MM DD, YYYY). License: Creative Commons Attribution- Noncommercial-Share Alike. Note: Please use the actual date you accessed this material in your citation. For more information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms MIT OpenCourseWare http://ocw.mit.edu 18.06 Linear Algebra, Spring 2005 Transcript – Lecture 5 Okay. This is lecture five in linear algebra. And, it will complete this chapter of the book. So the last section of this chapter is two point seven that talks about permutations, which finished the previous lecture, and transposes, which also came in the previous lecture. There's a little more to do with those guys, permutations and transposes. But then the heart of the lecture will be the beginning of what you could say is the beginning of linear algebra, the beginning of real linear algebra which is seeing a bigger picture with vector spaces -- not just vectors, but spaces of vectors and sub-spaces of those spaces. So we're a little ahead of the syllabus, which is good, because we're coming to the place where, there's a lot to do. Okay. So, to begin with permutations. Can I just -- so these permutations, those are matrices P and they execute row exchanges. And we may need them. We may have a perfectly good matrix, a perfect matrix A that's invertible that we can solve A x=b, but to do it -- I've got to allow myself that extra freedom that if a zero shows up in the pivot position I move it away.
    [Show full text]
  • Voronoi's Algorithm
    ICERM Conference on Computational Challenges in the Theory of Lattices Providence, April 2018 Variations and Applications of Voronoi’s algorithm Achill Schürmann (Universität Rostock) ( based on work with Mathieu Dutour Sikiric and Frank Vallentin ) PRELUDE Voronoi’s Algorithm - classically - Lattices and Quadratic Forms Lattices and Quadratic Forms Lattices and Quadratic Forms Reduction Theory for positive definite quadratic forms n t GLn(Z) acts on by Q U QU S>0 7! Task of a reduction theory is to provide a fundamental domain Classical reductions were obtained by Lagrange, Gauß, Korkin and Zolotareff, Minkowski and others… All the same for n = 2 : Voronoi’s reduction idea Georgy Voronoi (1868 – 1908) Observation: The fundamental domain can be obtained from polyhedral cones that are spanned by rank-1 forms only Voronoi’s reduction idea Georgy Voronoi (1868 – 1908) Observation: The fundamental domain can be obtained from polyhedral cones that are spanned by rank-1 forms only Voronoi’s algorithm gives a recipe for the construction of a complete list of such polyhedral cones up to GL n ( Z ) -equivalence Perfect Forms Perfect Forms DEF: min(Q)= min Q[x] is the arithmetical minimum x n 0 2Z \{ } Perfect Forms DEF: min(Q)= min Q[x] is the arithmetical minimum x n 0 2Z \{ } Q is uniquely determined by min(Q) and n DEF: Q >0 perfect 2 S , n MinQ = x Z : Q[x]=min(Q) { 2 } Perfect Forms DEF: min(Q)= min Q[x] is the arithmetical minimum x n 0 2Z \{ } Q is uniquely determined by min(Q) and n DEF: Q >0 perfect 2 S , n MinQ = x Z : Q[x]=min(Q) { 2 } DEF: For Q n , its Voronoi cone is (Q)=cone xxt : x MinQ 2 S>0 V { 2 } Perfect Forms DEF: min(Q)= min Q[x] is the arithmetical minimum x n 0 2Z \{ } Q is uniquely determined by min(Q) and n DEF: Q >0 perfect 2 S , n MinQ = x Z : Q[x]=min(Q) { 2 } DEF: For Q n , its Voronoi cone is (Q)=cone xxt : x MinQ 2 S>0 V { 2 } THM: Voronoi cones give a polyhedral tessellation of n S>0 and there are only finitely many up to GL n ( Z ) -equivalence.
    [Show full text]
  • On the Inverting of a General Heptadiagonal Matrix
    British Journal of Applied Science & Technology 18(5): 1-12, 2016; Article no.BJAST.31213 ISSN: 2231-0843, NLM ID: 101664541 SCIENCEDOMAIN international www.sciencedomain.org On the Inverting of a General Heptadiagonal Matrix ∗ A. A. Karawia1;2 1Mathematics Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt. 2Computer Science Unit, Deanship of Educational Services, Qassim University, P.O.Box 6595, Buraidah 51452, Saudi Arabia. Author’s contribution The sole author designed, analyzed and interpreted and prepared the manuscript. Article Information DOI: 10.9734/BJAST/2016/31213 Editor(s): (1) Orlando Manuel da Costa Gomes, Professor of Economics, Lisbon Accounting and Business School (ISCAL), Lisbon Polytechnic Institute, Portugal. Reviewers: (1) Jia Liu, University of West Florida, USA. (2) Hammad Khalil, University of Education (Attock Campus), Lahore, Pakistan. (3) Gerald Bourgeois, University of French Polynesia and University of Aix-Marseille, France. Complete Peer review History: http://www.sciencedomain.org/review-history/17657 Received: 26th December 2016 Accepted: 21st January 2017 Original Research Article Published: 28th January 2017 ABSTRACT In this paper, the author presents a new algorithm computing the inverse of any nonsingular heptadiagonal matrix. The computational cost of our algorithms is O(n2) operations in C. The algorithms are suitable for implementation using computer algebra system such as MAPLE, MATLAB and MATHEMATICA. Examples are given to illustrate the efficiency of the algorithms. Keywords: Heptadiagonal matrices; LU factorization; Determinants; Computer algebra systems(CAS). 2010 Mathematics Subject Classification: 15A15, 15A23, 68W30, 11Y05, 33F10, F.2.1, G.1.0. *Corresponding author: E-mail: [email protected]; Karawia; BJAST, 18(5), 1-12, 2016; Article no.BJAST.31213 1 INTRODUCTION The n × n general heptadiagonal matrices take the form: 0 1 d1 e1 f1 g1 B C B c2 d2 e2 f2 g2 C B C B b3 c3 d3 e3 f3 g3 0 C B C B a4 b4 c4 d4 e4 f4 g4 C B C B C B C B .
    [Show full text]
  • A Multi-Domain Model for Product and Manufacturing System Design
    A MULTI-DOMAIN MODEL FOR PRODUCT AND MANUFACTURING SYSTEM DESIGN A Thesis SUBMITTED TO THE FACULTY OF UNIVERSITY OF MINNESOTA BY Aparajitha Varanasi IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE Dr. Tarek AlGeddawy August 2017 © Aparajitha Varanasi 2017 i Acknowledgements I would like to thank my professor and my advisor Professor Tarek AlGeddawy for helping me and giving me immense amounts of support and encouragement throughout my journey as a Master’s student. I would also like to thank the University and my professors for giving me a great experience and the opportunities to help me grow in my academic field. ii Dedication I would like to dedicate this to my parents, brother and my friends for their continuous support throughout my student as well as professional life. I would also like to thank Hossein Tohidi for his immense help and contribution towards my thesis. iii Abstract The present work is shown to bring two different domains which are manufacturing and design into picture and to make them co-exist with one another. The increase in customer diversity and variety in demand has led to the proliferation of product variety to the point of mass customization and personalization which also changed the product design constantly. These rapid changes are handled with the help of matrices Design Structure Matrix (DSM) and Incidence Matrix (IM) which help to understand how the machines and parts and components of parts interact with each other. The DSM shows how the component of parts and arranged in a module and the IM shows how the parts and machines interact with each other in a cell.
    [Show full text]
  • Ranks of Random Matrices and Graphs
    RANKS OF RANDOM MATRICES AND GRAPHS BY KEVIN COSTELLO A dissertation submitted to the Graduate School—New Brunswick Rutgers, The State University of New Jersey in partial fulfillment of the requirements for the degree of Doctor of Philosophy Graduate Program in Mathematics Written under the direction of Van Vu and approved by New Brunswick, New Jersey October, 2007 ABSTRACT OF THE DISSERTATION Ranks of Random Matrices and Graphs by Kevin Costello Dissertation Director: Van Vu Let Qn be a random symmetric matrix whose entries on and above the main diagonal are independent random variables (e.g. the adjacency matrix of an Erd˝os-R´enyi random graph). In this thesis we study the behavior of the rank of the matrix in terms of the probability distribution of the entries. One main result is that if the entries of the matrix are not too concentrated on any particular value, then the matrix will with high probability (probability tending to 1 as the size of the matrix tends to infinity) have full rank. Other results concern the case where Qn is sparse (each entry is 0 with high proba- bility), and in particular on the adjacency matrix of sparse random graphs. In this case, we show that if the matrix is not too sparse than with high probability any dependency among the rows of Qn will come from a dependency involving very few rows. ii Acknowledgements I have been fortunate to have been surrounded by supportive people both before and during my graduate career. As an undergraduate, I got my introduction to research during summer programs under the tutelage of Professors Paul Garrett and the Uni- versity of Minnesota and Richard Wilson at Caltech.
    [Show full text]