OPTIMIZATION MODELS for SHAPE-CONSTRAINED FUNCTION ESTIMATION PROBLEMS INVOLVING NONNEGATIVE POLYNOMIALS and THEIR RESTRICTIONS by DAVID´ PAPP

Total Page:16

File Type:pdf, Size:1020Kb

OPTIMIZATION MODELS for SHAPE-CONSTRAINED FUNCTION ESTIMATION PROBLEMS INVOLVING NONNEGATIVE POLYNOMIALS and THEIR RESTRICTIONS by DAVID´ PAPP OPTIMIZATION MODELS FOR SHAPE-CONSTRAINED FUNCTION ESTIMATION PROBLEMS INVOLVING NONNEGATIVE POLYNOMIALS AND THEIR RESTRICTIONS by DAVID´ PAPP A Dissertation submitted to the Graduate School-New Brunswick Rutgers, The State University of New Jersey in partial fulfillment of the requirements for the degree of Doctor of Philosophy Graduate Program in Operations Research written under the direction of Dr. Farid Alizadeh and approved by New Brunswick, New Jersey May 2011 ABSTRACT OF THE DISSERTATION Optimization models for shape-constrained function estimation problems involving nonnegative polynomials and their restrictions by DAVID´ PAPP Dissertation Director: Dr. Farid Alizadeh In this thesis function estimation problems are considered that involve constraints on the shape of the estimator or some other underlying function. The function to be estimated is assumed to be continuous on an interval, and is approximated by a polynomial spline of given degree. First the estimation of univariate functions is considered under constraints that can be represented by the nonnegativity of affine functionals of the estimated function. These include bound constraints, monotonicity, convexity and concavity constraints. A general framework is presented in which arbitrary combination of such constraints, along with monotonicity and periodicity constraints, can be modeled and handled in a both theoretically and practically efficient manner, using second-order cone programming and semidefinite programming. The approach is illustrated by a variety of applications in statistical estimation. Wherever possible, the numerical results are compared to those obtained using methods previously proposed in the statistical literature. Next, multivariate problems are considered. Shape constraints that are tractable in the uni- variate case are intractable in the multivariate setting. Hence, instead of following the univariate approach, polyhedral and spectrahedral (semidefinite) approximations are proposed, which are obtained by replacing nonnegative splines by piecewise weighted-sum-of-squares polynomial splines. A decomposition method for solving very large scale multivariate problems is also investigated. In order to include more constraints in the same unified framework, the notion of weighted-sum- of-squares functions is generalized to weighted-sum-of-squares cones in finite-dimensional real linear spaces endowed with a bilinear multiplication. It is shown that such cones are semidefinite repre- sentable, and the representation is explicitly constructed. An example of a constraint representable in this form is the pointwise positive semidefiniteness of a time-varying covariance matrix. Finally, seeking a method to circumvent the use of semidefinite programming in the solution of optimization problems over nonnegative and weighted-sum-of-squares polynomials, we study the conditions of optimality (for homotopy methods), as well as barrier functions (for barrier methods) ii in such optimization problems. For univariate polynomials a method based on fast Fourier transform is provided that accelerates the evaluation of the logarithmic barrier function (and its first two derivatives) of the moment cone. This reduces the running time of some interior point methods for semidefinite programming from O(n6) to O(n3) when solving problems involving polynomial nonnegativity constraints. iii Contents Abstract ii 1 Introduction 1 1.1 Outline of the thesis....................................5 2 Nonnegative and sum-of-squares polynomials7 2.1 Univariate nonnegative polynomials...........................9 2.2 Multivariate nonnegative polynomials.......................... 13 2.2.1 Global nonnegativity................................ 13 2.2.2 Nonnegative polynomials on polyhedra...................... 15 2.3 Dual cones of nonnegative polynomials: moment cones................. 18 3 Univariate shape constrained estimation 21 3.1 Existing results in univariate shape-constrained estimation............... 22 3.2 Sieves and cones of nonnegative functions........................ 26 3.2.1 Estimation in functional Hilbert spaces..................... 26 3.2.2 Sieves and finite-dimensional approximations.................. 28 3.3 Representations of nonnegative polynomials and splines................ 32 3.3.1 Representations involving semidefinite and second-order cone constraints.. 32 3.3.2 Sieves of polyhedral spline cones......................... 34 3.4 Shape-constrained statistical estimation models..................... 38 3.4.1 Non-parametric regression of a nonnegative function.............. 39 3.4.2 Isotonic, convex, and concave non-parametric regression............ 39 3.4.3 Unconstrained density estimation......................... 40 3.4.4 Unimodal density estimation........................... 40 iv 3.4.5 Log-concave density estimation.......................... 41 3.4.6 Arrival rate estimation............................... 44 3.4.7 Knot point selection................................ 45 3.5 Numerical examples.................................... 46 3.5.1 Isotonic and convex/concave regression..................... 46 3.5.2 Density estimation................................. 51 3.5.3 Arrival rate estimation............................... 53 3.6 Summary and conclusion................................. 54 4 Multivariate shape constrained estimation 56 4.1 Multivariate nonnegative and sum-of-squares splines.................. 57 4.1.1 Numerical illustration { posterior probability estimation............ 61 4.2 A decomposition method for multivariate splines.................... 63 4.2.1 Augmented Lagrangian decomposition for sparse problems........... 64 4.2.2 Numerical illustration { NJ Turnpike accidents................. 67 4.3 Generalized sum-of-squares cones............................. 70 4.3.1 Semidefinite characterization of sums of squares................. 72 4.3.2 Application to vector-valued functions...................... 78 4.3.3 Further applications................................ 82 4.4 Conclusion......................................... 84 5 Direct optimization methods for nonnegative polynomials 85 5.1 Optimality conditions for nonnegative polynomials................... 87 5.1.1 Preliminary observations.............................. 89 5.1.2 Nonnegative polynomials over a finite interval.................. 91 5.1.3 M¨untz polynomials................................. 100 5.1.4 Cones linearly isomorphic to nonnegative polynomials over an interval.... 102 5.2 A barrier method for moment cone constraints..................... 106 5.2.1 Fast computation of the gradient and the Hessian............... 107 5.2.2 Alternative bases.................................. 109 5.3 Conclusion......................................... 110 6 Conclusion 112 v A Background material 114 A.1 Conic optimization..................................... 114 A.2 Positive semidefinite matrices............................... 116 A.3 Semidefinite and second-order cone programming.................... 117 Bibliography 120 Vita 131 vi 1 Chapter 1 Introduction In this thesis we consider function estimation problems involving constraints on the shape of the estimator or some other underlying function. Such estimation problems abound in statistics and engineering, and there are numerous examples in other disciplines as well. Here we briefly recall a few to give a flavor of these applications; we will return to some of them in the subsequent chapters. 1. Isotonic regression. Regression problems often arise in situations where some prior knowledge (laws of nature or common sense) tells us that the estimated function must be monotone increasing or decreasing in some of the variables. Calculating the least-squares regression function under this constraint is the simplest form of the univariate isotonic regression problem [RWD88]. Multivariate extensions, as well as more abstract forms of this problem, such as [Bru55], also exist; in these problems monotonicity is understood with respect to some partial order. 2. Convex/Concave regression. Similarly to isotonic regression, some problems may require that the estimator is convex or concave over its domain [Hil54]. Univariate applications include the estimation of the Laffer curve [Wan78] and utility functions in econometrics. The latter is also an example of a situation when multiple shape constraints may be present: the utility function of a rational, risk-averse decision maker is increasing and concave. 3. Density estimation. One of the fundamental problems in statistics is the estimation of probability density functions (or PDFs) and cumulative distribution functions (or CDFs) of random variables, given a finite number of samples (realizations) of these variables [DG85, EL01]. These problems come in two flavors: in the parametric setting the unknown PDF or CDF is 2 assumed to belong to a finite-dimensional space (or at least to a family of functions given up to a finite number of parameters) that contains only PDFs and CDFs. Usually one considers parametric families which contain only functions of the right shape. In the non-parametric setting, however, no such assumptions are made, and constraints such as nonnegativity, being less than or equal to one, and monotonicity must be explicitly added to the problem. Further constraints, such as the unimodality or log-concavity of the PDF can also be considered (even though unimodality is not a convex constraint, which makes optimization with unimodality constraints particularly difficult). 4. Arrival rate estimation. The arrival rate of a non-homogeneous
Recommended publications
  • Some Aspects of the Optimization Over the Copositive and the Completely Positive Cone
    Some aspects of the optimization over the copositive and the completely positive cone Dissertation zur Erlangung des akademischen Grades eines Doktors der Naturwissenschaften (Dr. rer. nat.) Dem Fachbereich IV der Universit¨at Trier vorgelegt von Julia Witzel Trier, 2013 Eingereicht am 17.07.2013 Gutachter: Prof. Dr. Mirjam Dur¨ Prof. Dr. Gabriele Eichfelder Tag der mundlichen¨ Prufung:¨ 25.09.2013 Die Autorin hat im Laufe des Promotionsverfahrens geheiratet und hieß zu dessen Beginn Julia Sponsel. Zusammenfassung Optimierungsprobleme tauchen in vielen praktischen Anwendungsbereichen auf. Zu den einfachsten Problemen geh¨oren lineare Optimierungsprobleme. Oft reichen lineare Probleme allerdings zur Modellierung praktischer Anwendun- gen nicht aus, sondern es muss die Ganzzahligkeit von Variablen gefordert werden oder es tauchen nichtlineare Nebenbedingungen oder eine nichtlineare Zielfunktion auf. Eine wichtige Problemklasse stellen hierbei quadratische Pro- bleme dar, welche im Allgemeinen aber schwer zu l¨osen sind. Ein Ansatz, der sich in den letzten Jahren entwickelt und verbreitet hat, besteht in der Umfor- mulierung quadratischer Probleme in sogenannte kopositive Programme. Ko- positive Programme sind lineare Optimierungsprobleme uber¨ dem Kegel der kopositiven Matrizen n×n T T n Cn = fA 2 R : A = A ; x Ax ≥ 0 fur¨ alle x 2 R ; x ≥ 0g; oder dem Dualkegel, dem Kegel der vollst¨andig positiven Matrizen m ∗ n X T n o Cn = xixi : xi 2 R ; xi ≥ 0 fur¨ alle i = 1; : : : ; m : i=1 Die Schwierigkeit dieser Probleme liegt in der Kegelbedingung. Aber nicht nur das Optimieren uber¨ diesen Kegeln ist schwierig. Wie von Murty und Kabadi (1987) und Dickinson und Gijben (2013) gezeigt ist es NP-schwer zu testen, ob eine gegebene Matrix kopositiv oder vollst¨andig positiv ist.
    [Show full text]
  • Copositive Plus Matrices
    Copositive Plus Matrices Willemieke van Vliet Master Thesis in Applied Mathematics October 2011 Copositive Plus Matrices Summary In this report we discuss the set of copositive plus matrices and their properties. We examine certain subsets of copositive plus matrices, copositive plus matrices with small dimensions, and the copositive plus cone and its dual. Furthermore, we consider the Copositive Plus Completion Problem, which is the problem of deciding whether a matrix with unspecified entries can be completed to obtain a copositive plus matrix. The set of copositive plus matrices is important for Lemke's algorithm, which is an al- gorithm for solving the Linear Complementarity Problem (LCP). The LCP is the problem of deciding whether a solution for a specific system of equations exists and finding such a solution. Lemke's algorithm always terminates in a finite number of steps, but for some prob- lems Lemke's algorithm terminates with no solution while the problem does have a solution. However, when the data matrix of the LCP is copositive plus, Lemke's algorithm always gives a solution if such solution exists. Master Thesis in Applied Mathematics Author: Willemieke van Vliet First supervisor: Dr. Mirjam E. D¨ur Second supervisor: Prof. dr. Harry L. Trentelman Date: October 2011 Johann Bernoulli Institute of Mathematics and Computer Science P.O. Box 407 9700 AK Groningen The Netherlands Contents 1 Introduction 1 1.1 Structure . .1 1.2 Notation . .1 2 Copositive Plus Matrices and their Properties 3 2.1 The Class of Copositive Matrices . .3 2.2 Properties of Copositive Matrices . .4 2.3 Properties of Copositive Plus Matrices .
    [Show full text]
  • On Mathematical Programming (ISMP 2015), the Most Important Meeting of the Mathematical Optimization Society (MOS)
    TABLE OF CONTENTS i PROGRAM COMMITTEE LOCAL ORGANIZING COMMITTEE Welcome from the Chair ii Chair Chair Schedule of Daily Events and Sessions iii Gérard P. Cornuéjols François Margot Carnegie Mellon University Carnegie Mellon University Cluster Chairs v USA Speaker Information vi Egon Balas Egon Balas Carnegie Mellon University Internet Access vii Carnegie Mellon University USA Lorenz T. Biegler Conference Mobile App vii Carnegie Mellon University Xiaojun Chen Where to go for Lunch vii The Hong Kong Polytechnic University Gérard P. Cornuéjols Opening Ceremony & Reception viii China Carnegie Mellon University Conference Cruise & Banquet ix Monique Laurent Iganacio E. Grossmann CWI Amsterdam Carnegie Mellon University Plenary & Semi-Plenary Lectures x The Netherlands John Hooker Exhibitors xv Sven Leyffer Carnegie Mellon University Master Track Schedules xvii Argonne National Laboratory USA Fatma Kilinç-Karzan Floor Plans xxii Carnegie Mellon University Arkadi Nemirovski Georgia Institute of Technology Javier F. Peña USA Carnegie Mellon University Technical Sessions 1 Monday 1 Jorge Nocedal Oleg A. Prokopyev Northwestern University University of Pittsburgh Tuesday 41 USA Kirk Pruhs Wednesday 71 Andrzej Ruszczy´nski University of Pittsburgh Rutgers University Thursday 101 USA Nikolaos V. Sahinidis Friday 140 Carnegie Mellon University Claudia Sagastizábal IMPA Rio de Janeiro (Visiting Researcher) Andrew J. Schaefer Brazil University of Pittsburgh Session Chair Index 168 David P. Williamson Michael A. Trick Author Index 170 Cornell University Carnegie Mellon University Session Index 180 USA Willem-Jan van Hoeve Laurence Wolsey Carnegie Mellon University Université Catholique de Louvain Belgium ii WELCOME FROM THE CHAIR Tepper School of Business Carnegie Mellon University 5000 Forbes Ave Pittsburgh, PA 15213-3890 It is a pleasure to welcome you to the 22nd International Symposium on Mathematical Programming (ISMP 2015), the most important meeting of the Mathematical Optimization Society (MOS).
    [Show full text]
  • Cambridge University Press 978-1-108-47871-7 — Matrix Positivity Charles R
    Cambridge University Press 978-1-108-47871-7 — Matrix Positivity Charles R. Johnson , Ronald L. Smith , Michael J. Tsatsomeros Index More Information Index p-Newton, 159 completion of a partial matrix, 153 t-th Hadamard power, 128 completion to a P-matrix, 88 (convex) cone, 162 cone,3,39 (i,j)-path, 157 congruence of A, 168 (right) Perron eigenvector, 58 conjugate transpose, 1 (right) null space, 114 contiguous minors, 9 (strictly) codefinite pair, 172 convex, 3 (strictly) copositive of order m, 171 convex combination, 3 convex hull, 4 acute cone, 40 Copositive, 164 allow MSP,30 copositive, 10 allow RSP,30 copositive +,10 allow SP,25 copositive with respect to a cone K, 167 almost (strictly) semimonotone, 53 Copositive-plus, 164 almost C, 177 CP-rank, 11 almost C+, 177 critical exponent, 135 almost SC, 177 cycle of length, 59 almost diagonally dominant P-matrices, 88 cycle product, 120 almost principal submatrices, 109 cycle product inequalities, 120 associated quadratic form, 174 determinantal inequalities, 8 B-matrix, 58 diagonal Lyapunov solution, 91 block graph, 155 diagonal Lyapunov solutions, 95 block P-matrices, 88 diagonally dominant matrix, 2 buckle, 157 diagonally dominant of its column entries, 94 diagonally dominant of its columns, 93 Cayley transform, 57 diagonally dominant of its row entries, 94 Cholesky factorization, 10 diagonally dominant of its rows, 93 column (row) deleted submatrix, 16 diagonally symmetrizable, 127 column diagonally dominant, 12 directed graph, 59 common semipositivity vector, 59 directed graph of A, 121 comparison matrix, 58 dispersion, 75 complementary nullities, 114 doubly nonnegative matrices, 10, 135 completely positive matrix, 11 doubly positive matrices, 10 © in this web service Cambridge University Press www.cambridge.org Cambridge University Press 978-1-108-47871-7 — Matrix Positivity Charles R.
    [Show full text]
  • The Copositive-Plus Matrix Completion Problem, Xuhua Liu
    Alabama Journal of Mathematics ISSN 2373-0404 39 (2015) The Copositive-Plus Matrix Completion Problem Xuhua Liu Ronald L. Smith Department of Mathematics Department of Mathematics The University of Tennessee at Chattanooga The University of Tennessee at Chattanooga Chattanooga, TN 37403, USA Chattanooga, TN 37403, USA We derive a useful characterization of 3-by-3 copositive-plus matrices in terms of their entries, and use it to solve the copositive-plus matrix completion problem in the case of specified diagonal by showing that a partial copositive-plus matrix with graph G has a copositive-plus completion if and only if G is a pairwise disjoint union of complete subgraphs. Introduction (cf. Hiriart-Urruty and Seeger (2010)). See recent surveys Hiriart-Urruty and Seeger (2010) and Ikramov and Savel’eva In this article, the superscript “>” denotes transposi- n (2000) on copositive matrices and references therein. tion and R the set of all real n-vectors. A vector x = A partial matrix is one in which some entries are spec- > 2 n (x1;:::; xn) R is said to be nonnegative, denoted by ified, while the remaining entries are unspecified and free x > 0, if xi > 0 for all i = 1;:::; n. to be chosen. A completion of a partial matrix is a choice × Let S n denote the set of all n n real symmetric matrices. of values for the unspecified entries. A matrix completion 2 A matrix A S n is said to be problem asks which partial matrices have completions with + ∗ > n a desired property. A partial C (C, C , resp.) matrix is a (1) (real) positive semidefinite if x Ax > 0 for all x 2 R ; real symmetric partial matrix such that every fully specified > + ∗ ∗ (2) copositive if x Ax > 0 for all x > 0; principal submatrix is C (C, C , resp.).
    [Show full text]
  • Copositive Matrices with Circulant Zero Support
    Copositive matrices with circulant zero support set Roland Hildebrand ∗ July 19, 2021 Abstract 1 n Let n ≥ 5 and let u ,...,u be nonnegative real n-vectors such that the indices of their positive elements form the sets {1, 2,...,n − 2}, {2, 3,...,n − 1},..., {n, 1,...,n − 3}, respectively. Here each index set is obtained from the previous one by a circular shift. The set of copositive forms 1 n n which vanish on the vectors u ,...,u is a face of the copositive cone C . We give an explicit semi-definite description of this face and of its subface consisting of positive semi-definite forms, and study their properties. If the vectors u1,...,un and their positive multiples exhaust the zero set of an exceptional copositive form belonging to this face, then we say it has minimal circulant zero support set, and otherwise non-minimal circulant zero support set. We show that forms with non-minimal circulant zero support set are always extremal, and forms with minimal circulant zero support sets can be extremal only if n is odd. We construct explicit examples of extremal forms with non-minimal circulant zero support set for any order n ≥ 5, and examples of extremal forms with minimal circulant zero support set for any odd order n ≥ 5. The set of all forms with non-minimal circulant zero support set, i.e., defined by different collections u1,...,un of zeros, is a submanifold of codimension 2n, the set of all forms with minimal circulant zero support set a submanifold of codimension n.
    [Show full text]
  • Mathematisches Forschungsinstitut Oberwolfach Copositivity And
    Mathematisches Forschungsinstitut Oberwolfach Report No. 52/2017 DOI: 10.4171/OWR/2017/52 Copositivity and Complete Positivity Organised by Abraham Berman, Haifa Immanuel M. Bomze, Vienna Mirjam D¨ur, Augsburg Naomi Shaked-Monderer, Yezreel Valley 29 October – 4 November 2017 Abstract. A real matrix A is called copositive if xT Ax ≥ 0 holds for all Rn x ∈ +. A matrix A is called completely positive if it can be factorized as A = BBT , where B is an entrywise nonnegative matrix. The concept of copositivity can be traced back to Theodore Motzkin in 1952, and that of complete positivity to Marshal Hall Jr. in 1958. The two classes are related, and both have received considerable attention in the linear algebra community and in the last two decades also in the mathematical optimization commu- nity. These matrix classes have important applications in various fields, in which they arise naturally, including mathematical modeling, optimization, dynamical systems and statistics. More applications constantly arise. The workshop brought together people working in various disciplines re- lated to copositivity and complete positivity, in order to discuss these con- cepts from different viewpoints and to join forces to better understand these difficult but fascinating classes of matrices. Mathematics Subject Classification (2010): 15B48, 15A23, 15A63, 37B25, 37C75, 90C20, 90C22, 93D09 . Introduction by the Organisers T Rn A real matrix A is called copositive if x Ax 0 holds for all x +. Obviously, every positive semidefinite matrix is copositive,≥ and so is every entry∈ wise symmet- ric nonnegative matrix. However, for n 5 the cone of n n copositive matrices is considerably larger and more complex than≥ both the semidefinite× and symmetric nonnegative matrix cones.
    [Show full text]
  • Multilinear Algebra
    A Complete Bibliography of Publications in Linear [and] Multilinear Algebra Nelson H. F. Beebe University of Utah Department of Mathematics, 110 LCB 155 S 1400 E RM 233 Salt Lake City, UT 84112-0090 USA Tel: +1 801 581 5254 FAX: +1 801 581 4148 E-mail: [email protected], [email protected], [email protected] (Internet) WWW URL: http://www.math.utah.edu/~beebe/ 18 May 2021 Version 1.15 Title word cross-reference (0; 1) [FV97, Kim97, Zel85, BF15, BS18d, Cao19, KS83, LN10, Min74d, Zho16]. (0; 1; −1) [GZ99]. (1; −1) [KS84]. (1; 0) [MP13b]. (1; 1) [Zha20a, Che03b]. (1; 2; 3) [GK18]. (2) [Che95a]. (2; 2; 2) [SF17]. (2;p) [YD14]. (α, β)[YZ13]. (α, β; γ) [KO10]. (AXB; CXD)=(E;F) [YLW15]. (AXB; CXD)=(E;G) + [YTL20]. (b; c)[SCK´ 20, Boa19, Dra18b, KCICV18]. (e(xrys)) [Pre85]. (k) [Cha77, Cha79a]. (k + 1) [BT06]. (k; l)[Rem90].(k =2; 3; 4) [Sta15b]. (m; C) [MCL20]. (m; m − 1; 0) [HZ21]. (max; +) [HKT15]. (n + 1) [Sch78, Sch75]. (n; k)=(4; 2) [JLL88]. (n; m) [CM19]. (p; h) [DV18]. (p; q) [KL95]. (p; σ) [ADRP14].p (qr)[Raw81].(R; S) [fLLyP15, Pen15]. (s; p) − w [Ras17]. s ( 5 − 1)=2[Sim95].(T ) [Che95b]. (υ, k; λ)[Der83].(Zm) [How86]. −2 [Ano16b, BPS16]. 0 [HNS99, HLZ05, HL20, JS96, Wu09]. 0; 1 [MS79, BX07]. 0 62 F (Am) [JL90]. 1 [CM15, DFK19, Fra17, HNS99, HLZ05, HL20, JS96, KP14a, Min77, Sta10, Wu09]. 1; 2; 1[KHG13].f1; 2; 3g [ZX10]. f1; 2; 4g 1 [ZX10]. f1; 3g [CIM19]. 10 [LN10]. 12 [EM95].
    [Show full text]
  • Matrix Theory
    Matrix Theory Xingzhi Zhan +VEHYEXI7XYHMIW MR1EXLIQEXMGW :SPYQI %QIVMGER1EXLIQEXMGEP7SGMIX] Matrix Theory https://doi.org/10.1090//gsm/147 Matrix Theory Xingzhi Zhan Graduate Studies in Mathematics Volume 147 American Mathematical Society Providence, Rhode Island EDITORIAL COMMITTEE David Cox (Chair) Daniel S. Freed Rafe Mazzeo Gigliola Staffilani 2010 Mathematics Subject Classification. Primary 15-01, 15A18, 15A21, 15A60, 15A83, 15A99, 15B35, 05B20, 47A63. For additional information and updates on this book, visit www.ams.org/bookpages/gsm-147 Library of Congress Cataloging-in-Publication Data Zhan, Xingzhi, 1965– Matrix theory / Xingzhi Zhan. pages cm — (Graduate studies in mathematics ; volume 147) Includes bibliographical references and index. ISBN 978-0-8218-9491-0 (alk. paper) 1. Matrices. 2. Algebras, Linear. I. Title. QA188.Z43 2013 512.9434—dc23 2013001353 Copying and reprinting. Individual readers of this publication, and nonprofit libraries acting for them, are permitted to make fair use of the material, such as to copy a chapter for use in teaching or research. Permission is granted to quote brief passages from this publication in reviews, provided the customary acknowledgment of the source is given. Republication, systematic copying, or multiple reproduction of any material in this publication is permitted only under license from the American Mathematical Society. Requests for such permission should be addressed to the Acquisitions Department, American Mathematical Society, 201 Charles Street, Providence, Rhode Island 02904-2294 USA. Requests can also be made by e-mail to [email protected]. c 2013 by the American Mathematical Society. All rights reserved. The American Mathematical Society retains all rights except those granted to the United States Government.
    [Show full text]
  • Complementarity Properties of Peirce-Diagonalizable Linear Transformations on Euclidean Jordan Algebras
    Optimization Methods and Software Vol. 00, No. 00, January 2009, 1{14 Complementarity properties of Peirce-diagonalizable linear transformations on Euclidean Jordan algebras M. Seetharama Gowdaa∗, J. Taob, and Roman Sznajderc aDepartment of Mathematics and Statistics, University of Maryland Baltimore County, Baltimore, Maryland 21250, USA ; bDepartment of Mathematics and Statistics, Loyola University Maryland, Baltimore, Maryland 21210, USA; c Department of Mathematics, Bowie State University, Bowie, Maryland 20715, USA (xxxxxx) Peirce-diagonalizable linear transformations on a Euclidean Jordan algebra are of the form P P L(x) = A•x := aij xij , where A = [aij ] is a real symmetric matrix and xij is the Peirce decomposition of an element x in the algebra with respect to a Jordan frame. Examples of such transformations include Lyapunov transformations and quadratic representations on Euclidean Jordan algebras. Schur (or Hadamard) product of symmetric matrices provides another example. Motivated by a recent generalization of the Schur product theorem, in this article, we study general and complementarity properties of such transformations. Keywords: Peirce-diagonalizable transformation, linear complementarity problem, Euclidean Jordan algebra, symmetric cone, Schur/Hadamard product, Lypaunov transformation, quadratic representation. AMS Subject Classification: 15A33; 17C20; 17C65; 90C33. 1. Introduction Let L be a linear transformation on a Euclidean Jordan algebra (V; ◦; h·; ·i) of rank r and let Sr denote the set of all real r × r symmetric matrices. We say that L is Peirce-diagonalizable if there exist a Jordan frame fe1; e2; : : : ; erg (with a specified r ordering of its elements) in V and a matrix A = [aij] 2 S such that for any x 2 V P with its Peirce decomposition x = i≤j xij with respect to fe1; e2; : : : ; erg, we have X L(x) = A • x := aijxij: (1) 1≤i≤j≤r The above expression defines a Peirce-diagonal transformation and a Peirce diag- onal representation of L.
    [Show full text]
  • Perron–Frobenius Property of Copositive Matrices, and a Block Copositivity Criterion
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Available online at www.sciencedirect.com Linear Algebra and its Applications 429 (2008) 68–71 www.elsevier.com/locate/laa Perron–Frobenius property of copositive matrices, and a block copositivity criterion Immanuel M. Bomze Department of Statistics and Decision Support Systems, University of Vienna, Austria Received 21 November 2007; accepted 5 February 2008 Available online 25 March 2008 Submitted by R.A. Brualdi Abstract Haynsworth and Hoffman proved in 1969 that the spectral radius of a symmetric copositive matrix is an eigenvalue of this matrix. This note investigates conditions which guarantee that an eigenvector correspond- ing to this dominant eigenvalue has no negative coordinates, i.e., whether the Perron–Frobenius property holds. Also a block copositivity criterion using the Schur complement is specified which may be helpful to reduce dimension in copositivity checks and which generalizes results proposed by Andersson et al. in 1995, and Johnson and Reams in 2005. Apparently, the latter five researchers were unaware of the more general results by the author precedingly published in 1987 and 1996, respectively. © 2008 Published by Elsevier Inc. Keywords: Dominant eigenvalue; Positive eigenvector; Schur complement; Spectral radius The Perron–Frobenius property has many well-studied consequences, also for matrices with some negative entries, see [6–9] and references therein. In [4], Haynsworth and Hoffman prove, among other results and in a more general setting, that a symmetric copositive matrix has a dominant (positive) eigenvalue. This way, part of the Perron–Frobenius theorem is extended to a class of matrices larger than the nonnegative ones, as copositive matrices also may have some negative entries, even if they are positive-semidefinite.
    [Show full text]
  • Nearly Positive Matrices Bryan Shader, Naomi Shaked-Monderer and Daniel B
    Nearly positive matrices Bryan Shader, Naomi Shaked-Monderer and Daniel B. Szyld Research Report 13-07-17 July 2013 Department of Mathematics Temple University This report is available in the World Wide Web at http://www.math.temple.edu/szyld Nearly positive matrices∗ Bryan Shadery Naomi Shaked-Mondererz Daniel B. Szyldx Abstract Nearly positive (NP) matrices are nonnegative matrices which, when premultiplied by orthogonal matrices as close to the identity as one wishes, become positive. In other words, all columns of an NP matrix are mapped simultaneously to the interior of the nonnegative cone by mutiplication by a sequence of orthogonal matrices converging to the identity. In this paper, NP matrices are analyzed and characterized in several cases. Different necessary and sufficient conditions for a nonnegative matrix to be an NP matrix are presented. A connection to completely positive matrices is also presented. Keywords: Nonnegative matrices, Positive matrices, Completely positive matrices. AMS subject classification: 15F10 1 Introduction Consider the cone of nonnegative vectors in the m-dimensional space m m R+ = fx 2 R ; x ≥ 0g. Any nonzero vector v in its boundary is nonnega- tive, but not positive. It is not hard to see that an infinitesimal rotation in the m appropriate direction can bring this vector into the interior of the cone R+ . In other words, one can build a sequence of orthogonal matrices Q(`) such that lim`!1 Q(`) = I with the property that Q(`)v > 0. For two non-orthogonal nonnegative vectors u, v, one can also build a se- quence of orthogonal matrices, such that both Q(`)u > 0 and Q(`)v > 0 [6, Theorem 6.12].
    [Show full text]