Solving Hankel Matrix Approximation Problem Using Semidefinite Programming

Total Page:16

File Type:pdf, Size:1020Kb

Solving Hankel Matrix Approximation Problem Using Semidefinite Programming Journal of Computational and Applied Mathematics 202 (2007) 304–314 www.elsevier.com/locate/cam Solving Hankel matrix approximation problem using semidefinite programming Suliman Al-Homidan∗ Department of Mathematical Sciences, King Fahd University of Petroleum and Minerals, PO Box 119, Dhahran 31261, Saudi Arabia Received 9 July 2005; received in revised form 22 February 2006 Abstract Positive semidefinite Hankel matrices arise in many important applications. Some of their properties may be lost due to rounding or truncation errors incurred during evaluation. The problem is to find the nearest matrix to a given matrix to retrieve these properties. The problem is converted into a semidefinite programming problem as well as a problem comprising a semidefined program and second-order cone problem. The duality and optimality conditions are obtained and the primal–dual algorithm is outlined. Explicit expressions for a diagonal preconditioned and crossover criteria have been presented. Computational results are presented. A possibility for further improvement is indicated. © 2006 Elsevier B.V. All rights reserved. MSC: 65F99; 99C25; 65K30 Keywords: Primal–dual interior-point method; Hankel matrix; Semidefinite programming 0. Introduction In view of its beautiful theory having significant applications, finite and infinite Hankel matrices have attracted attention of researchers working in different disciplines, see for example [21,8]. The related concept of structural matrix approximation problem having applications to image processing has been studied in [13,18]. Park et al. [20] have presented a method for structure preserving low-rank approximation of matrix which is based on structured total least norm (STLN). They have observed that a classical problem with a new STLN-based algorithm can have a significant impact on the model reduction problem with Hankel matrices. It may be noted that such a problem arises in many branches of engineering such as speech encoding, filter design and higher-order state-space models of dynamic systems. Motivated by [2–4,17], we have studied, as an extension of the work in [1], approximation of an arbitrary matrix by positive semidefinite Hankel matrices. Macinnes [17] has used a full rank of a particular Hankel matrix while Al-Homidan [2,3] has used a low-rank Hankel matrix based on the projection algorithm and the Newton method. The projection algorithm provides global convergence with slow convergence rate. This method has been combined with the Newton method to yield the best features of both approaches. ∗ Tel.: +966 386 04490; fax: +966 386 02340. E-mail address: [email protected]. 0377-0427/$ - see front matter © 2006 Elsevier B.V. All rights reserved. doi:10.1016/j.cam.2006.02.033 S. Al-Homidan / Journal of Computational and Applied Mathematics 202 (2007) 304–314 305 Anjos et al. [5] have studied a semidefinite programming approach for the nearest correlation matrix problem. It may be recalled that the nearest correlation matrix problem is to find a positive definite matrix with unit diag- onal that is nearest in the Frobenius norm to a given symmetric matrix. This problem has been formulated as an optimization problem with quadratic objective function and semidefinite programming constraints by Anjos et al. and they have developed several algorithms to solve this problem. In the present paper we have studied a related problem to the nearest correlation matrix problem where the positive semidefinite matrix with unit diagonal is re- placed by a positive semidefinite Hankel matrix. More precisely, we have discussed the solution of the following problem: Given an arbitrary data matrix A ∈ Rn×n, find the nearest positive semidefinite Hankel matrix H to A, i.e., = 1 H − A2 minimize 2 F subject to H ∈ P ∩ O, (0.1) n where P is the set of all n × n symmetric positive semidefinite matrices P ={H : H 0,H ∈ S }, O is the set of Sn A2 = n A2 all Hankel matrices, and is the set of all symmetric matrices. Here, F i,j=1 ij is the Frobenius norm squared. Section 1 is devoted to the basic results needed in subsequent sections while the projection method for solving (0.1) is given in Section 2. In Section 3, we formulate the problem first as a semidefined programming problem (SDP), then as a mixed SDP and second-order cone problem (SOC). The duality and optimality conditions for quadratic programs are presented in Section 4. The primal–dual algorithm is outlined in Section 5 including explicit expressions for diagonal preconditioner and crossover criteria. Computational results are presented in Section 6 and concluding remarks are given in Section 7. 1. Notation n n Define M to be the space of n × n matrices, then for a general rectangular matrix M =[m1 m2 ... mn]∈M , v = vec (M) forms a vector from columns of M. The inverse mapping, vec −1, and the adjoint mapping, vec ∗, are given by Mat = vec −1 = vec ∗, the adjoint formula following from vec (M), u=M,vec ∗(u). We use the trace inner product M,N=trace MTN, which induces the Frobenius norm. With this inner product, Mat (and vec ) is an isometry. M† denotes the Moore–Penrose generalized inverse, e.g., [7]. Define e the vector of ones and ek the zero vector with one in the k-position. Define PO(W) to be the orthogonal projection of W onto the subspace of Hankel matrices O. We also need the operator H : R2n−1 −→ O ⎡ ⎤ x1 x2 ... xn ⎢ ⎥ ⎢ ⎥ ⎢ x x ... xn+ ⎥ ⎢ 2 3 1 ⎥ H(x) = ⎢ ⎥ ⎢ . ⎥ . (1.1) ⎢ . .. ⎥ ⎣ ⎦ xn xn+1 ... x2n−1 Also, define the isometry operator hvec : R2n−1 −→ O −→ R2n−1 as √ √ √ T hvec (H(x)) = hvec (x) =[x1 2x2 ··· nxn ··· 2x2n−2 x2n−1] (1.2) for any x ∈ R2n−1. hvec is a linear operator satisfying the following: for any x,y ∈ R2n−1 H(x) · H(y) = hvec (x)Thvec (y), (1.3) H(x) − H(y)2 = ( (x) − (y))T( (x) − (y)) F hvec hvec hvec hvec . (1.4) 306 S. Al-Homidan / Journal of Computational and Applied Mathematics 202 (2007) 304–314 n 2 −1 n Here U · U = trace(UU) = i,j Ui,j . Let hMat = hvec denote the inverse mapping into S , i.e., the one–one mapping between R2n−1 and O. The adjoint operator hMat ∗ = hvec , since hMat (v), H(s)=trace hMat (v)H(s) ⎛ ⎞ v2 vn v1 √ ... √ ⎛ ⎞ ⎜ 2 n ⎟ s s ... s ⎜ ⎟ 1 2 n ⎜ ⎟ ⎜ ⎟ ⎜ v2 v3 vn+1 ⎟ ⎜ ⎟ ⎜ √ √ ... √ ⎟ ⎜ s s ... sn+ ⎟ ⎜ n − ⎟ ⎜ 2 3 1 ⎟ = ⎜ 2 3 1 ⎟ ⎜ ⎟ trace ⎜ ⎟ ⎜ . ⎟ ⎜ . ⎟ ⎜ . .. ⎟ ⎜ . ⎟ ⎝ ⎠ ⎜ . ⎟ ⎝ ⎠ vn vn+1 sn sn+1 ... s2n−1 √ √ ... v2n−1 n n − 1 v2 vn = v1s1 + 2√ s2 +···+n√ sn +···+v2n−1s2n−1 2 n ∗ =hvec (H(s)), v=hMat (H(s)), v. 2. The projection method The method of successive cyclic projections onto closed subspaces Ci’s was first proposed by vonNeumann [24] and independently by Wiener [25]. They showed that if, for example, C1 and C2 are subspaces and D is a given point, then the nearest point to D in C1 ∩ C2 could be obtained by Algorithm 2.1. Alternating projection algorithm Let X1 = D For k = 1, 2, 3,... Xk+1 = P1(P2(Xk)). Then Xk converges to the nearest point D in C1 ∩ C2, where P1 and P2 are the orthogonal projections on C1 and C2, respectively. Dykstra [11] modified von Neumann’s algorithm to handle the situation when C1 and C2 are replaced by convex sets. Other proofs and connections to duality along with applications were given in [15]. The modified Neumann’s algorithm when applied to (0.1) for a given data matrix A: Algorithm 2.2. Modified alternating projection algorithm Let A1 = A For j = 1, 2, 3,... Aj+1 = Aj +[PP(PO(Aj )) − PO(Aj )]. Then {PO(Aj )} and {PP(PO(Aj ))} converge in Frobenius norm to the solution. Here, PP(A) is the projection of A onto the convex cone P. It is simply setting the negative eigenvalues of the spectral decomposition of A to zero. 3. Mixed-cone formulation In this section we introduce briefly a direct approach for solving (0.1) which is obtained by formulating it first as an SDP problem then as a mixed SDP and second-order cone problem, more details given in [1]. To take the advantage of the isometry operator hvec, we need A to be Hankel. If we project A onto O,wegetPO(A). The following lemma shows that the nearest symmetric Hankel positive semidefinite matrix to A is exactly equal to the nearest symmetric Hankel positive semidefinite matrix to PO(A). S. Al-Homidan / Journal of Computational and Applied Mathematics 202 (2007) 304–314 307 Lemma 3.1. Let H(x) be the nearest symmetric Hankel positive semidefinite matrix to PO(A), then H(x) is so for A. Proof. If PO(A) is positive semidefinite, then we are done. If not, then for any H(x) ∈ O,wehave (H(x) − PO(A)) · (PO(A) − A) = 0 since PO(A) is the orthogonal projection of A. Thus, H(x) − A2 =H(x) − P (A)2 +P (A) − A2 F O F O F. This complete the proof since the second part of the above equation is constant. In view of Lemma 3.1, (0.1) is equivalent to the problem ∗ = 1 H(x) − P (A)2 minimize 2 O F subject to H(x)0. (3.1) Now, we have the following equivalences (for 0 ∈ R): H(x) − P (A)2 O F ⇔ (hvec (x) − hvec (a))T(hvec (x) − hvec (a)) by (1.4) ⇔ − (hvec (x) − hvec (a))TI(hvec (x) − hvec (a))0 I(hvec (x) − hvec (a)) ⇔ 0 by Schur complement, (3.2) (hvec (x) − hvec (a))T where H(a) = PO(A).
Recommended publications
  • Polynomials and Hankel Matrices
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Polynomials and Hankel Matrices Miroslav Fiedler Czechoslovak Academy of Sciences Institute of Mathematics iitnci 25 115 67 Praha 1, Czechoslovakia Submitted by V. Ptak ABSTRACT Compatibility of a Hankel n X n matrix W and a polynomial f of degree m, m < n, is defined. If m = n, compatibility means that HC’ = CfH where Cf is the companion matrix of f With a suitable generalization of Cr, this theorem is gener- alized to the case that m < n. INTRODUCTION By a Hankel matrix [S] we shall mean a square complex matrix which has, if of order n, the form ( ai +k), i, k = 0,. , n - 1. If H = (~y~+~) is a singular n X n Hankel matrix, the H-polynomial (Pi of H was defined 131 as the greatest common divisor of the determinants of all (r + 1) x (r + 1) submatrices~of the matrix where r is the rank of H. In other words, (Pi is that polynomial for which the nX(n+l)matrix I, 0 0 0 %fb) 0 i 0 0 0 1 LINEAR ALGEBRA AND ITS APPLICATIONS 66:235-248(1985) 235 ‘F’Elsevier Science Publishing Co., Inc., 1985 52 Vanderbilt Ave., New York, NY 10017 0024.3795/85/$3.30 236 MIROSLAV FIEDLER is the Smith normal form [6] of H,. It has also been shown [3] that qN is a (nonzero) polynomial of degree at most T. It is known [4] that to a nonsingular n X n Hankel matrix H = ((Y~+~)a linear pencil of polynomials of degree at most n can be assigned as follows: f(x) = fo + f,x + .
    [Show full text]
  • Inverse Problems for Hankel and Toeplitz Matrices
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Inverse Problems for Hankel and Toeplitz Matrices Georg Heinig Vniversitiit Leipzig Sektion Mathematik Leipzig 7010, Germany Submitted by Peter Lancaster ABSTRACT The problem is considered how to construct a Toeplitz or Hankel matrix A from one or two equations of the form Au = g. The general solution is described explicitly. Special cases are inverse spectral problems for Hankel and Toeplitz matrices and problems from the theory of orthogonal polynomials. INTRODUCTION When we speak of inverse problems we have in mind the following type of problems: Given vectors uj E C”, gj E C”’ (j = l,.. .,T), we ask for an m x n matrix A of a certain matrix class such that Auj = gj (j=l,...,?-). (0.1) In the present paper we deal with inverse problems with the additional condition that A is a Hankel matrix [ si +j] or a Toeplitz matrix [ ci _j]. Inverse problems for Hankel and Toeplitz matices occur, for example, in the theory of orthogonal polynomials when a measure p on the real line or the unit circle is wanted such that given polynomials are orthogonal with respect to this measure. The moment matrix of p is just the solution of a certain inverse problem and is Hankel (in the real line case) or Toeplitz (in the unit circle case); here the gj are unit vectors. LINEAR ALGEBRA AND ITS APPLICATIONS 165:1-23 (1992) 1 0 Elsevier Science Publishing Co., Inc., 1992 655 Avenue of tbe Americas, New York, NY 10010 0024-3795/92/$5.00 2 GEORG HEINIG Inverse problems for Toeplitz matrices were considered for the first time in the paper [lo]of M.
    [Show full text]
  • Hankel Matrix Rank Minimization with Applications to System Identification and Realization ∗
    HANKEL MATRIX RANK MINIMIZATION WITH APPLICATIONS TO SYSTEM IDENTIFICATION AND REALIZATION ∗ y z x { MARYAM FAZEL , TING KEI PONG , DEFENG SUN , AND PAUL TSENG In honor of Professor Paul Tseng, who went missing while on a kayak trip on the Jinsha river, China, on August 13, 2009, for his contributions to the theory and algorithms for large-scale optimization. Abstract. In this paper, we introduce a flexible optimization framework for nuclear norm minimization of matrices with linear structure, including Hankel, Toeplitz and moment structures, and catalog applications from diverse fields under this framework. We discuss various first-order methods for solving the resulting optimization problem, including alternating direction methods, proximal point algorithm and gradient projection methods. We perform computational experiments to compare these methods on system identification problem and system realization problem. For the system identification problem, the gradient projection method (accelerated by Nesterov's extrapola- tion techniques) and the proximal point algorithm usually outperform other first-order methods in terms of CPU time on both real and simulated data, for small and large regularization parameters respectively; while for the system realization problem, the alternating direction method, as applied to a certain primal reformulation, usually outperforms other first-order methods in terms of CPU time. Key words. Rank minimization, nuclear norm, Hankel matrix, first-order method, system identification, system realization 1. Introduction. The matrix rank minimization problem, or minimizing the rank of a matrix subject to convex constraints, has recently attracted much renewed interest. This problem arises in many engineering and statistical modeling application- s, where notions of order, dimensionality, or complexity of a model can be expressed by the rank of an appropriate matrix.
    [Show full text]
  • Exponential Decomposition and Hankel Matrix
    Exponential Decomposition and Hankel Matrix Franklin T. Luk Department of Computer Science and Engineering, Chinese University of Hong Kong, Shatin, NT, Hong Kong. [email protected] Sanzheng Qiao Department of Computing and Software, McMaster University, Hamilton, Ontario L8S 4L7 Canada. [email protected] David Vandevoorde Edison Design Group, Belmont, CA 94002-3112 USA. [email protected] 1 Introduction We consider an important problem in mathematical modeling: Exponential Decomposition. Given a finite sequence of signal values {s1,s2,...,sn}, determine a minimal positive integer r, complex coefficients {c1,c2,...,cr}, and distinct complex knots {z1,z2,...,zr}, so that the following exponential decomposition signal model is satisfied: r − s = c zk 1, for k =1,...,n. (1.1) k X i i i=1 We usually solve the above problem in three steps. First, determine the rank r of the signal sequence. Second, find the knots zi. Third, calculate the coefficients {ci} by solving an r × r Vandermonde system: W (r)c = s(r), (1.2) where 1 1 · · · 1 c1 s1 z1 z2 · · · zr c2 s2 (r) (r) W = . , c = . and s = . . . .. . . r−1 r−1 r−1 z1 z2 · · · zr cr sr A square Vandermonde system (1.2) can be solved efficiently and stably (see [1]). 275 276 Exponential Decomposition and Hankel Matrix There are two well known methods for solving our problem, namely, Prony [8] and Kung [6]. Vandevoorde [9] presented a single matrix pencil based framework that includes [8] and [6] as special cases. By adapting an implicit Lanczos pro- cess in our matrix pencil framework, we present an exponential decomposition algorithm which requires only O(n2) operations and O(n) storage, compared to O(n3) operations and O(n2) storage required by previous methods.
    [Show full text]
  • Analysis of a Fast Hankel Eigenvalue Algorithm
    Analysis of a Fast Hankel Eigenvalue Algorithm a b Franklin T Luk and Sanzheng Qiao a Department of Computer Science Rensselaer Polytechnic Institute Troy New York USA b Department of Computing and Software McMaster University Hamilton Ontario LS L Canada ABSTRACT This pap er analyzes the imp ortant steps of an O n log n algorithm for nding the eigenvalues of a complex Hankel matrix The three key steps are a Lanczostype tridiagonalization algorithm a fast FFTbased Hankel matrixvector pro duct pro cedure and a QR eigenvalue metho d based on complexorthogonal transformations In this pap er we present an error analysis of the three steps as well as results from numerical exp eriments Keywords Hankel matrix eigenvalue decomp osition Lanczos tridiagonalization Hankel matrixvector multipli cation complexorthogonal transformations error analysis INTRODUCTION The eigenvalue decomp osition of a structured matrix has imp ortant applications in signal pro cessing In this pap er nn we consider a complex Hankel matrix H C h h h h n n h h h h B C n n B C B C H B C A h h h h n n n n h h h h n n n n The authors prop osed a fast algorithm for nding the eigenvalues of H The key step is a fast Lanczos tridiago nalization algorithm which employs a fast Hankel matrixvector multiplication based on the Fast Fourier transform FFT Then the algorithm p erforms a QRlike pro cedure using the complexorthogonal transformations in the di agonalization to nd the eigenvalues In this pap er we present an error analysis and discuss
    [Show full text]
  • Paperfolding and Catalan Numbers Roland Bacher
    Paperfolding and Catalan numbers Roland Bacher To cite this version: Roland Bacher. Paperfolding and Catalan numbers. 2004. hal-00002104 HAL Id: hal-00002104 https://hal.archives-ouvertes.fr/hal-00002104 Preprint submitted on 17 Jun 2004 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Paperfolding and Catalan numbers Roland Bacher June 17, 2004 Abstract1: This paper reproves a few results concerning paperfolding sequences using properties of Catalan numbers modulo 2. The guiding prin- ciple can be described by: Paperfolding = Catalan modulo 2 + signs given by 2−automatic sequences. 1 Main results In this paper, a continued fraction is a formal expression a b + 1 = b + a b + a b + . 0 b + a2 0 1 1 2 2 1 b2+... with b0, b1,...,a1, a2,... ∈ C[x] two sequences of complex rational functions. We denote such a continued fraction by a1| a2| ak| b0 + + + . + + . |b1 |b2 |bk and call it convergent if the coefficients of the (formal) Laurent-series ex- pansions of its partial convergents P0 b0 P1 b0b1 + a1 Pk a1| a2| ak| = , = ,..., = b0 + + + . + ,... Q0 1 Q1 b1 Qk |b1 |b2 |bk k C 1 are ultimately constant.
    [Show full text]
  • Matrix Theory
    Matrix Theory Xingzhi Zhan +VEHYEXI7XYHMIW MR1EXLIQEXMGW :SPYQI %QIVMGER1EXLIQEXMGEP7SGMIX] Matrix Theory https://doi.org/10.1090//gsm/147 Matrix Theory Xingzhi Zhan Graduate Studies in Mathematics Volume 147 American Mathematical Society Providence, Rhode Island EDITORIAL COMMITTEE David Cox (Chair) Daniel S. Freed Rafe Mazzeo Gigliola Staffilani 2010 Mathematics Subject Classification. Primary 15-01, 15A18, 15A21, 15A60, 15A83, 15A99, 15B35, 05B20, 47A63. For additional information and updates on this book, visit www.ams.org/bookpages/gsm-147 Library of Congress Cataloging-in-Publication Data Zhan, Xingzhi, 1965– Matrix theory / Xingzhi Zhan. pages cm — (Graduate studies in mathematics ; volume 147) Includes bibliographical references and index. ISBN 978-0-8218-9491-0 (alk. paper) 1. Matrices. 2. Algebras, Linear. I. Title. QA188.Z43 2013 512.9434—dc23 2013001353 Copying and reprinting. Individual readers of this publication, and nonprofit libraries acting for them, are permitted to make fair use of the material, such as to copy a chapter for use in teaching or research. Permission is granted to quote brief passages from this publication in reviews, provided the customary acknowledgment of the source is given. Republication, systematic copying, or multiple reproduction of any material in this publication is permitted only under license from the American Mathematical Society. Requests for such permission should be addressed to the Acquisitions Department, American Mathematical Society, 201 Charles Street, Providence, Rhode Island 02904-2294 USA. Requests can also be made by e-mail to [email protected]. c 2013 by the American Mathematical Society. All rights reserved. The American Mathematical Society retains all rights except those granted to the United States Government.
    [Show full text]
  • Forward-Backward Hankel Matrix Fitting for Spectral Super-Resolution
    Forward-Backward Hankel Matrix Fitting for Spectral Super-Resolution Zai Yang and Xunmeng Wu School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, China [email protected] Abstract—Hankel-based approaches form an important class which eventually results in simple algorithm design [6]–[8]. of methods for line spectral estimation within the recent spec- However, this causes a fundamental limitation of Hankel- tral super-resolution framework. However, they suffer from the based methods, to be specific, the estimated poles do not fundamental limitation that their estimated signal poles do not lie on the unit circle in general, causing difficulties of physical lie on the unit circle in general, resulting in difficulties of interpretation and performance loss. In this paper, we present physical interpretation and potential performance loss (see the a modified Hankel approach called forward-backward Hankel main context). This paper aims at resolving this fundamental matrix fitting (FB-Hankel) that can be implemented by simply problem. modifying the existing algorithms. We show analytically that In this paper, by using the classic forward-backward tech- the new approach has great potential to restrict the estimated poles on the unit circle. Numerical results are provided that nique [9], we propose a modified Hankel-based approach for corroborate our analysis and demonstrate the advantage of FB- line spectral estimation, named as forward-backward Hankel Hankel in improving the estimation accuracy. 1 matrix fitting (FB-Hankel). The core of FB-Hankel is introduc- Index Terms—Forward-backward Hankel matrix fitting, line ing a (conjugated) backward Hankel matrix which is composed spectral estimation, spectral super-resolution, Vandermonde de- of the same spectral modes as and processed jointly with composition, Kronecker’s theorem.
    [Show full text]
  • A Panorama of Positivity
    A PANORAMA OF POSITIVITY ALEXANDER BELTON, DOMINIQUE GUILLOT, APOORVA KHARE, AND MIHAI PUTINAR Abstract. This survey contains a selection of topics unified by the concept of positive semi-definiteness (of matrices or kernels), reflecting natural constraints imposed on discrete data (graphs or networks) or continuous objects (probability or mass distributions). We put empha- sis on entrywise operations which preserve positivity, in a variety of guises. Techniques from harmonic analysis, function theory, operator theory, statistics, combinatorics, and group representations are invoked. Some partially forgotten classical roots in metric geometry and distance transforms are presented with comments and full bibliographical refer- ences. Modern applications to high-dimensional covariance estimation and regularization are included. Contents 1. Introduction 2 2. From metric geometry to matrix positivity 4 2.1. Distance geometry 4 2.2. Spherical distance geometry 6 2.3. Distance transforms 6 2.4. Altering Euclidean distance 8 2.5. Positive definite functions on homogeneous spaces 11 2.6. Connections to harmonic analysis 15 3. Entrywise functions preserving positivity in all dimensions 18 Date: November 13, 2019. 2010 Mathematics Subject Classification. 15-02, 26-02, 15B48, 51F99, 15B05, 05E05, arXiv:1812.05482v3 [math.CA] 12 Nov 2019 44A60, 15A24, 15A15, 15A45, 15A83, 47B35, 05C50, 30E05, 62J10. Key words and phrases. metric geometry, positive semidefinite matrix, Toeplitz ma- trix, Hankel matrix, positive definite function, completely monotone functions, absolutely monotonic functions, entrywise calculus, generalized Vandermonde matrix, Schur polyno- mials, symmetric function identities, totally positive matrices, totally non-negative matri- ces, totally positive completion problem, sample covariance, covariance estimation, hard / soft thresholding, sparsity pattern, critical exponent of a graph, chordal graph, Loewner monotonicity, convexity, and super-additivity.
    [Show full text]
  • Total Positivity of Toeplitz Matrices of Recursive Hypersequences∗
    ISSN 1855-3966 (printed edn.), ISSN 1855-3974 (electronic edn.) ARS MATHEMATICA CONTEMPORANEA 17 (2019) 125–139 https://doi.org/10.26493/1855-3974.1526.b8d (Also available at http://amc-journal.eu) Total positivity of Toeplitz matrices of recursive hypersequences∗ Tomislav Dosliˇ c´ Faculty of Civil Engineering, University of Zagreb, Zagreb, Croatia Ivica Martinjak Faculty of Science, University of Zagreb, Zagreb, Croatia Riste Skrekovskiˇ FMF, University of Ljubljana, Ljubljana, Slovenia Faculty of Information Studies, Novo Mesto, Slovenia FAMNIT, University of Primorska, Koper, Slovenia Received 9 November 2017, accepted 12 March 2019, published online 6 September 2019 Abstract We present a new class of totally positive Toeplitz matrices composed of recently in- troduced hyperfibonacci numbers of the r-th generation. As a consequence, we obtain that (r) all sequences Fn of hyperfibonacci numbers of r-th generation are log-concave for r ≥ 1 and large enough n. Keywords: Total positivity, totally positive matrix, Toeplitz matrix, Hankel matrix, hyperfibonacci sequence, log-concavity. Math. Subj. Class.: 15B36, 15A45 1 Introduction and preliminary results A matrix M is totally positive if all its minors are positive real numbers. When it is allowed that minors are zero, then M is said to be totally non-negative. Such matrices appears in many areas having numerous applications including, among other topics, graph theory, ∗Partial support of the Croatian Science Foundation through project BioAmpMode (Grant no. 8481) is grate- fully acknowledged by the first author. All authors gratefully acknowledge partial support of Croatian-Slovenian bilateral project “Modeling adsorption on nanostructures: A graph-theoretical approach” BI-HR/16-17-046.
    [Show full text]
  • Positive Definite Hankel Matrices Using Cholesky Factorization
    COMPUTATIONAL METHODS IN APPLIED MATHEMATICS, Vol.9(2009), No.3, pp.221–225 c 2009 Institute of Mathematics of the National Academy of Sciences of Belarus POSITIVE DEFINITE HANKEL MATRICES USING CHOLESKY FACTORIZATION S. AL-HOMIDAN1 AND M. ALSHAHRANI1 Abstract — Real positive definite Hankel matrices arise in many important applica- tions. They have spectral condition numbers which exponentially increase with their orders. We give a structural algorithm for finding positive definite Hankel matrices using the Cholesky factorization, compute it for orders less than or equal to 30, and compare our result with earlier results. 2000 Mathematics Subject Classification: 65F99, 99C25, 65K30. Keywords: Cholesky factorization, Hankel matrices, real positive definite matrices. 1. Introduction An n × n Hankel matrix H is one with constant antidiagonal elements. It has the following structure: h1 h2 h3 ··· ··· hn h h h ··· h h 2 3 4 n n+1 H = . .. .. .. . ··· . h h ··· ··· ··· h − n n+1 2n 1 The general complex-valued elements can be well-conditioned while real positive definite Hankel matrices are known to be very ill-conditioned since their spectral condition numbers increase exponentially with n. The condition number of a positive definite Hankel matrix is bounded below by 3 · 2(n−6) which is very large even for relatively small orders [9]. Becker- mann [6] gave a better bound γn−1/(16n) with γ ≈ 3.210. Here, we try to force the condition number of the constructed matrix to be as small as possible to reach the latter, or at least the former, experimentally. Several other authors have developed algorithms for the factorization or inversion of Hankel matrices [7, 8, 10].
    [Show full text]
  • Hankel Operators Plus Orthogonal Polynomials Yield Combinatorial Identities
    Hankel Operators plus Orthogonal Polynomials Yield Combinatorial Identities E. A. Herman, Grinnell College ∗ Abstract: A Hankel operator H = [hi+j] can be factored as H = MM , where M maps a space of L2 functions to the corresponding moment sequences. Furthermore, a necessary and sufficient condition for a sequence to be in the range of M can be expressed in terms of an expansion in orthogonal polynomials. Combining these two results yields a wealth of combinatorial identities that incorporate both the matrix entries hi+j and the coefficients of the orthogonal polynomials. 2000 Mathematics Subject Classification: 47B35, 33D45, 05A19. Keywords: Hankel operators, Hausdorff moments, orthogonal polynomials, combinatorial identities, Hilbert matrices, Legendre polynomials, Fibonacci numbers. 1. Introduction The context throughout this paper will be the Hilbert spaces l2 of square-summable se- 2 quences and Lα( 1, 1) of square-integrable functions on [ 1, 1] with the distribution dα, α nondecreasing.− Their inner products are the usual dot− product for the former and the usual integral inner product for the latter. The Hankel operators in Section 2 are exactly as in [9]. That is, we study the infinite matrices H = [hi+j]i,j≥0, where 1 j hj = x dα(x), j =0, 1, 2,... Z−1 The following result in [9] will be essential: Widom’s Theorem: The following are equivalent: (a) H represents a bounded operator on l2. (b) h = O(1/j) as j . j →∞ (c) α(1) α(x)= O(1 x) as x 1−, α(x) α( 1) = O(1 + x) as x 1+. − − → − − → − 1 In Theorem 1 we show that H = MM ∗, where M : L2 ( 1, 1) l2 is the bounded operator α − → that maps each function f L2 ( 1, 1) to its sequence of moments: ∈ α − 1 k M(f)k = x f(x) dα(x), k =0, 1, 2,..
    [Show full text]