Singular Values, Diagonal Elements, and Extreme Matrices Hector F
Total Page:16
File Type:pdf, Size:1020Kb
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Linear Algebra and its Applications 305 (2000) 151–159 www.elsevier.com/locate/laa Singular values, diagonal elements, and extreme matrices Hector F. Miranda Departamento de Matemática, Universidad del Bío-Bío, Casilla 1102, Concepción, Chile Received 26 February 1999; accepted 23 September 1999 Submitted by R.A. Brualdi Abstract For complex matrices A and B there are inequalities related to the diagonal elements of AB and the singular values of A and B. We study the conditions on the matrices for which those inequalities become equalities. In all cases, the conditions are both necessary and sufficient. © 2000 Elsevier Science Inc. All rights reserved. AMS classification: 15A45; 15A18 Keywords: Singular values; Diagonal elements; Extreme cases Given an n × n complex matrix A, three sets of numbers are of particular interest: eigenvalues λ1,...,λn(|λ1|>···>|λn|), singular values a1 > ···>an, and diag- onal elements d1,...,dn(|d1|>···>|dn|). The relation between the eigenvalues and the singular values was obtained by Weyl [15] and Horn [5] and the relation between the diagonal elements and the singular values was obtained by Thompson [12] and Sing [9] independently. However, the relation between the eigenvalues and the diagonal elements is far from trivial, even for normal A [13]. Some inequalities for the singular valuesQ of the productQ C = AB and the singular k 6 k = − values of A and B are well-known, e.g. i=1 ci i=1 aibi,k 1,...,n 1and equality holds when k = n [4]. This immediately yields its additive version and Lemma 4. E-mail address: [email protected] (H.F. Miranda). 0024-3795/00/$ - see front matter ( 2000 Elsevier Science Inc. All rights reserved. PII:S0024-3795(99)00221-9 152 H.F. Miranda / Linear Algebra and its Applications 305 (2000) 151–159 So, if di,i =1,...,n,denote the diagonal elements of AB their absolute values in nonincreasing order, then one has (part of Theorem 1) |d1|+···+|dk|6a1b1+···+akbk,k=1,...,n and the inequality with a subtracted term |d1|+···+|dn−1|−|dn|6a1b1+···+an−1bn−1 −anbn. These inequalities completely describe the relation between the diagonal entries of a product AB and the singular values of A and B, respectively [8]. In recent years inequalities of subtracted term have appeared repeatedly and turn out to be closely related to the root system of some real simple Lie algebras. Here, we consider when these inequalities become equalities. The main results are Theorem 2 (for the weak majorization) and Theorem 3 (for the subtracted term inequality). The proofs rely on Lemma 3 and some work of Li [6] on the characterization of extremal matrices. Let A and B be n × n complex matrices with singular values a1 > ···>an and b1 > ···>bn, respectively. Denote the set of n × n complex matrices by Mn. The 1937 trace inequality of von Neumann [14] asserts that Re(tr(AB)) 6 a1b1 +···+anbn, where Re denotes the real part, and tr the trace. This inequality has commanded attention in more than 60 years since it was found and several applications of it in pure and applied mathematics are known. These include applications of group induced orderings to statistics [2], nonlinear elasticity [1], and applications to perturbation theory [10]. For more references, see [7]. A more detailed study of the theorem seems justified. Thus, in [8] we asked about the conditions satisfied by the individual diagonal elements of the product that sum to give the trace, and the answer was given in the following theorem. Theorem 1. Let A and B be in Mn with singular values a1 > ···>an and b1 > ···>bn,respectively. Then if d1,...,dn denote the elements of the principal diag- onal of AB numbered in order of decreasing absolute values, we have that |d1|+···+|dk|6a1b1+···+akbk,k=1,...,n, |d1|+···+|dn−1|−|dn|6a1b1+···+an−1bn−1 −anbn. Conversely, if we have numbers satisfying the above inequalities, there exist matrices A and B with singular values a1 > ···>an and b1 > ···>bn, respect- ively, and d1,...,dn the diagonal entries of AB. Here, we want to study the structure of the matrices in the case when the in- equalities from Theorem 1 become equalities. In order to obtain an answer we need some results. Thompson [12] found the conditions satisfied by the diagonal elements and singular values of a complex matrix. Li [6] studied the extreme cases of these inequalities and found that: H.F. Miranda / Linear Algebra and its Applications 305 (2000) 151–159 153 Lemma 1. Let A ∈ Mn with singular values a1 > ···>an, diagonal elements d1,...,dn such that |d1| > ···>|dn|.Let16k6n. Then |d1|+···+|dk|=a1+···+ak if and only if A = A1 ⊕ A2 (A1 ∈ Mk) and there exists a diagonal matrix D ∈ U(k) such that DA1 is a positive semidefinite matrix with eigenvalues a1,...,ak. Lemma 2. Let A ∈ Mn with singular values a1 > ···>an diagonal elements d1,...,dn such that |d1| > ···>|dn|.Then |d1|+···+|dn−1|−|dn|=a1+···+an−1 −an if and only if there exists a diagonal matrix D ∈ U(n) such that DA is a hermitian matrix with diagonal elements |d1|,...,|dn−1|,−|dn|; and eigenvalues a1,...,an−1, −an. Horn [4] proved that the vector of singular values of a product of two matrices is weakly majorized by the vector of the corresponding products of singular values of the factors, when they are ordered in decreasing order. The equality case is given in the next lemma. Lemma 3. Let A, B ∈ Mn with singular values a1 > ···>an,and b1 > ···>bn, respectively. Let c1 > ···>cn denote the singular values of AB. Let 1 6 k 6 n. Then c1 +···+ck =a1b1 +···+akbk if and only if there are U,V,W ∈ U(n),the n × n unitary group, such that U ∗AV = ∗ diag(a1,...,ak)⊕A2 and V BW = diag(b1,...,bk)⊕B2 for some A2,B2 ∈ Mn−k. Proof. First assume that k 6 min {rank A, rank B},soakbk >0. The singular value decomposition ensures that there are n × n unitary matrices X =[X1 X2]and Y = [Y Y ] such that X ,Y ∈M and 1 2 1 1 n,k ∗ ∗ ∗ = = X1ABY1 X (AB) Y diag(c1, ..., cn) ∗∗. ∗ In particular, X1 A (BY1) is positive semidefinite. Since " # X∗A X∗A = 1 , X∗A 2 ∗ 6 ∗ = = singular value interlacing ensures that σi X1 A σi (X A) ai for all i 1, ..., k. If these inequalities are all equalities, then the k largest eigenvalues of " # ∗ ∗ ∗ X AA X1 ∗ G = X∗A X∗A = 1 ∗ ∗ ∗ X2AA X1 154 H.F. Miranda / Linear Algebra and its Applications 305 (2000) 151–159 ∗ ∗ are exactly the k eigenvalues of its principal submatrix H ≡ X AA X1, which means 1 ∗ ∗ that the interlacing inequalities for H in G are all equalities; this forces X AA X1 = ∗ ∗ 2 0(therowsofX1Aare orthogonal to the rows of X2A). A similar conclusion holds for B. Now compute Xk = ∗ = ∗ ci tr X1A (BY1) tr (BY1) X1A i=1 Xk 6 ∗ σi BY1X1A (1) i=1 Xk 6 ∗ σi (BY1)σi X1A i=1 Xk 6 σi (A)σi (B) (2) i=1 Xk Xk = aibi = ci. i=1 i=1 Thus, all these inequalities are equalities. ∗ = = Equality at (2) means that all σi X1 A σi (A) and σi (BY1) σi (B) since all the terms are positive (here’s where we use the rank assumption). ∗ Equality at (1)means that (BY1) X A is positive semidefinite. Since we already ∗ 1 know that X1A (BY1) is positive semidefinite, the simultaneous singular value ∈ ∈ ∗ = R ∗ decomposition [3] says there are Z U(k) and W U(n) such that X1A Z W ∗ T and BY = WKZ ,whereR=[DA 0]∈Mk,n and K =[PDB 0]∈Mk,n, DA = diag(a1,...,ak), DB =diag(b1,...,b k),and Pis someP permutation matrix. The ∗ = k usual interchange argument using tr X1A (BY1) i=1 aibi ensures that the bi are in the correct position when the ai are distinct, or that they can be put into correct position via a harmless permutation (which is then absorbed into W) when some ai are repeated. The conclusion is that there are Z ∈ U(k) and W =[W1 W2]∈U(n) ∈ ∗ = R ∗ = ∗ = K ∗ = ∗ such that W1 Mn,k, X1 A Z W ZDAW1 ,andBY W Z W1DBZ . Compute " # " # ∗ ∗ ∗ X X AW1 X AW2 X∗AW = 1 A W W = 1 1 ∗ 1 2 ∗ ∗ X2 X2AW1 ∗ ∗ " # ZDAW1 W1 ZDAW1 W2 ZD 0 = = A ∗ ∗ −1 ∗ ∗ X2A A X1ZDA 0 ∗ = ∗ ∗ = since W1 W2 0andX2AA X1 0. Finally, H.F. Miranda / Linear Algebra and its Applications 305 (2000) 151–159 155 " # ∗ ∗ DA 0 Z ⊕ In−k X AW = 0 ∗ is a representation of the required form. A similar argument gives a representation of the desired form for B. Now suppose that k1 = rank A 6 rank B and k>k1.ThenrankAB 6 k1,so ci=0ifi>k1,and Xk1 Xk Xk Xk1 ci = ci = aibi = aibi. i=1 i=1 i=1 i=1 The preceding argument ensures that there are unitary U and V such that " # " # ∗ DA 0 ∗ DB 0 U AV = and U BV = , 00 0 B2 ∗ where DA,DB ∈Mk .LetB2 =V3DW be a singular value decomposition. Then 1 "3 # ∗ ∗ DA 0 U1 I ⊕ V U AV (I ⊕ W3) = 3 00 and " # ∗ ∗ DB 0 I ⊕ V U BV (I ⊕ W3) = 3 0 D is a representation of the desired form for all k > k1. The converse is clear. Let us prove now an inequality with subtracted term satisfied by the singular values of a product of matrices and the singular values of the factors.