R ESEARCH ARTICLE ScienceAsia 35 (2009): 106–110 doi: 10.2306/scienceasia1513-1874.2009.35.106 Inequalities for Kronecker products and Hadamard products of positive definite matrices Pattrawut Chansangiam∗, Patcharin Hemchote, Praiboon Pantaragphong Department of Mathematics and Computer Science, Faculty of Science, King Mongkut’s Institute of Technology Ladkrabang, Bangkok 10520, Thailand ∗ Corresponding author, e-mail: [email protected] Received 9 Oct 2008 Accepted 15 Jan 2009 ABSTRACT: The purpose of this paper is to develop inequalities for Kronecker products and Hadamard products of positive definite matrices. A number of inequalities involving powers, Kronecker powers, and Hadamard powers of linear combination of matrices are presented. In particular, Holder¨ inequalities and arithmetic mean-geometric mean inequalities for Kronecker products and Hadamard products are obtained as special cases. KEYWORDS:Lowner¨ partial order, jointly concave map INTRODUCTION that A is positive semidefinite. The relation “6” is reflexive, antisymmetric and transitive, i.e., “6” forms Inequalities have proved to be powerful tools in a partial order on the space of Hermitian matrices. mathematics. Matrix inequalities arise in various This is known as the Lowner¨ partial order 5. In fact, branches of mathematics and science such as system this relation does not form a total order on the space of and control theory 1, optimization 2 and semidefinite Hermitian matrices; there are Hermitian matrices A, programming 3. Matrix inequalities are also important B of same size which are not comparable, i.e., neither tools in quantum statistical inference and quantum A 6 B nor A > B holds. information theory 4. This paper is concerned with Now we introduce matrix products that differ inequalities for Kronecker products and Hadamard from the ordinary matrix multiplication. A notion products of special kinds of matrices. Let us begin which is useful in the study of matrix equations and with some terminology and notation. other applications is the Kronecker product of matri- As usual, R stands for the set of real numbers. ces. The Kronecker product of A = [aij] ∈ Mm,n and Denote the set of all m × n complex matrices by B = [bij] ∈ Mp,q is defined to be the block matrix Mm,n and abbreviate Mn,n to Mn for convenience. a B ··· a B The identity matrix in Mn is denoted by In or I if the 11 1n . size of matrix is clear. A matrix A ∈ Mn is Hermitian A ⊗ B := . .. ∈ Mmp,nq. ∗ ∗ if A = A, where denotes the conjugate transpose. a B ··· a B ∗ m1 mn A ∈ Mn is positive semidefinite if x Ax > 0 for all vectors x ∈ Cn (Cn is the set of n-tuples of This matrix product has very nice properties. The complex numbers). If A is positive semidefinite and most important is the mixed-product property: invertible, then A is positive definite. An equivalent (A ⊗ B)(C ⊗ D) = AC ⊗ BD condition for A ∈ Mn to be positive definite is that A is Hermitian and all eigenvalues of A are positive real numbers. A Hermitian matrix with the positivity for matrices A, B, C, D with appropriate sizes. The property (a positive definite matrix), which plays a set of positive semidefinite matrices is closed under similar role to a positive real number, is an important the Kronecker product, i.e. kind of matrix. The set of all n × n positive definite A > 0,B > 0 =⇒ A ⊗ B > 0. matrices is represented by Pn. By inequalities for matrices we mean inequalities The Hadamard product of A, B ∈ Mm,n is the in the Lowner¨ sense. Given Hermitian matrices A and entrywise product B of the same size, A 6 B means that B − A is positive semidefinite. In particular, A > 0 indicates A ◦ B := [aijbij] ∈ Mm,n. www.scienceasia.org ScienceAsia 35 (2009) 107 The Hadamard product differs from the ordinary where α, β are scalars. A map ψ : Pn × Pn → Pm product in many ways. The most important is that is jointly concave if for any A, B, C, D ∈ Pn and any Hadamard multiplication is commutative. The most 0 < < 1, basic properties of the product is the closure of the cone of positive semidefinite matrices under the ψ A + (1 − )B, C + (1 − )D) Hadamard product (Schur product theorem 6), i.e. > ψ(A, C) + (1 − )ψ(B, D). The following fact is well-known. A > 0,B > 0 =⇒ A ◦ B > 0. Lemma 2 (Ando 7) A map Φ defined by Φ(A, B) = −1 −1 −1 Inequalities for the Kronecker product and the (A + B ) for A, B ∈ Pn is jointly concave. 6–10 Hadamard product of matrices have a long history . The following identity is used in the next section. There are many results associated with them. In this paper we study inequalities for Kronecker products Lemma 3 The following identity holds for any and Hadamard products involving powers, Kronecker A, B ∈ Pn and s > 0 : powers and Hadamard powers of linear combinations −1 (s−1A ⊗ I)−1 + (I ⊗ B)−1 of matrices. We derive some inequalities and then in- −1 vestigate results under special cases. Among these we = (A ⊗ B−1) (A ⊗ B−1) + (sI ⊗ I) (I ⊗ B). obtain Holder¨ and arithmetic mean-geometric mean (1) (AM-GM) inequalities. Proof : Since A and B are positive definite and s PRELIMINARIES is positive, all terms in the equality (1) are existent, We recall the concept of maps on matrix spaces. Let f positive definite and nonsingular. For convenience, −1 −1 be a continuous real-valued function on a real interval write X = s A ⊗ I, Y = I ⊗ B, Z = A ⊗ B and P = X + Y . It follows from the mixed-product Ω. Let A ∈ Mn be Hermitian with eigenvalues λ1, λ2, . , λn contained in Ω. Since A is Hermitian, property of the Kronecker product that A can be decomposed as Z + (sI ⊗ I) (s−1I ⊗ I) − (s−1Y )P −1(s−1Z) ∗ −1 −1 A = U diag[λ1, λ2, . , λn] U = Z(s I ⊗ I) + (sI ⊗ I)(s I ⊗ I) − Z(s−1Y )(X + Y )−1(s−1Z) where U is unitary (i.e. U ∗U = I) and −1 −1 −1 diag[λ1, λ2, . , λn] is the diagonal matrix with diag- − (sI ⊗ I)(s Y )(X + Y ) (s Z) onal entries λ1, λ2, . , λn. The functional calculus = (s−1Z) + (I ⊗ I) − X(X + Y )−1(s−1Z) for A is defined as − Y (X + Y )−1(s−1Z) ∗ −1 −1 −1 f(A) = U diag[f(λ1), f(λ2), . , f(λn)] U . = (s Z) + In2 − (X + Y )(X + Y ) (s Z) = In2 . For example, if A ∈ Pn and r ∈ R, then That is Ar = U diag[λr, λr, . , λr ] U ∗. 1 2 n (s−1I ⊗ I) − (s−1Y )(X + Y )−1(s−1Z) −1 The following property involving Kronecker products = Z + (sI ⊗ I) . of positive definite matrices can be derived from the Again, the mixed-product property yields mixed-product property. −1 Z−1X−1 + Y −1 Y −1 Lemma 1 (Horn and Johnson 6) For any A, B ∈ Pn = Z−1X − X(X + Y )−1XY −1 and r ∈ R, we have (A ⊗ B)r = Ar ⊗ Br. = (A−1 ⊗ B)X(Y −1) A map Φ: Mn → Mm is unital if Φ maps − (A−1 ⊗ B)X(X + Y )−1XY −1 unit element to unit element, i.e. Φ(In) = Im. −1 −1 −1 −1 Φ is positive if Φ maps positive element to positive = (s I ⊗ I) − (s Y )(X + Y ) (s Z) −1 element, i.e. A > 0 ⇒ Φ(A) > 0. Φ is linear if Φ = Z + (sI ⊗ I) . preserves addition and scalar multiplication, i.e., −1 Thus, (X−1 +Y −1)−1 = ZZ +(sI ⊗I) Y which Φ(αA + βB) = αΦ(A) + βΦ(B) is (1). www.scienceasia.org 108 ScienceAsia 35 (2009) INEQUALITIES FOR KRONECKER is jointly concave. It is well-known that the positive PRODUCTS linear combination of the jointly concave maps is In this section we derive inequalities for the Kronecker jointly concave. Hence, from the viewpoint of the Riemann integral, the integrand is also jointly con- product of positive definite matrices in the form (αA+ r 1−r βB)r ⊗ (αC + βD)s and α(Ar ⊗ Cs) + β(Br ⊗ cave, and so is A ⊗ B . This means that for any Ds) where A, B, C, D are positive definite matrices A, B, C, D ∈ Pn and scalar 0 < < 1, and α, β, r, s are positive real numbers such that r + r s s = 1. (A + (1 − )B) ⊗ (C + (1 − )D) r s r s > (A ⊗ C ) + (1 − )(B ⊗ D ) Theorem 1 For A, B, C, D ∈ Pn and α, β, r, s > 0 such that r + s = 1, for s > 0 and r + s = 1. Since 0 < α/(α + β) < 1, by setting = α/(α + β), we get (2). (αA + βB)r ⊗ (αC + βD)s From this theorem, we obtain the Holder¨ inequal- ity for positive definite matrices as a special case. α(Ar ⊗ Cs) + β(Br ⊗ Ds). (2) > Recall that real numbers p, q are conjugate exponents Proof : Let f be a real-valued function defined by if p, q are positive and 1/p + 1/q = 1. f(t) = tr for t > 0 and 0 < r < 1. Clearly, f is Corollary 1 For A, B, C, D ∈ and conjugate continuous. Recall an integral representation of f (see Pn exponents p, q, we have Ref. 8): Z ∞ r−1 r sin rπ s t p p 1 q q 1 t = ds. (A⊗B)+(C⊗D) 6 (A +C ) p ⊗(B +D ) q . (3) π 0 s + t For convenience, write Y = I ⊗B and Z = A⊗B−1.