arXiv:1903.05360v1 [math.NA] 13 Mar 2019 otasomtemti qain()it oewell-resear more a into (1) equation the transform to li the analyzing theoret then whose and [7], systems linear in large (1) into equation equation matrix the of solution necessa one the regarding ex been contribution not theoretical have solution important the howe of 6]); uniqueness 5, the as [4, such e.g., itself (see developed, well been have methods hoe 1. Theorem theo following the in shown as equation, matrix transformed equation where n suppose and ecnie h -oguneSletreuto fteform the of equation Sylvester T-congruence the consider We Introduction 1 [email protected] {y-satake,m-oozawa,sogabe,kemmochi,zhang}@na.nuap.n where btatmteaia ed h agn pcso h Stief the a of excitation spaces tangent the the under field: mathemat tracks mathematical rail applied abstract of and vibration industrial the the studying in appears (1) equation † ∗ yemdaCne,OaaUiest,13 Machikaneyama, 1-32 University, Furo-c Osaka University, Nagoya Center, Engineering, Cybermedia of School Graduate huhirlvn oteaoe oaae l,i 08 devel 2018, in al., et Oozawa above, the to irrelevant Though nteps eae h ueia ovr o ovn equati solving for solvers numerical the decade, past the In eainbtenteTcnrec yvse qainadt and equation Sylvester T-congruence the between Relation n h te sanvltasomto o h case the for transformation novel a is other the and etnua matrices rectangular rnfrainta h arxeuto seuvln oo to transfor equivalent the is of condition equation the however, matrix equation); Lyapunov the that transformation a and A X A ˜ and : h -oguneyvse qaini h arxequation matrix the is equation T-congruenceSylvester The ∈ = C R AX B Λ [,Term3.1]) Theorem ([8, ∈ m ( r sue ob qaemtie ( matrices square be to assumed are S × R and n ) m , srcpoa re hnteTcnrec yvse equati Sylvester T-congruence the Then free. reciprocal is × B m Q ∈ r ie,and given, are uoMiyatake Yuto : = R A C n uiSatake Yuki and × ( − m and , eeaie yvse equation Sylvester generalized B SC Let n fte sa xeso ftersl fOzw ta.frt for al. et Oozawa of result the of extension an is them of One . ) T A C . , X B ooaKemmochi Tomoya , † ∈ , aaaOozawa Masaya , ∗ ∈ C R R ∈ m n × R × m m n AX X ˜ × m r ie,and given, are st edtrie.Rcnl,Ozw ta.discovered al. et Oozawa Recently, determined. be to is n − n suethat assume and = Abstract + S m n XS X ˜ .I hsppr w rnfrain r rvddfor provided are transformations two paper, this In ). 1 agoya-u.ac.jp T ≤ yadsffiin odto o h xsec fexactly of existence the for condition sufficient and ry B T n lmnfl [3]. manifold el = ersystems. near . = iigfo ihsedtan 1 ]adas nan in also and 2] [1, trains high-speed from rising lrdetniey n21,Trne l rvddan provided al. et Terán 2018, In extensively. plored hdmti qain i.e., equation, matrix ched ainsest etolmtdbcuematrices because limited too be to seems mation ∗ rem: clapoc sbsdo rnfrigtematrix the transforming on based is approach ical e,tetertclfaue ftemti equation matrix the of features theoretical the ver, Q ooioSogabe Tomohiro , C clfil:plnrmcegnau rbesfor problems eigenvalue palindromic field: ical o hks-u aoa4480,Jpn Email: Japan, 464-8603, Nagoya Chikusa-ku, ho, , eo h elsuidmti qain (the equations matrix well-studied the of ne , ∗ AX hoLagZhang Shao-Liang , n()i iwo ietmtosaditerative and methods direct of view in (1) on X pdanvltasomto htcnb used be can that transformation novel a oped ooaa sk 6-03 aa,Email: Japan, 560-0043, Osaka Toyonaka, + A ∈ X snniglr oevr let Moreover, nonsingular. is R T B n × = m n()i qiaett h Lyapunov the to equivalent is (1) on C st edtrie.Tematrix The determined. be to is where , ∗ A X ∗ ∈ T R osntapa nits in appear not does m ecase he × n , B ∈ m R S n ≥ he : × = m n , , B T A (1) − 1 The significance of Theorem 1 is that finding mathematical features and solvers of the matrix equation (1) reduces to only finding them of the Lyapunov equation whose features are studied extensively in control theory [9] and whose solvers have been well developed (see e.g., [10]). Furthermore, very recently, Miyajima utilized Theorem 1 to design a fast verified algorithm for the solution of the matrix equation (1) in [11]. From the viewpoint of the complexities of the numerical error verification, utilizing Theorem 1 successfully reduces the complexities of O(n6) to O(n3). Although Theorem 1 is of interest, the class of matrices that satisfies the required condition is limited. In fact, Theorem 1 does not hold if matrices A and B are rectangular. This motivates us to find transformations for the case where matrices A and B are rectangular. We will see in the following sections that a transformation for the case m ≥ n can be regarded as an extension of Theorem 1, and a transformation for the case m ≤ n is a novel transformation in that a similar mathematical approach as used in Theorem 1 cannot be employed mainly due to under-determined linear systems underlying the matrix equation. The rest of this paper is organized as follows. Section 2 describes some mathematical preliminaries on the . Section 3 presents the main results that under some conditions the T-congruence Sylvester equation is equivalent to a generalized Sylvester equation. The conclusion is provided in Section 4. m×m Throughout this paper, Λ(S) denotes the spectrum of S, i.e., the set of eigenvalues of S ∈ R . Let Im denote the m × m identity matrix and A† the Moore–Penrose inverse of A.

2 Preliminaries

In this section, some mathematical preliminaries are collected on the Kronecker product and the vectorization m×n p×q of a matrix, referred to as the vec operator. Given A = [aij ]∈ R and B ∈ R , the Kronecker product ⊗ is defined by    a11B a12B ··· a1n B     a21B a22B ··· a2n B  A ⊗ B =   ∈ Rmp×nq . :  . . . . .   . . . .    am1B am2B ··· amnB In addition, for C ∈ Rn×l and D ∈ Rq×r , it is known that

(A ⊗ B)(C ⊗ D) = (AC) ⊗ (BD).

Any eigenvalue of A ⊗ B is a product of an eigenvalue of A and an eigenvalue of B as shown below.

m×m Lemma 2. ([12, p.412]) Let λ1,...,λm be the eigenvalues of A ∈ R and µ1,...,µn be the eigenvalues of B ∈ Rn×n. Then the eigenvalues of A ⊗ B can be written as

λi µj (1 ≤ i ≤ m, 1 ≤ j ≤ n).

m×n m×n mn For A = [a1, a2,..., an]∈ R , the vec operator, vec : R → R is defined by   a1    a2  ( ) =   Rmn vec A :  .  ∈ ,  .    an and the inverse vec operator, vec−1 : Rmn → Rm×n is defined by

vec−1(vec(A)) = A.

For the vec operator, the following fact holds:

2 Lemma 3. ([13, Theorem 10]) Let A ∈ Rm×n, B ∈ Rn×p, and C ∈ Rp×q. Then, it follows that

vec(ABC) = (CT ⊗ A)vec(B).

We collect some properties on permutation matrices related to the vec operator.

Lemma 4. ([13]) Let ein denote an n-dimensional column vector which has 1 in the ith position and 0 for otherwise, i.e., T n ein := [0, 0,..., 0, 1, 0,..., 0] ∈ R . Let A ∈ Rm×n and B ∈ Rp×q. Then, for the permutation matrix

 eT  Im ⊗ 1n  T  Im ⊗ e  P =  2n ∈ Rmn×mn, mn :  .   .   eT  Im ⊗ nn the following properties hold:

T = Pmn Pnm, (2) T = T = PmnPmn PmnPmn Imn, (3) T vec(A) = Pmnvec(A ), (4) T = Pmp(A ⊗ B)Pnq B ⊗ A. (5)

It is known that T-congruence Sylvester equation (1) can be transformed into a linear system whose coefficient matrix has the Kronecker product structure with the permutation matrix multiplication (Pmm). To see this, applying the vec operator to (1) with Lemma 3 yields

T T (Im ⊗ A)vec(X) + (B ⊗ Im)vec(X ) = vec(C). (6)

It follows from (3), (4), and (5) of Lemma 4 that the second term of the left-hand side of equation (6) is

T T T (B ⊗ Im)vec(X ) = (B ⊗ Im)Pmnvec(X) = T T Pmm(Im ⊗ B )PmnPmnvec(X) T = Pmm(Im ⊗ B )vec(X).

Thus, T-congruence Sylvester equation (1) can be transformed into the following linear system:

T {Im ⊗ A + Pmm(Im ⊗ B )}x = c, (7) where x := vec(X) and c := vec(C).

3 Main results

In this section, a transformation of the T-congruence Sylvester equation into a generalized Sylvester equation is shown. A transformation for the case m ≥ n is provided in Section 3.1, which is an extension of Theorem 1, and a novel transformation for the case m ≤ n is provided in Section 3.2. Before stating the main results, the term reciprocal free is described. The following definition admits 0 and ∞ as elements of λ1,...,λn. Definition 5. (reciprocal free [1, 2]) A set {λ ,...,λ } ⊂ C ∪ {∞} is said to be reciprocal free if λ , 1 for 1 n i λ j any 1 ≤ i, j ≤ n.

3 3.1 The case m ≥ n In this subsection, a transformation from the T-congruence Sylvester equation (1) to the generalized Sylvester equation for the case m ≥ n is described. Theorem 6. Let m ≥ n, A ∈ Rm×n, B ∈ Rn×m, and C ∈ Rm×m. Assume that there exists a matrix S ∈ Rm×m such that BT = SA and Λ(S) is reciprocal free. Then, the T-congruence Sylvester equation (1) is equivalent to the generalized Sylvester equation AX − BTXST = C − (SC)T. (8)

Proof. First, we show that G := Im ⊗ Im − Pmm(Im ⊗ S) is nonsingular. Then we prove that the T-congruence Sylvester equation (1) and the generalized Sylvester equation (8) are equivalent. Let (λ(G), v) be an eigenpair of G. Then it follows that (G) Pmm(Im ⊗ S)v = (1 − λ )v.

Thus, G is nonsingular if and only if K := Pmm(Im ⊗ S) has no eigenvalue equal to 1. From (2) and (5), it follows that

2 K = Pmm(Im ⊗ S)Pmm(Im ⊗ S)

= (S ⊗ Im)(Im ⊗ S) = S ⊗ S. (9) As a result of (9) and Lemma 2, any eigenvalue of K2 is a product of two eigenvalues of S. Therefore, thanks to the assumption that Λ(S) is reciprocal free, G is nonsingular. Now, we show the statement of Theorem 6. By multiplying (7) by G and using (2) and (5), we have T T {Im ⊗ A − Pmm(Im ⊗ SA) + Pmm(Im ⊗ B )− Pmm(Im ⊗ S)Pmm(Im ⊗ B )}x = Gc, which implies

T (Im ⊗ A − S ⊗ B )x = Gc, (10) since BT = SA. From (4) and (5), the right-hand side of (10) becomes

Gc = c − Pmm(Im ⊗ S)c

= c − (S ⊗ Im)Pmm c T = vec(C) − (S ⊗ Im)vec(C ). Therefore, applying the inverse vec operator to (10), we obtain (8) by using Lemma 3. Hence, we complete the proof of Theorem 6. In Theorem 6, we have not mentioned the existence of the matrix S satisfying the condition BT = SA. If the matrix A has full column rank, there always exist infinitely many matrices S satisfying BT = SA. The simplest one is expressed by using the Moore–Penrose inverse of A. Proposition 7. Let m ≥ n, A ∈ Rm×n have full column rank and B ∈ Rn×m. Then S := BT A† yields BT = SA. Proof. When A has full column rank, the Moore–Penrose inverse of A can be written as A† = (AT A)−1 AT, which implies BT = SA. Notice that if m = n, Theorem 6 with Proposition 7 is equivalent to Theorem 1. Thus it can be regarded as an extension of Theorem 1. Theorem 6 also holds true for the case m < n; however, BT = SA holds true only for limited cases, i.e., an additional assumption is required for B and A. Thus, in the next subsection, we consider another transformation.

4 3.2 The case m ≤ n In this subsection, we describe a novel transformation from the T-congruence Sylvester equation (1) to the generalized Sylvester equation in the case m ≤ n. Theorem 8. Let m ≤ n, A ∈ Rm×n, B ∈ Rn×m, and C ∈ Rm×m. Assume that there exists a matrix D ∈ Rn×m T such that Im = AD, and for S := B D, Λ(S) is reciprocal free. Then the T-congruence Sylvester equation (1) is equivalent to the generalized Sylvester equation AX˜ − BTXS˜ T = C, (11) where X˜ ∈ Rn×m satisfies X = X˜ − DX˜ TB. T Proof. First, we show that G := Im ⊗ In − Pnm(D ⊗ B ) is nonsingular. Then we prove that the T-congruence Sylvester equation (1) and the generalized Sylvester equation (11) are equivalent. Let (λ(G), v) be an eigenpair of G. Then, it follows that T (G) Pnm(D ⊗ B )v = (1 − λ )v. T Thus, G is nonsingular if and only if K := Pnm(D ⊗ B ) has no eigenvalue equal to 1. From (2) and (5), it follows that 2 T T K = Pnm(D ⊗ B )Pnm(D ⊗ B ) = (BT ⊗ D)(D ⊗ BT) = BTD ⊗ DBT. (12) Since BTD and DBT have the same set of nonzero eigenvalues, then we have from (12) and Lemma 2 that a square of any eigenvalue of K is 0 or a product of two eigenvalues of S. Therefore, from the assumption that Λ(S) is reciprocal free, G is nonsingular. Now, we prove the statement of Theorem 8. By using the nonsingular matrix G, (2), (3), and (5), the equation (7) becomes T T {Im ⊗ A + Pmm(Im ⊗ B )}{Im ⊗ In − Pnm(D ⊗ B )}x˜ = c, which implies T (Im ⊗ A − S ⊗ B )x˜ = c, (13) where x˜ := G−1 x. Since vec(X˜ ) = x˜, applying the inverse vec operator to (13), we obtain (11) by using Lemma 3. Hence we complete the proof of Theorem 8. In Theorem 8, there exist infinitely many matrices D. The simplest one is the Moore–Penrose inverse of A. m×n n×m † Proposition 9. Let m ≤ n, A ∈ R have full row rank and B ∈ R . Then D := A yields Im = AD. Proof. When A has full row rank, the Moore–Penrose inverse of A can be written as A† = AT(AAT)−1. † Thus, letting D = A , we have AD = Im. In the square case, by setting Xˆ = AX˜ , Theorem 8 reduces to the following result: Corollary 10. Let A, B, C ∈ Rn×n. Assume that A is nonsingular, and for S := BT A−1, Λ(S) is reciprocal free. Then, the T-congruence Sylvester equation (1) is equivalent to the Lyapunov equation Xˆ − SXSˆ T = C, where Xˆ := AX˜ and X˜ satisfies X = X˜ − A−1 X˜ TB. This is a different result from that given in Theorem 1.

5 4 Conclusion

Our results are summarized in Table 1. The key result is that under certain conditions T-congruence Sylvester equation is equivalent to the generalized Sylvester equation. This may provide flexibility in research for finding further mathematical features and solvers of T-congruence Sylvester equation (or the generalized Sylvester equation) because mathematical features and solvers of the generalized Sylvester equation can be utilized for T-congruence Sylvester equation, and vice versa.

Table 1: Equivalent matrix equations of the T-congruence Sylvester equation AX + XTB = C. m ≥ n m ≤ n generalized Sylvester eq. (Th. 3.2) generalized Sylvester eq. (Th. 3.5) Theorem AX − BTXST = C − (SC)T AX˜ − BTXS˜ T = C Lyapunov eq. [8, Th. 3.1] Lyapunov eq. (Cor. 10) m = n X˜ − SXS˜ T = Q Xˆ − SXSˆ T = C

References

[1] R. Byers, D. Kressner, Structured condition numbers for invariant subspaces, SIAM J. Matrix Anal. Appl. 28 (2) (2006) 326–347. [2] D. Kressner, C. Schröder, D.S.Watkins, Implicit QR algorithms for palindromic and even eigenvalue problems, Numer. Algorithms 51 (2) (2009) 209–238. [3] P.-A. Absil, R. Mahony, R. Sepulchre, Optimization Algorithms on Matrix Manifolds, Princeton University Press, Princeton, 2008. [4] C.-Y. Chiang, E. K.-W. Chu, W.-W. Lin, On the ⋆-Sylvester equation AX ± X⋆B⋆ = C, Appl. Math. Comput. 218 (17) (2012) 8393–8407. [5] F. De Terán, F. M. Dopico, Consistency and efficient solution of the Sylvester equation for ⋆-congruence, Electron. J. Linear Algebra 22 (2011) 849–863. [6] M. Hajarian, Developing Bi-CG and Bi-CR methods to solve generalized Sylvester-transpose matrix equations, Int. J. Autom. Comput. 11 (1) (2014) 25–29. [7] F. De Terán, B. Iannazzo, F. Poloni, L. Robol, Solvability and uniqueness criteria for generalized Sylvester- type equations, Linear Algebra Appl. 542 (2018) 501–521. [8] M. Oozawa, T. Sogabe, Y. Miyatake, S.-L. Zhang, On a relationship between the T-congruence Sylvester equation and the Lyapunov equation, J. Comput. Appl. Math. 329 (2018) 51–56. [9] Z. Gajic, M. T. J. Qureshi, Lyapunov Matrix Equation in System Stability and Control, Mathematics in Science and Engineering, Academic Press, Inc., San Diego, 1995. [10] B. N. Datta, Numerical Methods for Linear Control Systems, Elsevier Academic Press, San Diego, 2004. [11] S. Miyajima, Fast verified computation for the solution of the T-congruence Sylvester equation, Jpn. J. Ind. Appl. Math. 35 (2) (2018) 541–551. [12] P. Lancaster, M. Tismenetsky, The Theory of Matrices, Computer Science and Applied Mathematics, Academic Press, Inc., Orlando, 1985. [13] H. Zhang, F. Ding, On the Kronecker products and their applications, J. Appl. Math. (2013) 1–8.

6