Arxiv:2105.00793V3 [Math.NA] 14 Jun 2021 Tubal Matrices
Total Page:16
File Type:pdf, Size:1020Kb
Tubal Matrices Liqun Qi∗ and ZiyanLuo† June 15, 2021 Abstract It was shown recently that the f-diagonal tensor in the T-SVD factorization must satisfy some special properties. Such f-diagonal tensors are called s-diagonal tensors. In this paper, we show that such a discussion can be extended to any real invertible linear transformation. We show that two Eckart-Young like theo- rems hold for a third order real tensor, under any doubly real-preserving unitary transformation. The normalized Discrete Fourier Transformation (DFT) matrix, an arbitrary orthogonal matrix, the product of the normalized DFT matrix and an arbitrary orthogonal matrix are examples of doubly real-preserving unitary transformations. We use tubal matrices as a tool for our study. We feel that the tubal matrix language makes this approach more natural. Key words. Tubal matrix, tensor, T-SVD factorization, tubal rank, B-rank, Eckart-Young like theorems AMS subject classifications. 15A69, 15A18 1 Introduction arXiv:2105.00793v3 [math.NA] 14 Jun 2021 Tensor decompositions have wide applications in engineering and data science [11]. The most popular tensor decompositions include CP decomposition and Tucker decompo- sition as well as tensor train decomposition [11, 3, 17]. The tensor-tensor product (t-product) approach, developed by Kilmer, Martin, Bra- man and others [10, 1, 9, 8], is somewhat different. They defined T-product opera- tion such that a third order tensor can be regarded as a linear operator applied on ∗Department of Applied Mathematics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China; ([email protected]). †Department of Mathematics, Beijing Jiaotong University, Beijing 100044, China. (zy- [email protected]). This author’s work was supported by NSFC (Grant No. 11771038) and Beijing Natural Science Foundation (Grant No. Z190002). 1 a matrix space. They regarded vectors as tubal scalars, matrices as tubal vectors, and third order tensors as tubal matrices, i.e., downgrade the orders of vectors, ma- trices and third order tensors, by one, respectively. In [10, 9], T-SVD factorization and the best low tensor tubal rank approximation were developed. Several impor- tant matrix terminology were extended to third order tensors, such as the trans- pose of a third order tensor, the inverse of a third order tensor, identity tensors, orthogonal tensors and f-diagonal tensors. Discrete Fourier Transform (DFT) was used in this process. After these, this approach has been widely used in applications [2, 5, 6, 7, 12, 13, 14, 15, 16, 20, 21, 22, 23, 24, 25, 27, 28, 29, 30, 32, 31, 33, 34, 35]. In 2015, Kernfeld, Kilmer and Aeron [7] extended the t-product approach by defining the t-product in a so-called transform domain under an arbitrary invertible transform. In 2020, Song, Ng and Zhang [24] studied this approach by using unitary transformation matrices, while Jiang, Ng, Zhao and Huang [6] proposed to apply non-invertible trans- forms instead of unitary matrices. Recently, Wang, Gu, Lee and Zhang [26] combined this approach with quantum computation. Theoretically, this approach was vague in several places. Somehow, in practice, vector singular values are not convenient. Some scalar singular values of third order tensors were introduced [14, 20, 31]. Recently, it was shown in [12] that the f-diagonal tensor in the T-SVD factorization cannot be an arbitrary f-diagonal tensor. The au- thors of [12] called such a f-diagonal tensor an s-diagonal tensor, and fully characterized such an s-diagonal tensor under the DFT. The followings are two further theoretical issues. First, can we characterize the f-diagonal tensor in the T-SVD factorization for the product developed in [7] with an invertible linear transformation L, other than the ∗L DFT? Second, the Eckart-Young like theorem (Theorem 4.3 of [9]) is based on the tensor tubal rank. For an m n p tensor , its tensor tubal rank is at most min m, n . × × A { } However, the f-diagonal tensor in the T-SVD factorization of has p min m, n S A { } diagonal entries. Is there another Eckart-Young like theorem based upon a rank which is up to p min m, n ? { } We aim to answer these two questions in this paper. We characterize the f-diagonal tensor in the T-SVD factorization of a third order real tensor for a doubly real-preserving transformation L. The DFT matrix, an arbitrary orthogonal matrix, the product of the DFT matrix and an arbitrary orthogonal matrix are examples of doubly real-preserving transformations. Note that the Discrete Cosine Transformation (DCT) matrix is an orthogonal matrix. We show that two Eckart-Young like theorems hold for an m n p tensor , as × × A described above, for any doubly real-preserving unitary transformation L. Note that the real-preserving and doubly real-preserving properties may be neglected in [7]. This 2 may have some potential application values. We use tubal matrices as a tool for this discussion. We feel that the tubal matrix language makes this approach more natural. Throughout this paper, we assume that m, n and p are positive integers. 2 T-SVD Factorization and s-Diagonal Tubal Ma- trices 2.1 Real-Preserving Transformation and Tubal Scalar Module p p 1 p Let L = (Lij) C × be an invertible matrix. Denote L− H = (Hij). For a C , ∈ Cp Cp ≡ 1 Cp ∈ Cp define a mapping φL : by φL(a) := La, and its inverse mapping φL− : 1 1 → p → by φ− (a) := L− a. For a, b C , define L ∈ 1 a b = φ− [(φ (a)) (φ (b))], (2.1) ⊙L L L ◦ L where is the Hadamard product. If L is real, then : Rp Rp Rp. In general, ◦ ⊙L × → even if a, b Rp, a b may not be real. ∈ ⊙L For a Cp, denote its ith component by a(i). ∈ Let F F be the p p Discrete Fourier Transform (DFT) matrix with the form ≡ p × 1 1 1 1 ··· p 2 p 1 1 ω ω − ω − . ···. F = . .. , p 2 (p 2)(p 2) (p 2)(p 1) 1 ω − ω − − ω − − ··· 1 ωp 1 ω(p 1)(p 2) ω(p 1)(p 1) − − − − − ··· where 2πi ω = e− p , 1 1 H H and i = √ 1 is the imaginary unit. Then F − = F , where F is the conjugate − p transpose of F , and for any a, c Cp, we have ∈ p (i 1)(l 1) φF (a)(l)= ω − − a(i), (2.2) i=1 X for l =1, ,p, and ··· p 1 1 (l 1)(k 1) φ− (c)(k)= ω¯ − − c(l), (2.3) F p l X=1 for k =1, ,p. ··· 3 Proposition 2.1 For any a, b Rp, we have ∈ (a b)(k)= a(i)b(j): i + j k 1=0 mod(p), i, j =1, ,p , (2.4) ⊙F { − − ··· } X for k =1, ,p. Thus, : Rp Rp Rp. ··· ⊙F × → Proof Let a, b Rp, and c = φ (a) φ (b). For k =1, ,p, we have ∈ F ◦ F ··· p 1 1 (l 1)(k 1) φ− (c)(k) = ω¯ − − c(l) F p l=1 Xp p p 1 (l 1)(k 1) (i 1)(l 1) (j 1)(l 1) = ω¯ − − ω − − ω − − a(i)b(j) p l=1 i=1 j=1 Xp Xp X p 1 (l 1)(i+j k 1) = a(i)b(j) ω − − − . p i=1 j=1 " l # X X X=1 Note that p (l 1)(i+j k 1) p, if i + j k 1=0, mod(p) ω − − − = − − l (0, otherwise. X=1 Thus, 1 φ− (c)(k)= a(i)b(j): i + j k 1= 0 mod(p), i, j =1, ,p . F { − − ··· } X This proves (2.4). The last conclusion follows. We call a p p invertible matrix L a real-preserving transformation if : × ⊙L Rp Rp Rp. The DFT matrix F and any p p real invertible matrices are real- × → × preserving transformations. Not all complex invertible matrices are real-preserving. For example, let i 0 1 1 L = , a = , b = . 0 i 1 0 1 1 Then L− = L, La = ia, L− a = ia, and − − 1 i a b = L− (La Lb)= i( a b)= , ⊙L ◦ − − ◦ 0 which is not real. Proposition 2.2 The product of a p p real-preserving matrix L and any p p in- × × vertible matrix P is real-preserving. 4 Proof Suppose that a, b Rp. Then, ∈ 1 a b = (LP )− ((LP a) (LP b)) ⊙LP ◦ 1 1 = P − L− ((LP a) (LP b)) ◦ 1 = P − ((P a) (P b)) . ⊙L Since L is real-preserving, (P a) (P b) Rp. Thus, ⊙L ∈ 1 p a b = P − ((P a) (P b)) R . ⊙LP ⊙L ∈ Hence, LP is real-preserving. This shows that the set of p p real-preserving matrices is invariant for multiplying × right with any p p invertible matrix. In particular, the product of the DFT matrix × and any invertible matrix is real-preserving. However, it is worth pointing out that P L may not be real-preserving even if P is an orthogonal matrix and L is real-preserving, as illustrated in the following example. √2 √2 2 2 0 1 1 1 Example 2.3 Let P = √2 √2 0 and F = 1 w w2 . Obviously, P is 2 − 2 0 0 1 1 w2 w4 orthogonal and F is the 3 3 DFT matrix. Choose a = (1, 2, 3)⊤, and b = (3, 4, 5)⊤. × Direct calculations lead to 11.4602+ 3.9279i 1 a PF b =(P F )− ((P F a) (P F b)) 17.8241 8.8269i , (2.5) ⊙ ◦ ≈ − 22.6881+ 3.0619i which indicates that P F is not real-preserving.