arXiv:1910.13586v4 [math.NT] 25 May 2021 n htae ucin n lotra usadEisenstei and sums Kloosterman and functions Whittaker and 5.4. 6. 5.3. 5.2. 5.1. 5. 4. 3.7. 3.6. 3.5. 3.4. 3.3. 3.2. 3.1. 2.12. 2.10. 2.13. 2.9. 2.11. 3. 2.8. 2.7. 2.6. 2.5. 2.3. 2.4. 2. 2.2. 1.2. 2.1. 1.1. 1. oinGlfl sprilyspotdb iosCollabora Simons by supported partially is Goldfeld Dorian phrases. and words Key onsfrtets function test the for Bounds elntasomo the of transform Mellin onigtegoercside geometric the Bounding unto rc oml for Formula Trace Kuznetsov htae ucin,Mascs om,adPicr series Poincaré and forms, cusp Maass functions, Whittaker nrdcinadMi Theorem Main and Introduction Abstract. emti ieo h unto rc formula. trace Kuznetsov the of side geometric onme hoy epeethr,frtefis ie eyexp very time, first the for here, GL(4 present We theory. number to hgnlt eainfrcaatr ffiieaeingroup abelian finite of GL(1) characters for relation thogonality eain for relations Expressing hf equations Shift oe n eiusof residues and Poles oml o elntasomo h htae function Whittaker the of transform Mellin for Formula iesencontribution Eisenstein lotra term Kloosterman anterm Main emti ieo h unto rc formula trace Kuznetsov the of side Geometric updlcontribution Cuspidal etn ptetaeformula trace the up Setting hieo etfunction test of Choice is ore-htae offiin faMascs form cusp Maass a of coefficient Fourier-Whittaker First ore-htae xaso fMascs forms cusp Maass of expansion Fourier-Whittaker h ne rdc ftoWitkrfunctions Whittaker two of product inner The htae Transform Whittaker aqe’ htae Function Whittaker Jacquet’s The diiecaatrof character Additive pcrladLnlnsparameters Langlands and Spectral oda o h ro fteMi Theorem Main the of proof the for Roadmap wsw Decomposition Iwasawa anTheorem Main ne rdc ftePicr eiswt as upform cusp Maass a with series Poincaré the of product Inner etro arxntto eedn ncontext on depending notation matrix or Vector ore-htae xaso ftePicr series Poincaré the of expansion Fourier-Whittaker onaésre for series Poincaré , a sdb iihe opoeifiieymn rmsi arit in primes many infinitely prove to Dirichlet by used was ) R I ) s -function ihapwrsvnserrtr.Tepofrqie oe tec novel requires proof The term. error savings power a with GL(2) rhgnlt safnaetlteei ersnainthe representation in theme fundamental a is Orthogonality M W OINGLFL,EI TD,ADMCALWOODBURY MICHAEL AND STADE, ERIC GOLDFELD, DORIAN NOTOOAIYRLTO FOR RELATION ORTHOGONALITY AN α unto rc oml n uoopi om n spectral and forms automorphic and formula trace Kuznetsov and nteKzesvtaeformula trace Kuznetsov the in steivreMli rnfr of transform Mellin inverse the as GL(3) K SL(4 nteKzesvtaeformula trace Kuznetsov the in W f U aebe okdo ymn eerhr ihabodrneo a of range broad a with researchers many by on worked been have C GL(4) n α E , ( oteKzesvtaeformula trace Kuznetsov the to R Z oteKzesvtaeformula trace Kuznetsov the to ) ) p SL(4 T,R htae function Whittaker , Z Contents ) series. n 1 inGatNme 567168. Number Grant tion nwrcgie sa rhgnlt eainon relation orthogonality an as recognized (now s ii rhgnlt eain o h elgroup real the for relations orthogonality licit W f α mtcporsin.Orthogonality progressions. hmetic nqe ntecmuaino the of computation the in hniques r n ore nlss nor- An analysis. Fourier and ory GL(4 for eopsto n onaéseries Poincaré and decomposition , SL(4 R ) , Z ) pplications 26 23 24 22 22 22 17 15 15 14 13 12 11 11 11 10 9 9 9 8 9 8 8 7 7 6 7 6 6 4 6 2 6.1. Decomposition of pT,R in terms of poles and residues of Wα 26 6.2. Philosophy of the proof of Theorem 4.0.3 28 6.3. Bounds for the shifted pT,R term f 31 6.4. Bounds for the single residue terms 38 6.5. Bounds for the double residue terms 48 6.6. Bounds for the triple residue terms 58 7. Bounding the contribution from the continuous spectrum 59 Acknowledgements 66 Appendix A. Integral bounds 66 Appendix B. Kloosterman sums on GL(4) by Bingrong Huang 68 B.1. Introduction 68 B.2. Stevens’ approach 70 References 74
1. Introduction and Main Theorem Let q > 1 be an integer and let χ : (Z/qZ)× C× be a Dirichlet character (mod q). The classical orthogonality relation for Dirichlet characters states→ that for integers m,n coprime to q, 1 1 if m n (mod q), χ(m)χ(n)= ≡ φ(q) (0 otherwise. χ (modX q) This orthogonality relation is the basis for Dirichlet’s proof that there are infinitely many primes p a (mod q) if (a, q)=1. It has played an essential role in the modern development of analytic number theory.≡ When they are lifted to the adele ring A over Q, Dirichlet characters can be realized as automorphic representations of GL(1) (see chapter 2 in [GH11]). It is then very natural to try to generalize the above orthogonality relation to representations of higher rank reductive groups. When trying to do this, however, there is an immediate obstacle. In the case of GL(1), there are only finitely many characters (mod q) for any fixed q > 1. In higher rank, on the other hand, there will be infinitely many automorphic representations. It then becomes necessary to introduce a test function with rapid decay and define the orthogonality relation as an absolutely convergent integral over the automorphic representations. The first successful attempt at obtaining an orthogonality relation for GL(2) was made by R. Bruggeman in 1978 (see [Bru78]) who considered the orthonormal basis φj j=1,2,... of Maass cusp forms for SL(2, Z) where { } φ (z)= a (n) 2πy K (2π n y) e2πinx, (z = x + iy upper-half plane), j j itj | | · ∈ n6=0 X p and Kitj is the modified K-Bessel function of the second kind while aj (n) C are the Fourier coefficients 2 ∈ of φj . The Maass cusp form φj has Laplace eigenvalue λj =1/4+ tj and is a Hecke eigenform. Each such Maass cusp form is associated to a unique irreducible cuspidal automorphic representation of GL(2). Then Bruggeman proved the following orthogonality relation for non-zero integers m,n: 4π2 ∞ a (m) a (n) 1 if m = n, lim j j e−λj /T = T → ∞ T cosh(πt ) · 0 if m = n. j=1 j ( X 6 Other versions of GL(2) type orthogonality relations were later obtained by P. Sarnak [Sar87], and, for the case of holomorphic Hecke modular forms, by Conrey-Duke-Farmer [CDF97] and J.P. Serre [Ser97]. An orthogonality relation for Maass cusp forms on GL(3, R) was first proved independently by Goldfeld– Kontorovich [GK13] and Blomer [Blo13] in 2013. Further results on orthogonality relations for GL(3, R) were obtained by Blomer-Buttcane-Raulf [BBR14] and Guerreiro [Gue15]. In his 2013 thesis (see [Zho13], [Zho14]) Fan Zhou conjectured a very general orthogonality relation for GL(n) for n 2. We now describe Zhou’s conjecture. ≥ 2 Fix n 2. A Maass cusp form for SL(n, Z) is a smooth function φ : GL(n, R) C which satisfies φ(gkr)= ≥φ(g) for all g GL(n, R), k K = O(n, R), and r R×. In addition φ is square→ integrable and is an eigenfunction of the∈ Laplacian. If λ∈denotes the Laplace eigenvalue∈ of φ then λ can be expressed in terms n of Langlands parameters α = (α1,...,αn) C of φ, where α1 + α2 + + αn =0. The precise relation is given (see Section 6 in [Mil02]) by ∈ ··· n3 n α2 + α2 + + α2 λ = − 1 2 ··· n . 24 − 2 The Maass cusp form φ is said to be tempered at if the Langlands parameters α1,...,αn are all pure imaginary. ∞ Let φj j=1,2,... denote an orthogonal basis of Maass cusp forms for SL(n, Z) with associated Langlands { } (j) (j) (j) th parameters α = α1 ,...,αn and M Fourier coefficient Aj (M) where M = (m1,m2,...,mn−1) with m m m =0.. We assume each Maass cusp form φ is normalized so that its first Fourier coefficient 1 2 ··· n−1 6 j Aj (1, 1,..., 1)=1. Let j := Res L(s, φj φj ) L s=1 × be the residue, at the edge of the critical strip, of the Rankin-Selberg L-function attached to φ φ which j × j is the value at s =1 of the adjoint L-function L(s, Ad φj ). n For T , and Langlands parameters α = (α1, α2,...,αn) C of φ, let hT (α) denote a good test function with→ ∞ exponential decay as n α 2 . Here “good”∈ means that h is smooth, holomorphic k=1| k| → ∞ T in a region η < Re(αi) < η for some η > 0, invariant under permutation of the Langlands parameters − P α = (α1,...,αn), real valued and positive, and is essentially supported on the Laplace eigenvalues of φ which are less than T 2. Conjecture 1.0.1. (Orthogonality relation for GL(n, R)) Let φ denote an orthogonal basis { j}j=1,2,... of Maass cusp forms for SL(n, Z) as above. Set M = (m ,...,m ) and M ′ = (m′ ,...,m′ ) Zn−1. 1 n−1 1 n−1 ∈ + Let hT denote a good test function as above. Then ∞ (j) ′ hT (α ) Aj (M)Aj (M ) Lj ′ j=1 1 if M = M , lim = P ∞ (j) T →∞ hT (α ) (0 otherwise. Lj j=1 For applications it is important to determineP the rate of convergence as T in the above asymp- totic relation. With this in mind, we reformulate Conjecture 1.0.1 with an error→ term.∞ 1 In this case, the orthogonality relation is expected to take the form: Conjecture 1.0.2. For some constant θ < 1, we have θ ∞ (j) ∞ (j) ∞ (j) hT α hT α hT α A (M)A (M ′) = δ ′ + ′ . j j M,M OM,M j=1 j j=1 j j=1 j X L X L X L ′ Here δM,M ′ is 1 or 0 depending on whether M = M or not. In the above, since θ < 1, the error term gives a power savings in the main term. In the case n =3, this 3 conjecture was proved in [GK13] with Langlands parameters α = (α1, α2, α3) C , and the following choice of test function: ∈ 2 Γ 2+R+αj −αk 2 2 2 4 α1+α2+α3 1≤j6=k≤3 hT,R(α) := e T 2 . · Q 1+αj −αk Γ 2 1≤j6=k≤3 ∞ j hT,R(α Q) More precisely, it was shown in [GK13] that cT 5+3R and θ = 3+3R+ε , for some constant Lj 5+3R j=1 ∼ c > 0, and any fixed ε > 0 as T . SimilarP results were independently obtained by Blomer [Blo13] → ∞ 1 O ′ We adopt the standard convention that the constant implied by M,M′ depends at most on M and M . 3 and improved later in [BBR14], and more recently in [BZ20] where an interesting technique is developed to remove the arithmetic weight j . Conjecture 1.0.2 has manyL important applications to low lying zeros, Katz–Sarnak conjectures on sym- metry types of families of automorphic L-functions, Sato–Tate conjectures, etc. Such applications, for the special case of GL(3, R), are a major main theme in [Blo13], [BBR14], [BZ20], [GK13], [Gue15], [Zho13], [Zho14]. See also [ST16] where results for these problems are obtained for general families of cohomological automorphic representations of reductive groups over number fields. In this paper we focus only on the orthogonality conjecture as the techniques to obtain the above type applications from Conjecture 1.0.2 are very well established. Shin–Templier [ST16] obtain their results by an application of the Arthur-Selberg trace formula, with polynomial dependence on the Hecke eigenvalue and a power saving on the error term. Matz-Templier [MT15] establish the analogous results for the family φj of Maass cusp forms for SL(n, Z), and this is strengthened and generalized in Finis-Matz [FM19]. A{ varia} nt of Theorem 1.1.1 is obtained in [MT15], 8R [FM19], without the arithmetic weight j , without the polynomial weight of size T , and with different L (j) 1 8 test functions which are indicator functions of α T Ω, and where the error term would be O( ℓm 2 T ). For comparison, note that in Theorem 1.1.1 (if the polynomia∈ l weights are removed) we obtain an| error| · term 2 +ε 6+ε of the form ℓm 5 T . Also note that our main term is of a different form than that of [MT15], O | | · 8+8R 7+8R [FM19], in that ours entails some high-order asymptotics (the terms c2T and c3T ). Shortly after our paper first appeared, Subhajit Jana [Jan20] obtained a proof of the conjecture for compactly supported functions (on the geometric side) for automorphic forms for PGLr(Z) with r 2. Although a power savings error term is not given in Jana’s paper the author has informed us that≥ the method can give a power savings error term which is very far from optimal (even for GL(2)).
1.1. Main Theorem. Let α = (α , α , α , α ) C4 and let S denote the symmetric group on a set of size 1 2 3 4 ∈ 4 four. The main result of this paper is a proof of Conjecture 1.0.2 for GL(4, R) for the test function hT,R(α) given by 2 2+R+αj −αk R α2 α2 α2 α2 Γ 1+ 2+ 3+ 4 4 12 2 e T 1+ ασ(1) ασ(2) ασ(3) + ασ(4) , Γ 1+αj −αk − − 1≤ jY6=k ≤4 2 σY∈S4 where T is a large positive number andR (sufficiently large) is a fixed positive integer.
Theorem 1.1.1. (Main Theorem) Let φj j=1,2,... denote an orthogonal basis of even Maass cusp forms for SL(4, Z) (assumed to be tempered at {) with} associated Langlands parameters ∞ α(j) = α(j), α(j), α(j), α(j) (iR)4 1 2 3 4 ∈ and Lth Fourier coefficient A (L) (as in (2.8.1)) where L = (ℓ ,ℓ ,ℓ ) Z3. Let = L(1, Ad φ ). We j 1 2 3 ∈ Lj j assume each Maass cusp form φj is normalized so that its first Fourier coefficient Aj (1, 1, 1)=1. Let ℓ,m Z with ℓm =0. Then, for T , ∈ 6 → ∞ ∞ (j) hT,R α A (ℓ, 1, 1) A (m, 1, 1) = δ c T 9+8R + c T 8+8R + c T 7+8R j j ℓ,m · 1 2 3 j=1 j X L 2 +ε 6+8R+ε 7 +ε 5+8R+ε 15 4+8R+ε + ℓm 5 T + ℓm 32 T + ℓm 2 T , Oε,R | | · | | · | | · where δℓ,m is the Kronecker symbol and c1, c2, c3 > 0 are absolute constants which depend at most on R. 8R Note that hT,R is of size T on the relevant support.
R 12 Remark 1.1.2. The polynomial 1+ ασ(1) ασ(2) ασ(3) + ασ(4) is a new feature. It has not σ∈S4 − − appeared in previous versions of thisQ method for GL(2, R) and GL(3, R), but we have included it because its inclusion improves the error terms.
4 Remark 1.1.3. For s C with Re(s) > 5/2, the L-function associated to φ is given by ∈ j ∞ −1 A (p, 1, 1) A (1, p, 1) A (1, 1,p) 1 L(s, φ )= A (m, 1, 1)m−s = 1 j + j j + . j j − ps p2s − p3s p4s m=1 p ! X Y This shows that Theorem 1.1.1 gives the orthogonality relation on GL(4, R) for coefficients of cuspidal L- functions. It is possible, using the Hecke relations, to obtain a more general version of Theorem 1.1.1 3 involving AL, AM for arbitrary L,M where ℓimi =0, but the formulas get quite complex and messy, so i=1 6 are omitted. Q
Remark 1.1.4. For a tempered Maass cusp form with Langlands parameters α (iR)4 note that ∈ hT,R (α) > 0 and is essentially supported on Laplace eigenvalues λ The proof of Conjecture 1.0.2 for GL(4, R) (with a strong power savings error term) has resisted all attempts up to now. Theorem 1.1.1 is the first orthogonality relation for GL(4, R) obtained which has a strong power savings error term. Many of the techniques used in the proof of the GL(3, R) conjecture do not generalize in an obvious way and new difficulties arise for the first time. We now point out the obstacles that we faced in the last seven years of work on this paper with some indications of how we overcame them. In the methods developed in [GK13] the Whittaker transform of a test function is estimated by first taking• the Mellin transform of the Whittaker function and then taking the inverse Mellin transform to go back. This leads to multiple integrals involving ratios of Gamma functions which can be estimated by Stirling’s asymptotic formula. When moving to GL(4, R), however, the Mellin transform of the Whittaker function is much more complex and does not satisfy a simple recurrence relation as on GL(3, R). The polynomials which appear in the recurrence formula in [FG93] are of large degree, and it did not seem possible to get good estimates for Mellin transforms of Whittaker functions via recurrence relations. Recent results (see Section 5.2) give precise control of the polynomials that appear in the recurrence formulae• for Mellin transforms of shifted Whittaker functions allowing us to overcome the problem discussed in the previous bullet. The classical Perron’s formula allows one to obtain asymptotic formulae for the sum of coefficients of an• L-function by computing a certain integral transform of that L-function and then evaluating the integral transform by shifting the contour of integration. An important tool in the proof of Theorem 1.1.1 is a novel higher dimensional version of Perron’s formula that gives asymptotic formulae for sums of terms arising in the cuspidal contribution to the trace formula. In the case of GL(4, R), the Perron type formula we develop involves a triple integral which requires shifting contours in 3 directions. It was necessary to generalize the method of Goldfeld-Kontorovich for finding the “exponential zero set” which gets repeatedly used for each shifted term. We also introduce a very precise bound for elementary integrals (see Appendix A) which turns out to be critical for accurately estimating the integrals over the shifted contours. Another difficulty is that the Langlands spectral decomposition is much more complex on GL(4, R) with many• more types of Langlands L-functions involving twists by Maass cusp forms of lower rank in the Levi components of the relevant parabolic subgroups. In order to obtain precise power savings error terms in the contribution of the continuous spectrum to the trace formula, it is necessary to have very explicit forms of the Fourier coefficients of the Eisenstein series. Although the Fourier coefficients are known in great generality (see, for example, Shahidi’s book [Sha10]) the archimedean factors do not seem to have been worked out explicitly in the published literature. In Section 3.2 we review [GMW] where Borel Eisenstein series are used as a template to explicitly determine the non-constant Fourier coefficients of general Langlands Eisenstein series on GL(4, R). 5 1.2. Roadmap for the proof of the Main Theorem. The proof of Theorem 1.1.1 is based on the Kuznetsov trace formula for GL(4, R) which is worked out in Section 3. The trace formula is the identity = + where C M K−E ∞ (j) hT,R α = A (ℓ, 1, 1) A (m, 1, 1) C j j j=1 j X L is the cuspidal contribution. The main term is computed in Proposition 3.5.1 and is given by M = δ c T 9+8R + c T 8+8R + c T 7+8R + T 6+8R . M L,M · 1 2 3 O The bound for the Kloosterman contribution is worked in Proposition 4.0.4 (with r =4), while the bound for the continuous spectrum is given in TheoremK 7.0.7. Combining these bounds with the main term completes the proof. E M 2. Whittaker functions, Maass cusp forms, and Poincaré series for SL(4, Z) We review basic notation and the definitions of Whittaker functions, Maass cusp forms, and Poincaré series following [Gol06]. 2.1. Iwasawa Decomposition. Fix n 2 and let g GL(n, R). We have the Iwasawa decomposition ≥ ∈ (2.1.1) g = utkr × where u Un(R) and k K = O(n, R) and r R and t T , the subgroup of diagonal matrices with positive entries.∈ Then t =∈t(g) can be uniquely chosen∈ to take∈ the form y1y2···yn−1 .. (2.1.2) t = . y1y2 y1 1 for some y = (y ,y ,...,y ) with y > 0 (i =1, 2,...,n 1). 1 2 n−1 i − 2.2. Spectral and Langlands parameters. In the context of SL(n, R), we associate to a vector of complex numbers s = (s ,s ,...,s ) Cn−1, the spectral parameters 1 2 n−1 ∈ 1 v := (v , v ,...,v ), v := s , j =1,...,n 1, 1 2 n−1 j j − n − and Langlands parameters Bn−1(v) if i =1, αi := B (v) B (v) if 1 < i < n, n−i − n−i+1 B1(v) if i = n, − where n−1 ij if i + j n, Bj (v)= bi,j vi with bi,j = ≤ i=1 ((n i)(n j) if i + j n. X − − ≥ Note that (2.2.1) α + α + + α =0. 1 2 ··· n n On the other hand, given α = (α1,...,αn) C satisfying (2.2.1), it is straightforward to see that the Langlands parameters associated to ∈ α α +1 (2.2.2) s = i − i+1 , i n are given by α. To be completely explicit, in the special case of SL(4, Z), the Langlands parameters (α1, α2, α3, α4) asso- 1 ciated to s = 4 + (v1, v2, v3) are given by α =3v +2v + v , α = v +2v + v , α = v 2v + v , α = v 2v 3v ; 1 1 2 3 2 − 1 2 3 3 − 1 − 2 3 4 − 1 − 2 − 3 α α α α α α v = 1 − 2 , v = 2 − 3 , v = 3 − 4 . 1 4 2 4 3 4 6 2.3. The Is-function. Let g GL(n, R) (with toric element given by (2.1.2)). We define a power function in terms of either the spectral∈ or Langlands parameters associated to s = (s ,s ,...,s ) Cn−1 via 1 2 n−1 ∈ n−1 n−1 bi,j sj Is(g)= Is(utkr) := yi , i=1 j=1 Y Y or, equivalently, n−1 j(n−j) 2 +α1+···+αj−1 Is(g)= Is(utkr) := yj . j=1 Y It is easy to see that if s and α are associated to each other as in Section 2.2, then these two definitions are equivalent. For example, when n =4 and s = (1/4+ v , 1/4+ v , 1/4+ v ) C3, we have 1 2 3 ∈ s1+2s2+3s3 2s1+4s2+2s3 3s1+2s2+s3 Is(g)= y1 y2 y3 3 3 3 3 2 +v1+2v2+3v3 2+2v1+4v2+2v3 2 +3v1+2v2+v3 2 +α1+α2+α3 2+α1+α2 2 +α1 = y1 y2 y3 = y1 y2 y3 . n−1 2.4. Additive character of Un(R). Assume n 2. Fix M = (m1,m2, ..., mn−1) Z . Let g GL(n, R) with Iwasawa decomposition g = utkr, where≥ ∈ ∈ 1 u1,2 u1,3 ··· u1,n 1 u2,3 ··· u2,n u = . . . . . . 1 un−1,n 1 Then associated to the vector M we have an additive character ψ : U (R) C defined by M n → 2πi m1u1,2 + m2u2,3 + ··· + mn−1un−1,n (2.4.1) ψM (g) := ψM (u) := e . 2.5. Jacquet’s Whittaker Function. Assume n 2. Given Langlands parameters α = (α1, α2, ..., αn), let s = s(α) be defined as in Section 2.2. ≥ 1 For Re(v ) > 0 (i = 1,...,n 1) and w = , we define the completed Whittaker function i − long ·· 1 · W ± : GL(n, R) (O(n, R) R×) C by the absolutely convergent integral α · → 1+αj −αk ± Γ 2 W (g) := − I (w ug) ψ (u) du, α 1+αj αk s long 1,...,1,±1 2 · 1≤j 2.6. Whittaker Transform. Assume n 2. Let v = 1 + (v , v ,...,v ) Cn−1 with the associated ≥ n 1 2 n−1 ∈ Langlands parameters α = (α1, α2,...,αn). Set y1y2···yn−1 . . y := (y ,y ,...y ), t(y) := . . 1 2 n−1 y1y2 y1 1 Let f : Rn−1 C be an integrable function. Then we define the Whittaker transform f # : Rn C by + → + → ∞ ∞ n−1 dy (2.6.1) f #(α) := f(y) W t(y) k , ··· α k(n−k)+1 Z Z k=1 yk y1=0 yn−1=0 Y n−1 provided the above integral converges absolutely and uniformly on compact subsets of R+ . Assume that α is tempered, i.e., v1, v2,...,vn−1 are all pure imaginary. The Whittaker transform was studied in [GK12] and the following explicit inverse Whittaker transform was obtained: 1 # dv1dv2 dvn−1 f(y)= f (α)W−α t(y) ··· , πn−1 ··· Γ αk−αℓ Z Z 2 Re(v1)=0 Re(vn−1)=0 1≤k6=ℓ≤n Q provided the above integral converges absolutely and uniformly on compact subsets of (iR)n. 2.7. The inner product of two Whittaker functions. Assume n 2. Suppose that α = (α1,...,αn) and β = (β ,...,β ) are Langlands parameters for which Re(α ) = Re(≥β )=0(1 j, k n). Then 1 n j k ≤ ≤ n n s+α −β ∞ ∞ j k n−1 Γ 2 (n−j)s dyk j=1 k=1 (2.7.1) Wα(y) Wβ(y) y = − , j k(n−k)+1 Q Qs n(n 1) ns ··· y 2π 2 Γ Z −Z j=1 k 2 y1=0 yn 1=0 Y where the left side converges absolutely for Re(s) sufficently large. This is given in [Sta02]. 2.8. Fourier-Whittaker expansion of Maass cusp forms. Assume n 2. Fix Langlands parameters n n ≥ α = (α1, α2,...,αn) C . Let φ : h C be a Maass cusp form for SL(n, Z) which satisfies δφ(g) = ∈ n → λα(δ) φ(g) for all δ and g GL(n, R), as in (2.5.2). Then for g GL(n, R), we have the following Fourier-Whittaker· expansion:∈ D ∈ ∈ ∞ ∞ Aφ(M) γ 0 (2.8.1) φ(g)= W sgn(mn−1) t(M) g , n−1 α ··· k(n−k) 0 1 Z Z m =1 m − =1 − γ∈Un−1(X)\ SLn−1( ) X1 nX2 mnX16=0 mk 2 k=1 | | Q th where M = (m1,m2, ..., mN−1) and Aφ(M) is the M Fourier coefficient of φ. This is proved in Section 9.1 of [Gol15]. 8 2.9. First Fourier-Whittaker coefficient of a Maass cusp form. For n 2, consider a Maass cusp form φ for SL(n, Z) with Fourier Whittaker expansion given by 2.8.1. Assume ≥φ is a Hecke eigenform. Let Aφ(1) := Aφ(1, 1,..., 1) denote the first Fourier-Whittaker coefficient of φ. Then we have A (M)= A (1) λ (M) φ φ · φ where λφ(M) is the Hecke eigenvalue (see Section 9.3 in [Gol15]), and λφ(1) = 1. Recall also the definition of the adjoint L-function: L(s, Ad φ) := L(s, φ φ)/ζ(s) where L(s, φ φ) is the Rankin-Selberg convolution L-function as in §12.1 of [Gol15]. × × Proposition 2.9.1. Assume n 2. Let φ be a Maass cusp form for SL(n, Z) with Langlands parameters ≥ α = (α1,...,αn). Then the first coefficient Aφ(1) is given by 2 cn φ, φ Aφ(1) = · | | 1+αj −αk L(1, Ad φ) Γ 2 1≤j6=k≤n where c =0 is a constant depending on n only. Q n 6 Proof. We follow the Rankin-Selberg computations in §12.1 of [Gol15]. φ, φ = φ(g) 2 d∗g | | ZZ n SL(n, )\h = vol (SL(n, Z) hn) Res φ(g)φ(g)E(g,s) d∗g \ · s=1 SL(n,ZZ)\hn where E(g,s) is the maximal parabolic Eisenstein series. After unfolding and replacing φ with its Fourier- Whittaker expansion, we obtain A (1) 2L(s, φ φ) n−1 dy φ(g)φ(g)E(g,s) d∗g = | φ | × W (y)W (y) k . ζ(ns) α α (k−s)(n−k)+1 j=1 y SL(n,ZZ)\hn RnZ−1 k + Y The proposition follows immediately from the formula (2.7.1), since L(1, Ad φ)= Res L(s, φ φ). s=1 × 3 2.10. Vector or matrix notation depending on context. Given a vector a = (a1,a2,a3) in R , we shall define the toric element t(a) := diag(a1a2a3,a1a2,a1, 1). 3 Given a function f : R C we define f(a) := f(a1,a2,a3). On the other hand, if f : GL(4, R) C is a function defined on the group→ then we let f(a) := f(t(a)), and more generally, for any g ,g GL(4→, R) we 1 2 ∈ define f(g1ag2) := f(g1t(a)g2). In other words, we may consider a as a vector or a diagonal matrix depending on the context. 2.11. Poincaré series for SL(4, Z). Let H : h4 C be a smooth test function satisfying H(utkr)= H(t) (see (2.1.1)). We assume that H has sufficient decay→ properties so that the series defining the Poincaré series (given below) converges absolutely. For g GL(4, R), M = (m ,m ,m ) Z3 , and s = (s ,s ,s ) C3, ∈ 1 2 3 ∈ + 1 2 3 ∈ with Re(sj ) sufficiently large, the SL(4, Z) Poincaré series is defined by M (2.11.1) P (g,s) := ψM (γg) H Mγg Is(γg). γ∈U (Z)\ SL(4,Z) 4 X Remark: Following Section 2.10, for ψM , we take M = (m1,m2,m3). On the other hand for H(Mγg), we take M to be the diagonal matrix t(M). 2.12. Inner product of the Poincaré series with a Maass cusp form. Let φ be a Maass cusp form for SL(4, Z) with Fourier expansion (2.8.1). Let P M denote the Poincaré series (2.11.1). The inner product is defined by P M ( ,s), φ := P M (g,s) φ(g) dg. ∗ ZZ 4 SL(4, )\h 9 It follows that M dy1dy2dy3 P ( ,s), φ = ψM (x)H My Is(y)φ(xy) dx1,2dx1,3dx1,4dx2,3dx2,4dx3,4 4 5 4 ∗ y1y2y3 Z 4 U4( )\h ∞ ∞ ∞ Aφ(M) dy1dy2dy3 = 3 3 H My Is(y) Wα(My) 4 5 4 . 2 2 2 · y1y2y3 m1 m2m3 Z Z Z y1=0 y2=0 y3=0 We see that the above inner product picks out the M th Fourier coefficient of φ multiplied by a certain Whittaker transform of H My I (y). Letting s 0, it follows from (2.6.1) that · s → ∞ ∞ ∞ M Aφ(M) dy1dy2dy3 (2.12.1) lim P ( ,s), φ = 3 3 H My Wα My 4 5 4 s→0 ∗ 2 2 2 · y1y2y3 m1 m2m3 Z Z Z y1=0 y2=0 y3=0 3 3 = m 2 m2m 2 A (M) H#(α). 1 2 3 · φ · 2.13. Fourier-Whittaker expansion of the Poincaré series. Let W4 ∼= S4 denote the Weyl group of GL(4, R). For w W , we define ∈ 4 Γ := w−1 tU (Z) w U (Z), w · 4 · ∩ 4 t where U4 denotes the transpose of U4. We have the Bruhat decomposition GL(4, R)= G , G = U (R) w T (R)U (R) , w w 4 · · 4 4 w[∈W4 where T4(R) is the subgroup of diagonal matrices in GL(4, R). Definition 2.13.1 (Twisted Character). Let v1 v2 V4 := v = v3 v1, v2, v3, v4 1 , v1v2v3v4 =1 . v ∈ {± } 4 3 Let M = (m1,m2,m3) Z , and consider ψM an additive character of U4. Then for v V4, we define the v ∈ ∈ twisted character ψM : U4(R) C by → v −1 ψM (g) := ψM v gv . 3 Definition 2.13.2 (Kloosterman Sum). Fix L = (ℓ1,ℓ 2,ℓ3),M = (m1,m2,m3) Z . Let ψL, ψM be ∈ 1/c3 c /c characters of U4(R). Let w W4 where W4 is the Weyl group of GL(4). Let c = 3 2 ∈ c2/c1 c1 ! with c N. Then the Kloosterman sum is defined as i ∈ Sw(ψL, ψM ,c) := ψL(β1) ψM (β2), Z γ=U4( )X\Γ∩Gw/Γw γ=β1cwβ2 ′ with notation as in Definition 11.2.2 of [Gol06]. The Kloosterman sum Sw(ψ, ψ ,c) is well defined and not equal to zero if and only if it satisfies the compatibility condition ψ(cwuw−1)= ψ′(u). It follows from Theorem 11.5.4 of [Gol06] that the M th Fourier coefficient of the Poincaré series P L (g, s) is given by ∞ ∞ ∞ S (ψ , ψv ,c)J (g; s, ψ , ψv ,c) (2.13.3) P L (ug, s) ψ (u) d∗u = w L M w L M , M 4s3 4s2 4s1 · c1 c2 c3 Z Z R w∈W4 v∈V4 c1=1 c2=1 c3=1 U4( )\U4( ) X X X X X 10 where v v ∗ Jw(g; s, ψL, ψM ,c)= ψL(wug) H Lcwug Is(wug) ψM (u) d u, (Z)Z (R) ZR Uw \Uw U w( ) U (R)= w−1 U (R) w U (R), U (R)= w−1 tU (R) w U (R), w · 4 · ∩ 4 w · 4 · ∩ 4 and tm denotes the transpose of a matrix m. 3. Kuznetsov Trace Formula for SL(4, Z) 4 3.1. Choice of test function. Let α = (α1, α2, α3, α4) (iR) with α1 + α2 + α3 + α4 = 0. Let T > 1 with T and R 14 with R fixed. We consider the test∈ function → ∞ ≥ 2 2 2 2 α1+α2+α3+α4 ♯ 2+R+αj −αk (3.1.1) p (α) := e 2T 2 (α) Γ , T,R FR 4 1≤ jY6=k ≤4 where R 24 (3.1.2) R(α) := 1+ ασ(1) ασ(2) ασ(3) + ασ(4) F − − ! σ∈S4 Y R 6 = 1+ α + α α α 2 1+ α + α α α 2 1+ α + α α α 2 . | 1 2 − 3 − 4| | 1 3 − 2 − 4| | 1 4 − 2 − 3| ♯ The function pT,R(α) defined in (3.1.1) generalizes the similar function defined in [GK13]. As before, ♯ the choice is motivated by the fact that we need pT,R to be invariant under the Weyl group, and have meromorphic continuation in α C4, while also requiring it to have enough exponential decay to kill the exponential growth of certain Gamma∈ factors appearing in the denominator of the Kuznetsov trace formula. The new feature is the introduction of the polynomial (α). FR By the inverse Lebedev-Whittaker transform (see [GK12]), we see that pT,R is given by 1 # dα1 dα2 dα3 (3.1.3) pT,R(y)= pT,R(y1,y2,y3)= 3 pT,R(α) Wα(y) . π Γ αj −αk Re(ZZZα )=0 2 j 1≤ j6=k ≤4 Q 3.2. Setting up the trace formula. Set L = (ℓ ,ℓ ,ℓ ),M = (m ,m ,m ) Z3 where we assume 1 2 3 1 2 3 ∈ 3 ℓ m =0. Consider the Poincaré series P L, P M , as defined in (2.11.1) with the test function H = p . i=1 i i 6 T,R DefinitionQ 3.2.1 (Normalization factor CL,M ). Let c4 be as Proposition 2.9.1. Then we define CL,M := c (ℓ m )3(ℓ m )4(ℓ m )3. 4 · 1 1 2 2 3 3 With the normalization factor CL,M defined above, the Kuznetsov trace formula is obtained by evaluating the inner product C−1 lim P L( ,s), P M ( ,s) = C−1 lim P L(g,s) P M (g,s) dg L,M · s→0 ∗ ∗ L,M · s→0 ZZ 4 SL(4, )\h in two different ways. The first approach is to use spectral theory while the second uses geometry. For the spectral theory approach, we will need the following definition. Definition 3.2.2 (Generic and non-generic automorphic forms). Let n 2. An automorphic form for ≥ SL(n, Z) is said to be generic if there exists some nondegenerate character of Un(R) for which the form has a nonzero Fourier coefficient. Otherwise, the automorphic form is said to be non-generic. Note that a character ψm1,m2,...,mn−1 of Un(R) is nondegenerate if all m1,m2,...,mn−1 are all nonzero. In order to prove the Kuznetsov trace formula for GL(4, R), we require the spectral expansion of the Poincaré series P M and P L. It will be shown (see the proof of Theorem 3.7.3) that these Poincaré series are orthogonal to the non-generic spectrum. Therefore, the following theorem suffices for our needs. 11 Theorem 3.2.3. (Langlands spectral decomposition for SL(4, Z)) Let φ1, φ2, φ3,... denote an orthog- onal basis of Maass cusp forms for SL(4, Z). Assume that F, G 2(SL(4, Z) h4) are orthogonal to the non-generic spectrum. Then for g GL(4, R) we have ∈ L \ ∈ ∞ φj (g) F (g)= F, φj + cP F, EP,Φ( ,s) EP,Φ(g,s) ds1 dsr−1; h i φj , φj ··· ∗ ··· j=1 P Φ Z Z X h i X X Re(s1)=0 Re(sr−1)=0D E ∞ F, φj φj , G F, G = h i h i + cP F, EP,Φ( ,s) EP,Φ( ,s), G ds1 dsr−1; h i φj , φj ··· ∗ ∗ ··· j=1 h i P Φ Z Z X X X Re(s1)=0 Re(sr−1)=0D ED E r where the sum over ranges over proper parabolic subgroups associated to partitions 4 = nk (r > 1), P k=1 and the sum over Φ (see Definition 3.7.1) ranges over an orthonormal basis of Maass cusp formsP associated r r to . Here s = (s1,...,sr) where nksk = 0 for the partition 4 = nk. Furthermore, cP is a fixed P k=1 k=1 non-zero constant for each parabolicP subgroup . P P Proof. For proofs of the spectral expansion for arbitrary reductive groups, see [Art79], [Lan76], and [MW95]. It has long been known that the residual spectrum of GL(n, R) is non-generic (see, for example, [LM18]). According to the results of Kostant, Casselman-Zuckerman, and Vogan (mentioned at the end of Vogan’s paper [Vog78]), generic representations have Gelfand-Kirillov dimension as large as possible. It follows that Eisenstein series induced from the residual spectrum can never be generic. Therefore, the spectral expansion here only involves terms coming from cusp forms, as claimed. In particular since P L, P M 2 SL(4, Z) h4 , the inner product can be computed with the spectral expansion of the Poincaré series.∈ L The geometric\ approach utilizes the Fourier Whittaker expansion of the Poincaré series which involve Kloosterman sums. The trace formula takes the following form. (3.2.4) + = + . C E M K spectral side geometric side | {z } | {z } Here is the cuspidal contribution, is the main term coming from the identity element. Further, = EisensteinC contribution, = KloostermanM sum contribution. These will be small with the special choiceE of the test function p . InK the subsections that follow, we explicitly evaluate , , , and . T,R C E M K 3.3. Cuspidal contribution to the Kuznetsov trace formula. C Proposition 3.3.1. (Cuspidal contribution to the trace formula) Fix L = (ℓ1,ℓ2,ℓ3) and M = (m1,m2,m3), where ℓ1,ℓ2,ℓ3,m1,m2,m3 are non-zero rational integers. Let φ1, φ2,... denote an orthogonal basis of Maass cusp forms for SL(4, Z) with spectral parameters α(1), α(2),..., respectively, ordered by Laplace th th eigenvalue. Let Aj (L) and Aj (M) denote the L and M Fourier coefficients of φj and assume that Aj (1, 1, 1)=1 for all j =1, 2,.... Let j = L(1, Ad φj ). Then the cuspidal contribution to the trace formula (3.2.4) is given by L 2 ∞ # (j) Aj (L)Aj (M) pT,R α = · C 1+αj −αk j=1 j Γ 2 X L 1≤j6=k≤4 Q # where pT,R is given by (3.1.1). 12 Proof. It follows from Theorem 3.2.3 that for g GL(4, R), the cuspidal contribution to the trace formula (3.2.4) is given by ∈ ∞ φ (g) P L( , 0), φ j . ∗ j · φ , φ j=1 h j j i X Now, since Aj (1, 1, 1)=1, Proposition 2.9.1 implies that 1+ α α φ , φ = c−1 Γ j − k . j j 4 · Lj 2 1≤j6=k≤4 Y The cuspidal contribution to the trace formula is given by ∞ L M P ( , 0), φj P ( , 0), φj := C−1 ∗ · ∗ . C L,M · φ , φ j=1 j j X h i The proposition immediately follows from the inner product formula (2.12.1). 3.4. Geometric side of the Kuznetsov trace formula. Next we consider the geometric side of the trace formula (3.2.4). This is computed with the Fourier-Whittaker expansion of the Poincaré series given in (2.13.3). Proposition 3.4.1 (Geometric side of the trace formula). Fix L = (ℓ1,ℓ2,ℓ3), M = (m1,m2,m3) with C =0. Then L,M 6 L M lim P ( ,s), P ( ,s) = w s→0 ∗ ∗ I w∈W X4 where we have ∞ ∞ ∞ ∞ ∞ ∞ (3.4.2) := S (ψ , ψv ,c) Iw w L M v∈V4 c1=1 c2=1 c3=1 y Z=0 y Z=0 y Z=0 Z Z R ZR X X X X 1 2 3 Uw( )\Uw( ) U w( ) v ∗ dy1 dy2 dy3 ψL(wuy) ψM (u) pT,R(Lcwuy) pT,R(My) d u 4 5 4 . · y1 y2 y3 Proof. We compute the inner product lim P L ( , s) , P M ( , s) = lim P L (g,s) P M (g,s) dg s→0 ∗ ∗ s→0 · ZZ 4 SL(4, )\h L = lim P (g,s) ψM (g) pT,R(Mg) Is(g) dg s→0 · 4 U4(Z)\h ∞ ∞ ∞ L dy1 dy2 dy3 = lim P (uy,s) ψM (u) du pT,R(My) Is(y) 4 5 4 . s→0 · · y1 y2 y3 y1Z=0 y2Z=0 y3Z=0 U (Z)Z\U (R) 4 4 13 It follows from (2.13.3) that lim P L ( , s) , P M ( , s) s→0 ∗ ∗ ∞ ∞ ∞ ∞ ∞ ∞ S (ψ , ψv ,c) = lim w L M s→0 4s1 4s2 4s3 c1 c2 c3 w∈W4 v∈V4 c1=1 c2=1 c3=1 y Z=0 y Z=0 y Z=0 Z Z R ZR X X X X X 1 2 3 Uw ( )\Uw( ) U w( ) v ∗ dy1 dy2 dy3 ψL(wuy) ψM (u) pT,R(Lcwuy) pT,R(My) Is(wuy) Is(y) d u 4 5 4 · y1 y2 y3 ∞ ∞ ∞ ∞ ∞ ∞ v = Sw(ψL, ψM ,c) v∈V4 c1=1 c2=1 c3=1 y Z=0 y Z=0 y Z=0 Z Z R ZR X X X X 1 2 3 Uw ( )\Uw( ) U w( ) v dy1 dy2 dy3 ψL(wuy) ψM (u) pT,R(Lcwuy) pT,R(My) du 4 5 4 · y1 y2 y3 = , Iw wX∈W4 as claimed. 3.5. Main term in the Kuznetsov trace formula. Let w1 denote the 4 4 identity matrix. The main term = I Min the trace formula (3.2.4) can now be easily computed. × M w1 Proposition 3.5.1. (Main term in the trace formula) There exist fixed constants c1, c2, c3 > 0 (de- pending only on R) such that the main term in the trace formula (3.2.4) is given by M = δ c T 9+8R + c T 8+8R + c T 7+8R + T 6+8R . M L,M · 1 2 3 O Proof. The Kloosterman sum in Definition 2.13.2 for the special case of the trivial Weyl group element w1 is ν identically zero unless c = (1, 1, 1) in which case Sw1 ψM , ψL, (1, 1, 1) =1. It follows from (3.4.2) and the normalization (by C ) of the cuspidal contribution that L,M C = C−1 M L,M · Iw1 ∞ ∞ ∞ −1 ∗ dy1 dy2 dy3 = CL,M ψL(u)ψM (u) d u pT,R(Ly) pT,R(My) 4 5 4 . · y1 y2 y3 y1Z=0 y2Z=0 y3Z=0 U (Z)Z\U (R) w w Next ∞ ∞ ∞ dy dy dy = δ c p (y) 2 1 2 3 = p ,p M L,M · 4 | T,R | y4 y5 y4 T,R T,R Z Z Z 1 2 3 y1=0 y2=0 y3=0 # 2 pT,R(α) dα1 dα2 dα3 = δL,M c4 · Γ αj −αk Re(ZZZα )=0 2 j 1≤j6=k≤ 4 # # Q = δ c p , p , L,M 4 · T,R T,R where the second representation of in terms of the norm of p# follows from the Plancherel formula in M T,R Corollary 1.9 of [GK12]. It now follows from (3.1.1) that 2 2 2 2 α1+α2+α3+α4 2 2+R+αj −αk 2T 2 e R(α) Γ 4 F 1≤ j6=k ≤4 = δL,M c4 Q dα1dα2dα3. M · Γ αj −αk Re(ZZZα )=0 2 j 1≤j6=k≤4 Q14 Let α = iτ with τ R, where τ = τ τ τ . We see that j j j ∈ 4 − 1 − 2 − 3 R 3 (α) 2 := 1+ τ + τ τ τ 2 1+ τ + τ τ τ 2 1+ τ + τ τ τ 2 . |FR | | 1 2 − 3 − 4| | 1 3 − 2 − 4| | 1 4 − 2 − 3| It then follows from Stirling’s asymptotic formula Γ(σ + it) 2 2π t 2 σ−1 e−π|t| that | | ∼ | | δ c M∼ L,M · 4 − 2− 2− 2− 2 R τ1 τ2 τ3 τ4 2 2 2 3 e 2T 2 1+ τ + τ τ τ 1+ τ τ + τ τ 1+ τ τ τ + τ · 1 2 − 3 − 4 1 − 2 3 − 4 1 − 2 − 3 4 ZZZR3 1+ τ τ 1+ τ τ 1+ τ τ 1+ 2τ + τ + τ · | 1 − 2| | 1 − 3| | 2 − 3| | 1 2 3| 1+R 1+ τ +2τ + τ 1+ τ + τ +2τ dτ dτ dτ . · | 1 2 3| | 1 2 3| 1 2 3 Next, make the change of variables τ τ T, τ τ T, τ τ T. 1 → 1 2 → 2 3 → 3 It follows that as T we have c δ T 9+8R, where → ∞ M∼ 1 · L,M − 2− 2− 2− 2 R τ1 τ2 τ3 τ4 2 2 2 3 c = c e 2 1+ τ + τ τ τ 1+ τ τ + τ τ 1+ τ τ τ + τ 1 4 1 2 − 3 − 4 1 − 2 3 − 4 1 − 2 − 3 4 ZZZR3 1+ τ τ 1+ τ τ 1+ τ τ 1+ 2τ + τ + τ · | 1 − 2| | 1 − 3| | 2 − 3| | 1 2 3| 1+R 1+ τ +2τ + τ 1+ τ + τ +2τ dτ dτ dτ . · | 1 2 3| | 1 2 3| 1 2 3 This method of proof can be extended by using additional terms in Stirling’s asymptotic expansion for the Gamma function to obtain additional terms in the asymptotic expansion of . M 3.6. Kloosterman term in the Kuznetsov trace formula. It immediately follows from Proposition 3.4.1 that K = C−1 . K L,M · Iw wX∈W4 w6=w1 3.7. Eisenstein contribution to the Kuznetsov trace formula. This section is based on [GMW]. There are 4 standard non-associateE parabolic subgroups on GL(4) corresponding to the partitions 4 = 3+1 = 2+2 = 2+1+1 = 1+1+1+1. Consider the minimal parabolic subgroup ∗ ∗ ∗ ∗ ∗ ∗ ∗ Min := GL(4, R) P ∗ ∗ ⊂ ∗ 1 3 associated to the partion 4 = 1+1+1+1. Let s = 4 + (s1,s2,s3) with s C . The minimal parabolic Eisenstein series for Γ = SL(4, Z) is defined by ∈ E (g,s) := I (γg), (g GL(4, R), Re(s) 1). PMin s ∈ ≫ γ ∈ (PXMin∩Γ)\Γ For the other 3 partitions 4=3+1=2+2=2+1+1, consider the parabolic subgroups ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ ∗ := ∗ ∗ ∗ ∗ , := ∗ ∗ ∗ ∗ , := ∗ ∗ ∗ ∗ , P3,1 ∗ ∗ ∗ ∗ P2,2 ∗ ∗ P2,1,1 ∗ ∗ ∗ ∗ ∗ ∗ respectively. For each of these parabolic subgroups (denoted ), associated to a partition with 4 = n1 + n + + n , we may define an infinite family of Eisenstein seriesP E (as in [GMW]) given by 2 ··· r P,Φ E (g,s) := Φ(γg) γg s , (g GL(4, R), Re(s) 1). P,Φ · | |P ∈ ≫ γ ∈ (XP∩Γ)\Γ 15 m1 0 ··· 0 0 m ··· 0 2 R Here Φ runs over cusp forms on the Levi components m = . . .. . of g (with mi GL(ni, )) and . . . . ! ∈ 0 0 ··· mr r s sj g P = det(mj ) is a toric character as in [GMW]. | | j=1 | | Q Definition 3.7.1. The cusp forms Φ and complex s values associated to Eisenstein series EP,Φ(g,s) for SL(4, Z) are given as follows. Let = , then Φ runs over Maass cusp forms for SL(3, Z) and s = (s ,s ) with 3s + s =0. • P P3,1 1 2 1 2 Let = , then Φ runs over pairs Φ = (φ , φ ) where φ , φ are Maass cusp forms for SL(2, Z) and • P P2,2 1 2 1 2 s = (s1,s2) with 2s1 +2s2 =0. Let = , then Φ runs over Maass cusp forms for SL(2, Z) and s = (s ,s ,s ) with 2s + s + s =0. • P P2,1,1 1 2 3 1 2 3 Now EP,Φ has a Fourier-Whittaker expansion similar to (2.8.1). If M = (m1,m2,m3) with m1, m2 and m positive integers, then the M th Fourier-Whittaker coefficient of E ( ,s) is given by 3 P,Φ ∗ AEP,Φ (M,s) EP (uy,s) ψM (u) du = Wα My , 3 2 3 m1 2 m2 m3 2 Z Z R U4( )\U4( ) | | | | | | where α denotes the Langlands parameter of EP,Φ(g,s). Here A (M,s)= A (1, 1, 1),s λ (M,s) EP,Φ EP,Φ · EP,Φ th and λEP,Φ (M,s) is the M Hecke eigenvalue of EP, Φ. M Proposition 3.7.2. (Inner product of the Poincaré series P with EP,Φ) Consider an Eisenstein series E for SL(4, Z). Fix M = (m ,m ,m ) Z3 . Let P M be the Poincaré series defined in (2.11.1) P,Φ 1 2 3 ∈ + with test function p : h4 C (as in (3.1.1)). Then T,R → 3 3 M 2 2 2 # lim P ( , δ), EP,Φ( , s) = m1 m2m3 AEP,Φ (M,s) pT,R(α). δ→0 ∗ ∗ · · D E Proof. The proof is similar to the proof of (2.12.1). One begins by taking Re(s) very large so that there is no problem with convergence and the result follows by analytic continuations in s. Theorem 3.7.3. (Spectral decomposition for the inner product of Poincaré series) Fix L = 3 (ℓ1,ℓ2,ℓ3),M = (m1,m2,m3) Z . ∈ (1) (2) Let φ1, φ2, φ3,... denote a basis of Maass cusp forms for SL(4, Z) with spectral parameters α , α , α(3),..., respectively, ordered by Laplace eigenvalue and normalized so that the first Fourier coefficient Aj (1, 1, 1)=1 for all j =1, 2,.... Set j = L(1, Ad φj). Let range over parabolics associatedL to partitions 4= n + + n , and Φ range over an orthonormal P 1 ··· r basis of Maass cusp forms associated to . Let EP,Φ(s) denote the Langlands Eisenstein series for SL(4, Z) Pth th with Langlands parameter αP,Φ (s) and L , M Fourier coefficients AEP,Φ (L,s), AEP,Φ (M,s), respectively. Then 2 # (j) ∞ Aj (L)Aj (M) p α −1 L M · T,R CL,M lim P ( ,δ), P ( ,δ) = · δ→0 ∗ ∗ 1+α j −αk j=1 j Γ 2 D E X L 1≤j6=k≤4 Q 2 + c A (L,s) A (M,s) p# α (s) ds ds , P ··· EP,Φ EP,Φ · T,R (P,Φ) 1 ··· r−1 P Φ Re(sZ1)=0 Re(srZ−1)=0 X X for constants cP > 0. Proof. This follows immediately from Proposition 3.3.1, Theorem 3.2.3, Proposition 3.7.2, and the rapid L M decay of the pT,R function. Note that the Poincaré Series P , P are orthogonal to the non-generic 16 spectrum. This can be seen as follows: M P (g)φ(g) dg = ψ(g)H(Mg)Is(g)φ(g) dg = H(Mg)Is(g) ψ(n) φ(ng) dn dg. 4 4 4 SL(4,ZZ)\h U4(ZZ)\h U4(RZ)\h U4(Z)Z\U4(R) The last integral is zero if φ is non-generic. Proposition 3.7.4. (Eisenstein term in the Kuznetsov trace formula) With the notation of The- orem 3.7.3, the Eisenstein term in the KuznetsovE trace formula is given by E 2 = c A (L,s) A (M,s) p# α (s) ds ds . E P ··· EP,Φ EP,Φ · T,R (P,Φ) 1 ··· r−1 P Φ Re(sZ1)=0 Re(srZ−1)=0 X X Proof. The proof follows from Proposition 3.7.3. 4. Bounding the geometric side Recall from (3.2.4) and (3.4.2) that the Kloosterman contribution to the Kuznetsov trace formula is given by = C−1 K L,M Iw wX∈W4 where C = c (ℓ m )3(ℓ m )4(ℓ m )3, and L,M 4 · 1 1 2 2 3 3 ∞ ∞ ∞ ∞ ∞ ∞ (4.0.1) = S (ψ , ψv ,c) Iw w L M v∈V4 c1=1 c2=1 c3=1 y Z=0 y Z=0 y Z=0 Z Z R ZR X X X X 1 2 3 Uw( )\Uw( ) U w( ) dy dy dy ψ (wuy) ψv (u) p (Lcwuy) p (My) d∗u 1 2 3 , · L M T,R T,R y4 y5 y4 1/c3 1 2 3 and c = c3/c2 . c2/c1 c1 ! The main term in the Kuznetsov trace formula is given in Proposition 3.5.1 and consists of the first term (corresponding to the identity Weyl element w = w1) on the geometric side of the trace formula. In this section we bound Iw in each of the remaining cases. We remark first, by Friedberg [Fri87], that w = 0 unless w is relevant. That is w must be of the form I I n1 k . w = . . , where Ini is the identity matrix of size ni ni and 4 = ni with 1 k 4 and × i=1 ≤ ≤ Ink ! n Z . The relevant Weyl group elements are therefore, P i ∈ ≥0 1 1 1 1 1 1 1 1 w1 = 1 , w2 = 1 , w3 = 1 , w4 = 1 , 1 1 1 1 1 1 1 1 1 1 1 1 w5 = 1 , w6 = 1 , w7 = 1 , w8 = 1 . 1 1 1 1 To motivate the strategy for bounding w, we consider (4.0.1) (choosing L = M = 1) and then take absolute values to obtain I δ (y) (4.0.2) I p (y) w p (cwyu) du d×y, y = diag(y y y ,y y ,y , 1) , | w| ≪ | T,R | δ(y) T,R 1 2 3 1 2 1 Z3 c∈ + RZ3 U Z(R) X + w 3 4 3 for each Weyl group element w where δ(y)= y1y2y3 is the modular character and δw(y) is the Jacobian of −1 δw (y) − 1 − 1 −1 U (R) u yuy . It can be checked that = δ 2 (y) δ 2 (wyw ). Theorem 4.0.3 is required to w ∋ 7→ δ(y) · prove the absolute convergence of (4.0.2). The trivial bound of the Kloosterman sum is given by − 1 S(1, 1,c) δ 2 (c) c c c . ≪ ≪ 1 2 3 17 1+ε From this, one obtains the absolute convergence of the sum over c provided that pT,R(y) δ (y). Fortu- nately, then one checks that the u-integral is also absolutely convergent and ≪ p (cwyu) du δ1+ε(c) δ1+ε(wyw−1). T,R ≪ · ZR Uw( ) Then the remaining y integral becomes 1 +ε −1 − 1 × p (y) δ 2 wyw δ 2 (y) d y. T,R · · RZ3 + 1 − 1 −1 −ε ε So, to make the y integral convergent one also needs p (y) δ 2 (y) δ 2 wyw min(y ,y ), for all T,R ≪ · Weyl elements w. Note that min(y−ε,yε) is needed as buffer as in the proof of Theorem 4.0.13 and that for 1+ε 1 w = wlong this bound coincides with δ (y). One also notes that δ 2 (y) is the trivial bound of pT,R(y). The main technical tool for bounding the geometric side, the proof of which occupies all of Section 6, is the following theorem. Theorem 4.0.3. Let 0 <ε< 1 and r Z . There exists R sufficiently large such that the following is ∈ ≥0 true. Suppose a1,a2,a3 satisfy the conditions ε 2r a 1 ε (1 j 3) if (r , r , r ) (0, r, 0), (r, r, 0), (0, r, r), (r, r, r) , ≤ | j − j |≤ − ≤ ≤ 1 2 3 ∈ or ε 2r a 1 ε, ε a 1 ε, 1+ ε a < ε if (r , r , r ) = (r, 0, 0), ≤ | − 1|≤ − ≤ | 2|≤ − − ≤ 3 − 1 2 3 or 1+ ε a < ε, ε a 1 ε, ε 2r a 1 ε if (r , r , r )=(0, 0, r). − ≤ 1 − ≤ | 2|≤ − ≤ | − 3|≤ − 1 2 3 Then we have the bound 3 ε+4R+9+ P (δ −r ) 3 +a 3 +a 0,rj j p (y) y 2 1 y2+a2 y 2 3 T j=1 . T,R ≪ 1 2 3 Here, δ0,rj is equal to 1 if rj =0 and is zero otherwise. The implicit constant depends on ε and R. Proof. We will show in Section 6 that pT,R(y) can be expressed as a sum of a “shifted pT,R term,” “single residue terms,” “double residue terms” and “triple residue terms” (see (6.1.8)). A bound for the shifted pT,R term is given in Proposition 6.3.4. Note that in the proof of Proposition 6.3.4 the first set of inequalities for aj (j =1, 2, 3) is shown to hold for any (r1, r2, r3) with rj 0. Bounds for the single residue terms are given in Proposition 6.4.2 and Proposition 6.4.18. See the proof≥ of Lemma 6.4.13 for details of why the further inequalities given above are required. Bounds for the double residue terms are given in Proposition 6.5.4 and Proposition 6.5.25. Finally, bounds for the triple residue terms are given in Proposition 6.6.2. Combining these bounds gives the desired result. 3 Proposition 4.0.4. Let w be as above. Let M = (m1,m2,m3),L = (ℓ1,ℓ2,ℓ3) Z , where CL,M = 0 is the normalization factor givenI in Definition 3.2.1. Let r 1 be an integer. Then for∈ R sufficiently large6 and any ε> 0, we have ≥ C−1 (ℓ m )2r−1/2(ℓ m )2r−1(ℓ m )2r−1/2B (T ), L,M Iwj ≪ε,R 1 1 2 2 3 3 j where T ε+8R+20−4r if j =2, 3, 4, ε+8R+19−5r Bj (T )= T if j =6, 7, T ε+8R+18−6r if j =5, 8. Remark 4.0.5. Given Proposition 3.5.1 (the asymptotic formula for the main term with asymptotic error terms), we need 20 4r < 6 in order for the contribution from w to be smaller than the main term . In other words, we will− need to take r 4. In order to minimizeI the contribution of L and M in the MainM Theorem 1.1.1, we take r =4. ≥ 18 Proof. The main idea of the proof of Proposition 4.0.4 is to apply Theorem 4.0.3 to each of the two instances of pT,R which appear on the right hand side of (4.0.1). Before doing so, we make the change of variables −1 −1 u yuy . Note that, by definition, d(yuy ) = δw(y) du for any u U w. We see that taking absolute values7→ in (4.0.1), we obtain ∈ ∞ ∞ ∞ ∞ ∞ ∞ (4.0.6) S (ψ , ψv ,c) |Iw| ≪ | w L M | v∈V4 c1=1 c2=1 c3=1 y Z=0 y Z=0 y Z=0 Z Z R ZR X X X X 1 2 3 Uw( )\Uw( ) U w( ) ∗ dy1 dy2 dy3 δw(y) pT,R(Lcwyu) pT,R(My) d u 4 5 4 · · | | · | | y1 y2 y3 For the term pT,R(Lcwyu), we need the Iwasawa form: Lcwyu =: u′tk so that we can apply Theorem 4.0.3 for a particular choice of integers r , r , r and parameters 2r 1 < 1 2 3 j − aj < 2rj for each j =1, 2, 3. For notational purposes, we write t = t(Lcwuy) =: Y = (Y1, Y2, Y3). It is easy to see that Yi factors as Yi =: Yi(w,c)Yi(w,L)Yi(w,y)Yi(w,u) with each factor being an expression in the entries of c, L, y or u respectively. (Note that we are following the notation of (2.1.2) for the element Y .) By inspection, we see that 3 3 2 +a1 2+a2 2 +a3 (4.0.7) Y1(w,L)= ℓ1 , Y2(w,L)= ℓ2 , Y3(w,L)= ℓ3 for all w. Moreover, ξ2(w,u) ξ1(w,u) ξ3(w,u) ξ2(w,u) (4.0.8) Y1(w,u)= , Y2(w,u)= · , Y3(w,u)= , pξ1(w,u) p ξ2(w,u) pξ3(w,u) where each function ξ (w,u) is strictly positive for any u U(R). j ∈ For example, in the case of w = w8, the long element, we find that if 1 x12 x13 x14 y1y2y3 0 00 0 1 x23 x24 0 y1y2 0 0 u = , y = (y1,y2,y3)= , 0 0 1 x34 0 0 y1 0 00 0 1 0 0 01 then 1 1 1 (4.0.9) Y1(w8,y)= , Y2(w8,y)= , Y3(w8,y)= , y3 y2 y1 and 2 2 2 ξ1(w8,u)=1+ x12 + x13 + x14, 2 2 2 ξ (w ,u)=1+ x2 + x2 + x x x + x x x + x x x x , 2 8 23 24 12 24 − 14 12 23 − 13 13 24 − 14 23 2 2 ξ (w ,u)=1+ x2 + x x x + x x x x x x x + x . 3 8 34 23 34 − 24 12 23 34 − 13 34 − 12 24 14 Returning now to (4.0.6), we apply Theorem 4.0.3 for (r, r, r) and yet to be determined values a1,a2,a3 ′ within the permissible bounds (ε 2r aj 1 ε) to the term pT,R(u tk). To the other term we apply ′ ′ ′≤ | − | ≤ − ′ ′ ′ ′ the theorem for a choice (r1, r2, r3) and values b1,b2,b3. As we will see, values of (r1, r2, r3) and bj will be forced upon us in order to guarantee the convergence of the sum over c, the integral over (y1,y2,y3) and the integral over u. In fact, it will become evident that these values are determined by w and a1,a2,a3. Independent of the choice of w, we define I := (0, 1], I = (1, ), 0 1 ∞ 19 hence ∞ ∞ ∞ = . Z Z Z i,j,k∈{0,1} ZIi ZIj ZIk y1=0 y2=0 y3=0 X Using the bounds for pT,R (once with parameters a1,a2,a3 and once with parameters b1,b2,b3 as described above), it follows that 3 ′ ′ ′ ε+8R+18−3r−r −r −r + P δr′ , 3 3 1 2 3 i 0 2 a a a b b b (4.0.10) T i=1 (ℓ m ) 2 (ℓ m ) (ℓ m ) 2 ℓ 1 ℓ 2 ℓ 3 m 1 m 2 m 3 |Iw| ≪ 1 1 2 2 3 3 1 2 3 1 2 3 ∞ ∞ ∞ v Sw(ψM , ψL,c) · 1+2a1−a2 1−a1+2a2−a3 1−a2+2a3 v∈V c =1 c =1 c =1 c1 c2 c 3 X4 X1 X2 X3 3 3 3 3 +b1 +b3 2 +a1 2+a2 2 +a3 2 2+b2 2 Y1(w,y) Y2(w,y) Y3(w,y) y1 y2 y3 δw(y) · Ii Ij Ik · · | | i,j,kX∈{0,1} Z Z Z 1 a2 1 a1 a3 1 a2 dy1 dy2 dy3 − 2 −a1+ 2 − 2 + 2 −a2+ 2 − 2 + 2 −a3 ∗ 4 5 4 ξ1 ξ2 ξ3 d u . · y1 y2 y3 · · · | | Z Z R Z Uw( )\Uw( ) U w(R) It is known (cf. [Jac67]) that the integral in ξ will converge provided that each of the exponents of ξj for j =1, 2, 3 is less than 1 . Explicitly, we require that − 2 (4.0.11) 2a3, 2a1 >a2, and 2a2 >a1 + a3. Note that for any r 2 the first of the conditions in (4.0.11) is ensured for any choice of a ,a ,a such that ≥ 1 2 3 (4.0.12) 0 < 2r a < 1 for each j =1, 2, 3. | − j| In this range, the second condition (that 2a2 > a1 + a3) imposes an additional constraint, but we will see that it can be easily satisfied as well. We next want to determine what additional restrictions on a1,a2,a3 must be satisfied to guarantee the convergence of the sum over c. We require the following Kloosterman bounds. Proposition 4.0.13. Let w = w . The sum 6 1 ∞ ∞ ∞ S (ψ , ψv ,c) (M,L; w,a) := | w M L | , K 1+2a1−a2 1−a1+2a2−a3 1−a2+2a3 c =1 c =1 c =1 c1 c2 c3 vX∈V4 X1 X2 X3 which appears on the right hand side of (4.0.10), satisfies the following bounds (with all implied constants independent of M, L, c, and a). For 2 j 8 and any ε> 0, we have ≤ ≤ ∞ ∞ ∞ 1 1 1 (M,L; wj ,a) . |K | ≪ 2a1−a2 −a1+2a2−a3 −a2+2a3 c =1 c1 c =1 c2 c =1 c3 X1 X2 X3 Proof. As noted in Appendix B, we have (4.0.14) S (ψ , ψv ,c) c c c (2 j 8). | wj M L | ≪ 1 2 3 ≤ ≤ Applying this to the definition of (M,L,c; w,a) gives the desired result. K Appendix B gives slightly better bounds for the Kloosterman sums in terms of c1,c2,c3 at the expense of some powers of M,L. The bounds in Appendix B will likely be relevant in other applications. However, we thank the referee for pointing out that the proof of Proposition 4.0.13 only requires the trivial bound for Kloosterman sums proved in [DR98, Theorem 0.3 (i)]. Clearly, the series in the above proposition will converge as long as each cj , for 1 j 3, occurs to an exponent less than 1. This will be guaranteed by the following additional set of restrictions:≤ ≤ − (4.0.15) 2a + a < 1, a 2a + a < 1, a 2a < 1. − 1 2 − 1 − 2 3 − 2 − 3 − Again, this is easy to arrange given that we may take any values of aj satisfying the bounds of (4.0.12). Note, moreover, that (4.0.11) is a consequence of (4.0.15). 20 The next step is to show that the integral over y = (y1,y2,y3) also converges. An elementary calculation shows that 3 +b 3 +b 3 3 2 1 2+b2 2 3 +a1 2+a2 +a3 y1 y2 y3 Y1(w,y) 2 Y2(w,y) Y3(w,y) 2 δw(y) 4 5 4 dy1dy2dy3 y1y2y3 b1−e1(w;a) b2−e2(w;a) b3−e3(w;a) dy1 dy2 dy3 = y1 y2 y3 , y1 y2 y3 where ej (w; a) is given by ′ ′ ′ w e1(w; a) e2(w; a) e3(w; a) (r1, r2, r3) w a a + a a + a (r, 0, 0) 2 3 − 1 3 − 2 3 w3 a1 a2 a1 a3 a1 (0, 0, r) w a − a a− a + a (0, r, 0) (4.0.16) 4 2 3 2 1 2 w a− a a + a − a (r, r, r) 5 3 1 − 2 3 1 w6 a2 a3 a2 a1 (0, r, r) w a− a a + a (r, r, 0) 7 3 2 − 1 2 w8 a3 a2 a1 (r, r, r) 3 4 3 The result for w8, for example, is established using (4.0.9) and the fact that δw8 (y)= y1y2y3. This means that for each j = 1, 2, 3 and k = 0, 1 we are searching for a1,a2,a3 satisfying (4.0.12) and ′ ′ ′ (4.0.15). Simultaneously, we search for r1, r2, r3 Z≥0 and b1,b2,b3 satisfying the necessary bounds given in Theorem 4.0.3 such that the integral ∈ dy ybj −ej (w;a) j j y ZIk j converges. Since I = (0, 1] and I = (1, ), we require that b e (w; a) be positive if k =0 and negative 0 1 ∞ j − j if k =1. With this in mind, we let ε> 0 and choose b1,b2,b3 such that +ε if k =0 bj ej(w; a)= − ε if k =1. (− ′ Note that having made this choice for bj , the value of rj is forced to be that given in the final column of ′ ′ ′ the table above. More precisely, given (r1, r2, r3) as indicated in the final column of the table, there exists some choice a1,a2,a3 and ε > 0 for which conditions (4.0.12) and (4.0.15) are satisfied, and for which the necessary bounds on b = e (w; a) ε are also satisfied. j j ± Except in the case that w = w2 or w = w3, the conditions on bj are that 0 < 2r′ (w) e (w; a) ε < 1. | j − j ± | It is not hard to see that in these cases there exists an appropriate choice of parameters a1,a2,a3. ′ ′ ′ On the other hand, if w = w2, for example, we see that (r1, r2, r3) = (r, 0, 0), and so the restriction on the quantities b = a a ε and b = a a ε (which plays the role of a in Theorem 4.0.3) are 2 3 − 1 ± 3 3 − 2 ± 3 (4.0.17) 0 < b = a a ε < 1, | 2| | 1 − 3 ± | (4.0.18) 1+ ε b = a a ε ε. − ≤ 3 3 − 2 ± ≤− But we’re assuming that a 2a + a < 1 and a a < 1 ε (by equations (4.0.15) and (4.0.17)), which 1 − 2 3 − 1 − 3 − together imply that a3 a2 < ε in any event. A similar analysis applies to the above restriction on b1 in − ′ −′ ′ the case that w = w3 and (r1, r2, r3)=(0, 0, r). ′ The values of rj for j =1, 2, 3 determine the exponent of T in (4.0.10), hence the values of Bj (T ) in the statement of the proposition. To complete the proof, we note that a < 2r +1 and b < 2r′ (w)+1 2r +1, j j j ≤ and therefore, the powers of ℓ1,ℓ2,ℓ3,m1,m2,m3 in (4.0.10) are as claimed. 21 5. Mellin transform of the GL(4) Whittaker function 4 3 Let α = (α1, α2, α3, α4) (iR) with α1 +α2 +α3 +α4 =0. Let y = (y1,y2,y3) R and s = (s1,s2,s3) 3 ∈ ∈ ∈ C with Re(sj ) >ε for j =1, 2, 3 and ε> 0. Define the Mellin transform (denoted Wα(s)) of the GL(4, R) Whittaker function Wα defined in Section 2.6 by the absolutely convergent integral ∞ ∞ ∞ f 3 3 s1− 2 s2−2 s3− 2 dy1dy2dy3 (5.0.1) Wα(s) := y1 y2 y3 Wα(y) . y1y2y3 Z0 Z0 Z0 f 5.1. Formula for Mellin transform of the Whittaker function. Here we present an expression for Wα(s) as an integral, over an additional variable t C, of a ratio of Gamma functions involving s and α. For the purposes of this section, we will assume that∈ α is in general position, meaning that α = α for all j 6 k jf= k. As explained in Remark 6.1.9, for our purposes this assumption is not prohibitive. 6 In the context of GL(4), this expression was first given in [Sta95]; that result was later generalized to −3 −s −s −s s GL(n), in Theorem 3.1 of [Sta01]. The formula for n = 4 takes the form W (s)=2 π 1 2 3 W α , α 2 2 where, assuming that Re(s ) ε> 0 for each j =1, 2, 3, j ≥ f 1 c (5.1.1) W (s)=Γ(s + α )Γ(s + α )Γ(s α α )Γ(s + α + α )Γ(s α )Γ(s α ) α 1 1 1 2 2 − 1 − 2 2 1 2 3 − 1 3 − 2 · 2πi Γ( t + α )Γ( t + α )Γ(t + s )Γ(t + s + α )Γ(t + s + α )Γ(t + s + α + α ) c − 3 − 4 1 2 1 2 2 3 1 2 dt, · Γ(t + s1 + s2 + α1 + α2)Γ(t + s2 + s3) Re(t)=Z −ε′ assuming that 0 <ε′ <ε. 5.2. Poles and residues of Wα. Following [Sta01], we introduce the sets (5.2.1) P1 := α1, α2, α3, α4 , f {− − − − } P := (α + α ), (α + α ), (α + α ) , 2 {± 1 2 ± 1 3 ± 2 3 } P := α , α , α , α . 3 { 1 2 2 4} Note that if p P then p P . ∈ k − ∈ 4−k It is shown in [ST21, Propositions 12 and 14] that the sets P1, P2, and P3 determine the poles of Wα(s), in the following sense. f Proposition 5.2.2. The Mellin transform Wα(s) extends to a meromorphic function of the variable s = (s ,s ,s ) C3 with the following properties. 1 2 3 ∈ f (a) Wα(s) has a pole at sj = p 2δ for each p Pj and δ Z≥0. Moreover, Wα(s) has no other poles or polar divisors in C3. − ∈ ∈ f f (b) The residue of Wα(s) at any of the above poles is a polynomial times a ratio of Gamma functions. More specifically, for each δ Z , there exists a polynomial Q (b,c,d; e,f,g), of degree at most 3δ, such ∈ ≥0 δ that the following are true.f (5.2.3) 4 1 αk −α1 s2+α1+αk s3−αk Res Wα(s)= Γ( δ)Γ( )Γ( ) s =−α −2δ s2+s3+α1 2 2 2 1 1 Γ( 2 + δ) " − # kY=2 f s α s α s α 1+ α s + s s α s + s + α Q 3 − 2 , 3 − 3 , 3 − 4 ; 1 − 2 3 , 3 − 1 δ, 2 3 1 , · δ 2 2 2 2 2 − 2 3 s1+αj s3−αj αk −αj (5.2.4) Res Wα(s)= Γ( 2 ) Γ( 2 ) Γ( 2 δ) s2=−α1−α4−2δ − j∈{Y1,4} kY=2 j∈{Y1,4} f s + α α α s α 1+ α α s + α s α Q 1 1 , 3 − 4 δ, 3 − 2 ; 1 − 2 , 1 3 δ, 3 − 4 δ , · δ 2 2 − 2 2 2 − 2 − 22 and 4 1 α1−αk s1+αk s2−α1−αk (5.2.5) Res Wα(s)= Γ( δ)Γ( )Γ( ) s =α −2δ s1+s2−α1 2 2 2 3 1 Γ( 2 + δ) " − # kY=2 f s + α s + α s + α 1 α s + s s + α s + s α Q 1 2 , 1 3 , 1 4 ; − 1 − 2 1 , 1 1 δ, 1 2 − 1 . · δ 2 2 2 2 2 − 2 The formulas for the remaining residues are found from each of the above by permuting α (i.e., applying Weyl group transformations). It may be seen from [ST21, Equation (43)] that Q0 is the constant polynomial Q0 1. Thus the case δ =0 of the above proposition yields the following special cases, also deduced in [Sta01,≡ Theorem 3.2]: 4 αk−α1 s2+α1+αk s3−αk Γ( 2 )Γ( 2 )Γ( 2 ) k=2 (5.2.6) Res Wα(s)= , s =−α Q s2+s3+α1 1 1 Γ( 2 ) f 3 s1+αj s3−αj αk −αj (5.2.7) Res Wα(s)= Γ( 2 ) Γ( 2 ) Γ( 2 ) , s2=−α1−α4 j∈{Y1,4} kY=2 j∈{Y1,4} f and 4 α1−αk s1+αk s2−α1−αk Γ( 2 )Γ( 2 )Γ( 2 ) k=2 (5.2.8) Res Wα(s)= . s =α Q s1+s2−α1 3 1 Γ( 2 ) f In Section 6.5 below, we will also need to consider double residues of Wα(s) — that is, residues in any one of the three sj ’s of residues in either of the others. To this end we have the following, which is proved in [ST21, Proposition 15]. f Proposition 5.2.9. (a) For each δ ,δ Z , there is a polynomial f (s , α), of degree at most 1 2 ∈ ≥0 δ1,δ2 3 2δ1 + δ2, such that (5.2.10) Res Res Wα(s) s =−α −α −2δ s =−α −2δ 2 1 4 2 1 1 1 3 f α4−α1 αk −α1 αk −α4 s3−αk = Γ( 2 δ1) Γ( 2 δ1)Γ( 2 δ2)Γ( 2 ) fδ1,δ2 (s3, α). − " − − # kY=2 (b) For each δ ,δ Z , there is a polynomial g (s , α), of degree at most 2δ + δ , such that 1 3 ∈ ≥0 δ1,δ3 2 1 3 (5.2.11) Res Res Wα(s) s =α −2δ s =−α −2δ 3 2 3 1 1 1 4 f α2−α1 αk −α1 α2−αk s2+α1+αk = Γ( 2 δ1) Γ( 2 δ1)Γ( 2 δ3)Γ( 2 ) gδ1,δ3 (s2, α). − " − − # kY=3 5.3. Shift equations. We would like to have an expression similar to (5.1.1) for Wα(s) in the region where Re(s) < 0. Although we cannot use the right hand side of (5.1.1) directly when Re(s) < 0, we can use the fact that Wα(s) satisfies the following shift equation which (as will be showfn) is a direct corollary of Propositions 7 and 9 from [ST21]. f 3 4 Proposition 5.3.1. Let s = (s1,s2,s3) C . Let α = (α1, α2, α3, α4) C with α1 + α2 + α3 + α4 = 0. Suppose that r , r , r 0 are integers. Then∈ ∈ 1 2 3 ≥ r1 r2 r3 Qr1,r2,r3 W (s ,s ,s ) j,k,ℓ W s + 2(r + j + k),s +2r ,s + 2(r + ℓ) , α 1 2 3 ≪ r1 r2 r3 α 1 1 2 2 3 3 j=0 1 2 3 Xℓ=0 kX=0 X B B B 23 f f where := (α, s) := s + α s + α s + α s + α , B1 B1 1 1 1 2 1 3 1 4 := (α, s) := s + α + α s + α + α s + α + α B2 B2 2 1 2 2 1 3 2 1 4 s + α + α s + α + α s + α + α , · 2 2 3 2 2 4 2 3 4 := (α, s) := s α s α s α s α , B3 B3 3 − 1 3 − 2 3 − 3 3 − 4 and Qr1,r2,r3 is a polynomial in α and s with combined degree 2(r +2r + r j k ℓ). j,k,ℓ 1 2 3 − − − Proof. We begin with Proposition 7(a) of [ST21] which states that q (α, s) q (α, s) W (s ,s ,s )= 0 W (s +2,s ,s )+ 1 W (s +2,s ,s + 2), α 1 2 3 (α, s ) α 1 2 3 (α, s ) α 1 2 3 B1 1 B1 1 where deg(q )=2f 2i. Iterating this formulaf r times gives f i − 1 r1 (ℓ) (α, s) Q1,r1 (5.3.2) Wα(s1,s2,s3) r Wα(s1 +2r1,s2,s3 +2ℓ) . ≪ 1(α, s1) 1 ℓ=0 B X In order to have an equality f here, we would need to keep trackf of various shifts of the polynomial (α, s ), 1 1 but since we are only interested in bounds, the version presented here suffices. It is easy to show thatB (ℓ) deg( ) = (r1 ℓ) deg(q0)+ ℓ deg(q1)=2(r1 ℓ). Q1,r1 − − Similarly, Proposition 9 of [ST21] states that p (α, s) p (α, s) W (s ,s ,s )= 0 W (s ,s +2,s )+ 1 W (s +2,s +2,s ), α 1 2 3 (α, s ) α 1 2 3 (α, s ) α 1 2 3 B2 2 B2 2 where deg(p )=4f 2k. Iterating this formulaf r times gives f k − 2 r2 (k) (α, s) Q2,r2 (5.3.3) Wα(s1,s2,s3) r Wα(s1 +2k,s2 +2r2,s3) , ≪ 2(α, s2) 2 k=0 B X and f f (k) deg( ) = (r2 k) deg(p0)+ k deg(p1)=4(r2 k)+2k =4r2 2k. Q2,r2 − − − Via the change of variables (s ,s , α) (s ,s , α) which preserves W applied to (5.3.2), we have 1 3 7→ 3 1 − α r3 (j) ( α, s) Q1,r3 − f (5.3.4) Wα(s1,s2,s3) r Wα(s1 +2j, s2,s3 +2r3) . ≪ 3(α, s3) 3 j=0 B X f f Applying equations (5.3.2), (5.3.3) and (5.3.4) in succession gives the desired result with r1,r2,r3 (ℓ) (k) (j) deg(Q ) = deg( ) + deg( ) + deg( )=2(r1 +2r2 + r3 ℓ k j), j,k,ℓ Q1,r1 Q2,r2 Q1,r3 − − − as claimed. 5.4. Expressing Wα as the inverse Mellin transform of Wα. Given the equation (5.0.1) for the Mellin transform of Wα, we find by Mellin inversion that 1 3 −s f 3 −s (5.4.1) W (y)= y 2 1 y2−s2 y 2 3 W (s) ds, α (2πi)3 1 2 3 α Re(ZZZs)=u f provided that u = (u1,u2,u3) satisfies uj > 0 for j =1, 2, 3. As a matter of notation, for u = (u ,u ,u ) R3 define 1 2 3 ∈ 1 3 −s 3 −s W (y; u) := y 2 1 y2−s2 y 2 3 W (s) ds, α (2πi)3 1 2 3 α Re(ZZZsj )=uj 24 f and if I is a nonempty subset of 1, 2, 3 of cardinality r and p = (p ) Cr define { } I i i∈I ∈ 3 3 pI 1 2 −s1 2−s2 2 −s3 α (y; u) := 3−r Res y1 y2 y3 Wα(s) dsj , R (2πi) sI =pI Z j∈ /I Re(sj )=uj Y j∈ /I f where RessI =pI is the operator which evaluates the iterated residue at each of the points si = pi with i I, i.e., ∈ Res := Res Res , (I = (i1,...,iq)). sI =pI si1 =pi1 ◦···◦ siq =piq