Arxiv:2005.11808V1 [Math.SP]
Total Page:16
File Type:pdf, Size:1020Kb
HECKE TRIANGLE GROUPS, TRANSFER OPERATORS AND HAUSDORFF DIMENSION LOUIS SOARES Abstract. We consider the family of Hecke triangle groups Γw = S,Tw generated by the M¨obius h i transformations S : z 1/z and Tw : z z + w with w> 2. In this case the corresponding hyperbolic 2 7→ − 7→ quotient Γw H is an infinite-area orbifold. Moreover, the limit set of Γw is a Cantor-like fractal whose Hausdorff dimension\ we denote by δ(w). The first result of this paper asserts that the twisted Selberg zeta function ZΓw (s,ρ), where ρ : Γw U(V ) is an arbitrary finite-dimensional unitary representation, can be realized as the Fredholm determinant→ of a Mayer-type transfer operator. This result has a number 1 of applications. We study the distribution of the zeros in the half-plane Re(s) > 2 of the Selberg zeta n function of a special family of subgroups (Γw)n∈N of Γw. These zeros correspond to the eigenvalues of the n n 2 Laplacian on the associated hyperbolic surfaces Xw = Γw H . We show that the classical Selberg zeta \ function ZΓw (s) can be approximated by determinants of finite matrices whose entries are explicitly given in terms of the Riemann zeta function. Moreover, we prove an asymptotic expansion for the Hausdorff dimension δ(w) as w . → ∞ 1. Introduction In [14] Hecke introduced the one-parameter family of subgroups Γw = S, Tw of PSL2(R)=SL2(R)/ id generated the elements h i {± } 1 w 0 1 T = and S = , w 0 1 1 0 and their inverses, where w is a positive real number. On the hyperbolic plane H2 = z = x + iy : x R, y R , { ∈ ∈ >0} these elements act by the M¨obius transformations S : z 1/z and Tw : z z + w. The groups Γw, which came to be known as the ‘Hecke triangle groups’,7→ naturally − generalize7→ the well-known modular arXiv:2005.11808v1 [math.SP] 24 May 2020 group a b PSL (Z)= Z2×2 : ad bc =1 , 2 c d ∈ − which corresponds to the case w = 1. Hecke showed that Γw is a Fuchsian group, that is, a discrete subgroup of PSL (R), if and only if w = 2 cos(π/q) for integer q 3 or w 2. Moreover, the set 2 ≥ ≥ w (1) (w)= z H2 : Re(z) < , z > 1 F ∈ | | 2 | | n o 2 provides a fundamental domain for the action of Γw on H , see Figure (1). 2010 Mathematics Subject Classification. Primary: 11M36, Secondary: 37C30, 37D35, 11K55. Key words and phrases. Selberg zeta function, Hecke triangle groups, transfer operator, Hausdorff dimension. 1 2 L. SOARES w>i 2 w 1 0 1 w − 2 − 2 Figure 1. Fundamental domain (w) for Γ with w> 2 F w In the present paper we will restrict our attention to the case w > 2. In this case the quotient Γ H2 is an infinite-area hyperbolic orbifold with one cusp, one funnel and one conical singularity1. In w\ particular, the limit set Λ(Γw) of Γw is a Cantor-like fractal whose Hausdorff dimension we denote by δ(w). Equivalently, δ(w) is the exponent of convergence of the Poincar´eseries for Γw, see [31]. We are interested in the Selberg zeta function of Γw twisted by arbitrary finite-dimensional unitary representations ρ: Γ U(V ). It is defined for Re(s) > δ(w) by the infinite Euler product w → ∞ (2) Z (s, ρ)= det 1 ρ(γ)e−(s+k)ℓ(γ) , Γw V V − [γ] k=0 Y Y where [γ] runs over the conjugacy classes of primitive hyperbolic elements of Γw and ℓ(γ) is the dis- placement length of γ (see Subsection 2.1). Notice that (2) reduces to the classical Selberg zeta function when ρ = 1 is the trivial one-dimensional representation. Our first main result asserts that ZΓw (s, ρ) can be realized as the Fredholm determinant of a well-chosen family of transfer operators. Theorem 1.1. Fix w> 2, let Γw = S, Tw be the corresponding Hecke triangle group, and let ρ: Γw U(V ) be a unitary representation withh finite-dimensionali representation space V. Let D be the open unit→ disk of the complex plane and consider the operator acting on functions f : D V via Ls,w,ρ → ′ s −1 D (3) s,w,ρf(z)= γn(z) ρ(γn) f (γn(z)) , z , L Zr ∈ n∈X{0} where γ := ST n. Then, for all s C with Re(s) > 1 , equation (3) defines a trace-class operator n w ∈ 2 (4) : H2(D; V ) H2(D; V ) Ls,w,ρ → (see Subsection 2.3 for more details). Moreover, the twisted Selberg zeta function is represented by the Fredholm determinant of (4), that is, (5) Z (s, ρ) = det(1 ) Γw −Ls,w,ρ 1 for all Re(s) > 2 . Remark 1.2. Identities such as (5) are well-known in thermodynamic formalism, a subject going back to Ruelle [39]. The relation between the Selberg zeta function and transfer operators has been studied by a number of different authors. For the convex co-compact setting (no cusps) we refer to [36, 37, 13]. In the presence of cusps, the first example of an identity in the spirit of (5) was given by Mayer [23] for the modular group Γ1 = PSL2(Z) and for the trivial twist ρ = 1. Hecke triangle groups (cofinite and non-cofinite) have been studied extensively in Pohl [34, 35], where a version of (5) has been proven by geometrical methods and using different transfer operators. Our proof relies solely on 1the conical singularity is caused by the elliptic element S which fixes the point i 3 certain combinatorial features of the group Γw and is reminiscent of the method of Lewis–Zagier [21] for the modular group. Related work includes [10, 26, 25, 24, 9]. The representation of the Selberg zeta functions in terms of transfer operators has proven to be a powerful tool in the spectral theory of infinite-area hyperbolic surfaces, a subject not yet fully explored. For instance, transfer operator techniques have been implemented in [19] to construct hyperbolic surfaces with arbitrarily small ‘spectral gap’. In [13, 29], transfer operators have been used to prove fractal Weyl bounds for resonances of the Laplacian on hyperbolic surfaces, analogous to Sj¨ostrands pioneering work [45] on semi-classical Schr¨odinger operators. Related works where thermodynamic formalism plays an essential role include [27, 28, 18, 16, 8, 30]. Another application of Fredholm determinant identities such as (5) is a simple proof of meromorphic continuation of the twisted Selberg zeta function, which is far from obvious from its definition in (2) as an infinite product over primitive conjugacy classes. Theorem 1.1 gives a new proof of the following result: Corollary 1.3. Assumptions being as in Theorem 1.1, the Selberg zeta function ZΓw (s, ρ) admits a meromorphic continuation to s C and all its poles are contained in 1 (1 N ). ∈ 2 − 0 In this paper we give additional applications of Theorem 1.1. The transfer operator obtained in Theorem 1.1 can be used to study the Hausdorff dimension δ(w) of the limit set Λ(Γw). Apart from its intrinsic interest, the Hausdorff dimension of the limit set of Fuchsian groups plays a profound role in the spectral 2 theory of hyperbolic surfaces. For instance, the base eigenvalue of the Laplacian on Γw H is known to be equal to δ(w)(1 δ(w)) by Patterson’s result [31, Theorem 7.2]. \ − For applications to spectral theory, it is sometimes more convenient to work with torsion-free Fuchsian groups Γ in which case the quotient Γ H2 is a smooth surface2. Selberg’s lemma [42] says that every finitely generated Fuchsian group has a\ finite-index, torsion-free subgroup. In the case of Hecke triangle 1 C× groups there is a simple way of manufacturing such a subgroup Γw Γw. Indeed, let ρ: Γw be ⊂ 1 → the one-dimensional representation defined by ρ(Tw) = 1 and ρ(S) = 1, and set Γw = ker(ρ). The 1 − 3 group Γw is a normal subgroup of Γw (being the kernel of a homomorphism) and it is freely generated by the elements 1 w 1 0 (6) T ± = and R± := ST ±S = . w 0± 1 w w w 1 ∓ 1 In particular Γw contains no elliptic elements and it is therefore torsion-free. Moreover we have Γ /Γ1 id,S Z/2Z, w w ≃{ } ≃ 1 H2 so the action of Γw on has the fundamental domain (7) 1(w)= (w) S. (w), F F ∪ F where (w) is the fundamental domain of Γ given in (1), see Figure 2. F w 2 0 that is, Xw has no conical singularities 3 this means that there are no relations between the generators Tw and Rw except for the trivial relations of the form γ−1γ = γγ−1 = id 4 L. SOARES w>i 2 w 2 0 2 w − 2 − w w 2 Figure 2. Fundamental domain 1(w) for Γ1 with w> 2 F w 1 1 H2 It follows that the associated hyperbolic quotient Xw = Γw is a smooth 2-cover of Xw. More generally, for every positive integer n, we can define a family of\ torsion-free subgroups n Γw = ker(ρn) × as the kernel of the representation ρn : Γw C given by → 2πi ρ (S)= 1 and ρ(T )= e n . n − w n n H2 1 The corresponding quotients Xw =Γw are simultaneous covers of both Xw and Xw.