arXiv:math/9904125v1 [math.GT] 22 Apr 1999 uoopim ihafwecpin.Tepofo hsresul this if that of states proof which The Hirshon, R. exceptions. of result few a with , caty[M rvdta if that that proved [KM] McCarthy igcasgroup class ping automorphism. L ]adrsdal nt G 1.Hnei shpa.NV I N.V. hopfian. is it Hence that I1]. proved [G, [IM] finite McCarthy residually J.D. and B] [L, of endomorphism lyfiiegop r ofin[LS]. hopfian are groups finite ally eeae eiulyfiiegroup finite residually generated xssahomomorphism a exists h stp lse foinainrvrigdiffeomorphism reversing in orientation of classes isotopy the of of htde o contain not does that then group otiil qiaety hr ssm nt ne normal index finite some is there Equivalently, nontrivial. diffeomorphisms preserving group Φ n NEDMRHSSO UFC APN CLASS MAPPING OF ENDOMORPHISMS ON e od n phrases: and words Key 1991 h apn ls ru fa retbesraei ntl g finitely is surface orientable an of group class mapping The nti ae,w rv ute htif that further prove we paper, this In ealta group a that Recall ..Ws W aea xml fafiieygnrtdresidual generated finitely a of example an gave [W] Wise D.T. Date Let S M G ( G stegopo stp lse faldiffeomorphisms all of classes isotopy of group the is φ φ si ata automorphism. subgr an a onto fact t surfaces in of orientable is endomorphism certain every of group that class paper ping this in prove We ABSTRACT: S ∗ sa uoopim ti elkonta ntl eeae r generated finitely that known well is It automorphism. an is sntijciefrany for injective not is ) ( coe 7 2018 17, October : n hence and , G M S ahmtc ujc Classification Subject M etitdto restricted eacmatcnetdoinal ufc.Tempigclas mapping The surface. orientable connected compact a be S n nedmrhs of Φ endomorphism an and S sanra ugopand normal a is ) ftesurface the of M G M φ sa automorphism. an is S x S n G . ( noafiieidxsbru,then subgroup, index finite a onto apn ls rus ufcs eiulyfiiegroups. finite residually surfaces, groups, class Mapping sasbru of subgroup a is G G scle eiulyfiiei o each for if finite residually called is f sa neto o some for injection an is ) scle ofini vr ujcieendomorphism surjective every if hopfian called is from S UTF KORKMAZ MUSTAFA S 1. stegopo stp lse forientation of classes isotopy of group the is → Introduction GROUPS G n φ S G nwrn usino .Hrhnin Hirshon R. of question a answering , M h xeddmpigcasgroup class mapping extended The . : nosm nt ru uhthat such group finite some onto rmr 79;Scnay2F8 30F60. 20F38, Secondary 57M99; Primary . G uhthat such M S 1 G scle oofini vr injective every if cohopfian called is S sas oofin uhradJ.D. and Author cohopfian. also is M M φ φ M → uhta h etito fΦto Φ of restriction the that such S sa noopimo h map- the of endomorphism an is sa noopimo finitely a of endomorphism an is S ∗ /φ fidxtwo. index of ( M φ S ( G S sahmmrhs such homomorphism a is saein then abelian, is ) so nt ne in index finite of is ) n . u ffiieindex finite of oup r loincluded also are s S x → φ ugopof subgroup in 1 6= si atan fact in is S emap- he eiso a on relies t oethat Note . ao and vanov enerated yfinite ly G φ f esidu- ( there san is x M is ) G G S ∗ s , 2 MUSTAFA KORKMAZ negative. It might be interesting to consider the same question for mapping class groups of surfaces.

2. Endomorphisms of mapping class groups Let S be a compact connected oriented surface of genus g with b bound- ary components. For any simple closed curve a on S, there is a well known diffeomorphism, called a right , supported in a regular neighbor- hood of a. We denote by ta the isotopy class of a right Dehn twist about −1 a, also called a Dehn twist. Note that ftaf = tf(a) for any orientation preserving mapping class f. The pure mapping class group PMS is the subgroup of MS consisting of those orientation preserving mapping classes which preserve each boundary component. For a group G and a subgroup H of it, we denote by CG(H) the centralizer of H in G. The center of G is denoted by C(G). Theorem 1. Let G be a finitely generated residually finite group, and let φ be an endomorphism of G onto a finite index subgroup. Then there exists an n such that the restriction of φ to φn(G) is an injection.

Theorem 2. Let S be a compact connected orientable surface of genus g with b boundary components. Suppose, in addition, that if g = 0 then b ≥ 5, if g = 1 then b ≥ 3, and if g = 2 then b ≥ 1. Then any isomorphism between ∗ two finite index of the extended mapping class group MS is the ∗ restriction of an inner automorphism of MS. Theorem 1 was proved by R. Hirshon ([H]), and Theorem 2 was proved by N.V. Ivanov [I2] for surfaces of genus at least two and by the author [K] for the remaining cases. Since the mapping class group MS is normal in ∗ MS, we deduce the following theorem. Theorem 3. Let S be a compact connected orientable surface of genus g with b boundary components. Suppose, in addition, that if g = 0 then b ≥ 5, if g = 1 then b ≥ 3, and if g = 2 then b ≥ 1. Then any isomorphism between two finite index subgroups of the mapping class group MS is the restriction of an automorphism of MS.

Lemma 4. Let S be a closed orientable surface of genus two and let Γ be a finite index subgroup of MS. Then the center C(Γ) of Γ is equal to Γ ∩ hσi, where σ is the hyperelliptic involution.

Proof: Since the subgroup hσi = {1,σ} is the center of MS, its intersec- tion with Γ is contained in the center of Γ. N Now let f ∈ C(Γ) and let N be the index of Γ in MS. Since ta ∈ Γ for N N −1 N all simple closed curves a, we have tf(a) = fta f = ta . It follows that −1 f(a)= a (cf. [IM]). Hence, ftaf = tf(a) = ta. Since MS is generated by Dehn twists, f ∈ C(MS)= hσi. ✷ ON ENDOMORPHISMS OF SURFACE MAPPING CLASS GROUPS 3

We are now ready to state and prove the main result of this paper.

Theorem 5. Let S be a compact connected orientable surface of genus g with b boundary components. Suppose, in addition, that if g = 0 then b 6= 2, 3, 4, and if g = 1 then b 6= 2. If φ is an endomorphism of MS such that φ(MS) is of finite index in MS, then φ is an automorphism.

Proof: If S is a (closed) sphere or a disk, then MS is trivial. Clearly, the conclusion of the theorem holds. Suppose first that S is a with b ≤ 1 boundary component. It is well known that MS is isomorphic to SL2(Z). The commutator subgroup of SL2(Z) is a nonabelian free group of rank 2 and its index in SL2(Z) is 12. Let us denote it by F2. φ(F2) is contained in F2 as a finite index subgroup. If this index is k, φ(F2) is a free group of rank k + 1. Since there is no homomorphism from F2 onto a free group of rank ≥ 3, it follows that k = 1. That is, φ(F2)= F2. In particular, φ(SL2(Z)) contains F2. The fact that φ is an automorphism in this case was proved in [KM]. Suppose now that S is not one of the surface above and not a closed a surface of genus 2. Let us orient S arbitrarily. Since MS is finitely gener- ated and residually finite, there exists an n such that the restriction of φ n n+1 to φ (MS ) is an isomorphism onto φ (MS ). Note that the subgroups n n+1 φ (MS) and φ (MS) are of finite index in MS. Hence, there is an au- n tomorphisms α of MS such that the restrictions of α and φ to φ (MS) coincide. n Let N be the index of φ (MS) in MS. For any simple closed curve a on N n N N S, ta is contained in φ (MS ). Hence, α(ta )= φ(ta ). Let f ∈ MS be any element. Then

N −1 N tf(a) = α (φ(tf(a))) −1 N −1 = α (φ(fta f )) −1 −1 N −1 −1 = α (φ(f))α (φ(ta ))α (φ(f )) −1 N −1 −1 = α (φ(f))ta α (φ(f)) N = tα−1(φ(f))(a).

Hence, α−1(φ(f))(a)= f(a) for all a (cf. [IM]). It follows that f −1α−1(φ(f)) commutes with all Dehn twists. Since PMS is generated by Dehn twists, it is in CMS (PMS), the centralizer of PMS in MS. But CMS (PMS) is trivial [IM]. Hence, α−1(φ(f)) = f. Therefore, φ = α. In particular, φ is an automorphism. Suppose finally that S is a closed surface of genus two. Let R be a sphere with six holes. Then MR is isomorphic to the quotient of MS with its center hσi, where σ is the hyperelliptic involution (cf. [BH]) . Let us identify MR and Ms/hσi, and let π : MS → MR be the quotient map. Since φ(σ) is in the center of φ(MS ), either φ(σ)= σ or φ(σ) = 1 by the lemma above. 4 MUSTAFA KORKMAZ

If φ(σ)= σ, then φ induces an endomorphism Φ of MR, such that πφ = Φπ. Then we have a diagram in which all squares are commutative: π 1 −→ hσi −→ MS −→ MR −→ 1       yI yφ yΦ π 1 −→ hσi −→ MS −→ MR −→ 1 where I is the identity homomorphism. Since the image Φ(MR) of Φ is of finite index, Φ is an automorphism by the first part. By 5-lemma, φ is an automorphism. If φ(σ) = 1, then φ induces a homomorphism φ : MR −→ MS such that φπ = φ. The image of the endomorphism Φ = πφ of MR has finite index. Since R is a sphere with six holes, Φ is an automorphism by the first part. Then, φ is an automorphism, and hence σ = 1. This contradiction finishes the proof of our theorem. ✷

Remark: If S is a sphere with two holes, then MS is a group of order two, and if S is a sphere with three holes, then MS is isomorphic to the symmetric group on three letters. Hence, in these cases the trivial homomorphism is an endomorphism onto a finite index subgroup which is not automorphism. We do not know if the conclusion of Theorem 5 holds if a sphere with four holes and a torus with two holes.

References [B] Birman, J. S., Braids, links and mapping class groups, Annals of Math. Studies, Princeton University Press, Princeton, NJ, 1975. [BH] Birman, J.S., Hilden, H.M., On the mapping class groups of closed surfaces as covering spaces, in: Advances in the theory of Riemann surfaces, Ann. Math. Studies no. 66, Princeton University Press, Princeton NJ 1971, 81-115. [G] Grossman, E. K.,On the residual finiteness of certain mapping class groups, J. London Math. Soc. (2) 9 (1974), 160-164. [H] Hirshon, R.,Some properties of endomorphisms in residually finite groups, J. Austral. Math. Soc. Ser. A 24 (1977), no.1, 117-120. [I1] Ivanov, N. V., Finite approximability of modular Teichm¨uller groups, Sibirskii Matematicheskii Zhurnal 32 (1991), no.1, 182-185 [I2] Ivanov, N. V., of complexes of curves and of Teichm¨uller spaces, International Mathematics Research Notices (1997) no. 14, 651-666. [IM] Ivanov, N. V., McCarthy, J. D., On injective homomorphisms between Te- ichm¨uller modular groups, Invent. Math, V. 135, F.2 (1999), 425-486. [K] Korkmaz, M., Automorphisms of complexes of curves on punctured spheres and on punctured tori, Topology and its Applications, to appear. [KM] Korkmaz, M., McCarthy, J. D., Surface mapping class groups are ultrahopfian, Proc. Camb. Phil. Soc., to appear, [L] Lickorish, W. B. R., A finite set of generators for the group of a 2-, Proc. Camb. Phil. Soc. 60 (1964), 769-778. [LS] Lyndon, R. C., Schupp, P. E., Combinatorial group theory, A Series of Modern Surveys in Mathematics, Springer-Verlag, Berlin Heidelberg, 1977. ON ENDOMORPHISMS OF SURFACE MAPPING CLASS GROUPS 5

[W] Wise, D., An endomorphism of a finitely generated residually finite group, MAGNUS preprint, #97-09-23A, available at http://zebra.sci.ccny.cuny.edu/ web/html/1997.html.

Department of Mathematics, Middle East Technical Univer- sity, 06531 Ankara, Turkey. E-mail: [email protected].