On medium-rank Lie primitive and maximal subgroups of exceptional groups of Lie type David A. Craven Author address: School of Mathematics, University of Birmingham, Birmingham, B15 2TT, United Kingdom Email address: [email protected] arXiv:2102.11096v2 [math.GR] 26 Jun 2021 Contents Chapter 1. Introduction 1 Chapter 2. Notation and preliminaries 5 Chapter 3. Subgroup structure of exceptional algebraic groups 17 Chapter 4. Techniques for proving the results 27 4.1. The strategy 27 4.2. An example 29 Chapter5. ModulesforgroupsofLietype 33 Chapter 6. Rank 4 groups for E8 39 6.1. PSL5 39 6.2. PSU5 41 6.3. Ω9 44 6.4. PSp8 44 + 6.5. Ω8 48 − 6.6. Ω8 50 3 6.7. D4 51 2 6.8. F4 and F4 52 Chapter 7. Rank 3 groups for E8 55 7.1. PSL4 55 7.2. PSU4 60 7.3. Ω7 64 7.4. PSp6 65 Chapter 8. Rank 2 groups for E8 71 8.1. PSL3 71 8.2. PSU3 81 8.3. PSp4 101 2 8.4. B2 117 2 8.5. G2 125 8.6. G2 126 Chapter 9. Subgroups of E7 135 Chapter 10. Subgroups of E6 159 Chapter 11. Subgroups of F4 171 iii iv CONTENTS Chapter 12. Difficult cases 175 12.1. PSL5(2) ≤ E8 175 12.2. PSL3(5) ≤ E8 190 12.3. PSU3(4) ≤ E8 197 Chapter 13. The trilinear form for E6 207 13.1. Using the symmetric form 207 13.2. The case PSU3(3) 211 2 ′ 13.3. The case G2(3) 211 13.4. The case PSL3(3) 212 Bibliography 213 Abstract We study embeddings of groups of Lie type H in characteristic p into excep- tional algebraic groups G of the same characteristic. We exclude the case where H is of type PSL2. A subgroup of G is Lie primitive if it is not contained in any proper, positive-dimensional subgroup of G. With a few possible exceptions, we prove that there are no Lie primitive sub- groups H in G, with the conditions on H and G given above. The exceptions are ′ for H one of PSL3(3), PSU3(3), PSL3(4), PSU3(4), PSU3(8), PSU4(2), PSp4(2) 2 and B2(8), and G of type E8. No examples are known of such Lie primitive embeddings. We prove a slightly stronger result, including stability under automorphisms of G. This has the consequence that, with the same exceptions, any almost simple group with socle H, that is maximal inside an almost simple exceptional group of 2 Lie type F4, E6, E6, E7 and E8, is the fixed points under the Frobenius map of a corresponding maximal closed subgroup inside the algebraic group. The proof uses a combination of representation-theoretic, algebraic group- theoretic, and computational means. Received by the editor 7th December, 2019. 2020 Mathematics Subject Classification. Primary 20D06, 20E28, 20G41. Key words and phrases. Maximal subgroups, exceptional groups, finite simple groups. The author is a Royal Society University Research Fellow, and gratefully acknowledges the financial support of the Society. v CHAPTER 1 Introduction This paper deals with four interconnected questions, progress on all of which can be achieved with the same analysis: (1) Classify the maximal subgroups of finite simple groups of Lie type; (2) Understand the subgroup structure of the simple algebraic groups; (3) Study the morphism extension problem: given a simple algebraic group G and an algebraic group H, and a Frobenius endomorphism σ of H, when does a homomorphism Hσ → G extend to a morphism H → G of algebraic groups; (4) Generalize Steinberg’s restriction theorem for GLn (that every simple module for a finite simple group of Lie type—in other words, an irre- ducible subgroup of GLn—is the restriction of one for the algebraic group) to arbitrary semisimple algebraic groups. Here we analyse the first problem for G a finite exceptional group of Lie type and a potential maximal subgroup that is the normalizer of a finite simple group of Lie type H in the same characteristic as G, but is not of type PSL2. We more or less give a complete answer for such maximal subgroups, leaving only eight possible maximal subgroups in E8 up to isomorphism. The determination of the maximal subgroups of the exceptional groups of Lie type is one of the major outstanding problems in our understanding of the structure of the finite simple groups. This task has occupied the endeavours of mathemati- cians over several decades; this paper is the third in a series by the author, whose eventual goal is the completion of this determination. By a result of Borovik [Bor89] and Liebeck–Seitz [LS90], all maximal sub- groups of almost simple exceptional groups of Lie type that are not themselves almost simple groups are known, so we apply the classification of finite simple groups. Alternating maximal subgroups were nearly classified in [Cra17], and 2 there has been more work since then (there are no examples in F4, E6 and E6, and there is one conjugacy class of maximal Alt(7) in E7(5), but Alt(6) in E7(q) and Alt(6), Alt(7) in E8 are unresolved), and cross-characteristic Lie type and sporadic groups that embed in exceptional groups were determined in [LS99], with some analysis of these in various papers in characteristic 0, and particularly [Lit18] in positive characteristic. (These will be treated in a later paper.) The remaining potential maximal subgroups, which form the bulk of the groups to be examined, are groups of Lie type in the same characteristic as the exceptional group. Broadly speaking, all embeddings of a group of Lie type H = H(q) into an exceptional algebraic group G of characteristic p | q are contained in proper, σ- stable, positive-dimensional subgroups of G if q > 9 (and q 6= 16 for H of type PSL3 and PSU3) or if the rank of H is more than half of the rank of G. If H is of 1 2 1. INTRODUCTION 2 2 type PSL2, B2 or G2 then much larger bounds than 9 are needed to guarantee the result, for example q> 2624 for G = E8. (This was proved in [LS98, Law14].) This paper does not deal with the case of PSL2 (which for G = F4, E6, E7, but not E8, was considered in [Cra]), but with all of the other groups H. Recall that a finite subgroup H of an algebraic group is called Lie primitive if it does not lie in a proper positive-dimensional subgroup. We prove the following result. In fact, we prove something slightly stronger that involves stability under automorphisms of G (which is needed for the application to maximal subgroups), but this will suffice for applications to the morphism extension problem. Theorem 1.1. Let G be the exceptional algebraic group E8 over an algebraically closed field of characteristic p > 0. Let H = H(q) be a simple group of Lie type with p | q, and suppose that H is a subgroup of G. Furthermore, suppose that H does not have the same type as G, and that H is not PSL2(q). If NG(H) is Lie primitive in G, then H is one of the groups PSL3(q) for q = 3, 4, PSU3(q) for ′ 2 q =3, 4, 8, PSp4(2) , B2(8), and PSU4(2). Moreover, if σ is a Frobenius endomorphism on G and H ≤ Gσ, then there is σ a σ-stable proper positive-dimensional subgroup X such that NGσ (H) ≤ X unless H is one of the above groups. (Note that there are no known examples of such groups.) We will define the slight strengthening of this result now. Let G be a sim- ple, simply connected algebraic group and σ a Frobenius endomorphism of G. A subgroup K of G = Gσ is strongly imprimitive if there is some σ-stable positive- σ dimensional subgroup X of G such that NG¯ (K) is contained in NG¯ (X ) for all almost simple groups G¯ with socle G/Z(G). The statement of the theorem above is also true with strong imprimitivity in place of Lie imprimitivity. The second statement of this theorem (with strong imprimitivity) yields an application to maximal subgroups of the finite groups E8(q), namely that the max- imal subgroups of the form NG¯ (H) for H a Lie type group in characteristic p | q are known except for H on the list above, and H =∼ PSL2(q0) for p | q0. The author believes that one might be able to use the techniques in this paper to solve the outstanding cases of PSU4(2) and PSU3(8), but that PSp4(2) and 2 B2(8) cannot be resolved using these methods. For the rest he is not sure. We also consider the other exceptional groups F4, E6 and E7, obtaining the same statement as above, but with a very short list of possibilities. (We do not need to consider G2 because, by work of Kleidman [Kle88] and Cooperstein [Coo81] all 2 maximal subgroups of the finite groups G2(q) and G2(q) are known, and hence it is easy to determine all Lie primitive subgroups. Indeed, we use G2 as an example in Section 4.2.) Using [Cra] we can also include PSL2 subgroups in the list. (In the case of F4 and p ≥ 5 this result was obtained by Magaard [Mag90], and for E6 and H =6∼ PSL2(11), PSL3(3), PSU3(3) this result was obtained by Aschbacher 2 [Asc]. The maximal subgroups of F4(q) were obtained by Malle [?].) Theorem 1.2.