Permutation Group Algorithms

Total Page:16

File Type:pdf, Size:1020Kb

Permutation Group Algorithms This page intentionally left blank Permutation group algorithms comprise one of the workhorses of symbolic algebra systems computing with groups and play an indispensable role in the proof of many deep results, including the construction and study of sporadic finite simple groups. This book describes the theory behind permutation group algorithms, up to the most recent developments based on the classification of finite simple groups. Rigorous complexity estimates, implementation hints, and advanced exercises are included throughout. The central theme is the description of nearly linear-time algorithms, which are extremely fast in terms of both asymptotic analysis and practical running time. A significant part of the permutation group library of the computational group algebra system GAP is based on nearly linear-time algorithms. The book fills a significant gap in the symbolic computation literature. It is recommended for everyone interested in using computers in group theory and is suitable for advanced graduate courses. Akos´ Seress is a Professor of Mathematics at The Ohio State University. CAMBRIDGE TRACTS IN MATHEMATICS General Editors B. BOLLOBAS,´ W. LTON, A. KATOK, F. KIRWAN, P. SARNAK 152 Permutation Group Algorithms Akos´ Seress The Ohio State University Permutation Group Algorithms Cambridge, New York, Melbourne, Madrid, Cape Town, Singapore, São Paulo Cambridge University Press The Edinburgh Building, Cambridge , United Kingdom Published in the United States by Cambridge University Press, New York wwcambridgorg Information on this title: wwcambrid gor g/9780521661034 © Ákos Seress 2002 This book is in copyrigh Subject to statutory exception and to the provision of relevant collective licensing agreements, no reproduction of any part may take place without the written permission of Cambridge University Pres First published in print format 2003 ISBN-13 978-0-511-06647-4 eBook (NetLibrary) ISBN-10 0-511-06647-3 eBook (NetLibrary) ISBN-13 978-0-521-66103-4 hardback ISBN-10 0-521-66103-X hardback Cambridge University Press has no responsibility for the persistence or accuracy of s for external or third-party internet websites referred to in this book, and does not guarantee that any content on such websites is, or will remain, accurate or appropriat Contents 1Introductionpage1 1.1AListofAlgorithms4 1.2NotationandTerminology6 1.2.1Groups7 1.2.2PermutationGroups9 1.2.3AlgorithmicConcepts10 1.2.4Graphs11 1.3ClassificationofRandomizedAlgorithms12 2Black-BoxGroups16 2.1ClosureAlgorithms18 2.1.1OrbitComputations18 2.1.2ClosureofAlgebraicStructures23 2.2RandomElementsofBlack-BoxGroups24 2.3RandomSubproducts30 2.3.1DefinitionandBasicProperties30 2.3.2ReducingtheNumberofGenerators33 2.3.3ClosureAlgorithmswithoutMembershipTesting37 2.3.4DerivedandLowerCentralSeries38 2.4RandomPrefixes40 2.4.1DefinitionandBasicProperties40 2.4.2Applications44 3PermutationGroups:AComplexityOverview48 3.1Polynomial-TimeAlgorithms48 3.2NearlyLinear-TimeAlgorithms51 3.3Non-Polynomial-TimeMethods52 v vi Contents 4BasesandStrongGeneratingSets55 4.1BasicDefinitions55 4.2TheSchreier–SimsAlgorithm57 4.3ThePowerofRandomization62 4.4ShallowSchreierTrees64 4.5StrongGeneratorsinNearlyLinearTime70 4.5.1Implementation75 5FurtherLow-LevelAlgorithms79 5.1ConsequencesoftheSchreier–SimsMethod79 5.1.1PointwiseStabilizers79 5.1.2Homomorphisms80 5.1.3 Transitive Constituent and Block Homomorphisms81 5.1.4ClosuresandNormalClosures83 5.2WorkingwithBaseImages84 5.3PermutationGroupsasBlack-BoxGroups93 5.4BaseChange97 5.5BlocksofImprimitivity100 5.5.1BlocksinNearlyLinearTime101 5.5.2TheSmallestBlockContainingaGivenSubset107 5.5.3StructureForests111 6ALibraryofNearlyLinear-TimeAlgorithms114 6.1ASpecialCaseofGroupIntersectionandApplications115 6.1.1IntersectionwithaNorm a lClosure115 6.1.2CentralizerintheSymmetricGroup117 6.1.3TheCenter120 6.1.4CentralizerofaNormalSubgroup120 6.1.5CoreofaSubnorm a lSubgroup124 6.2CompositionSeries125 6.2.1ReductiontothePrimitiveCase126 6.2.2TheO’Nan–ScottTheorem129 6.2.3NormalSubgroupswithNontrivialCentralizer133 6.2.4 Groups with a Unique Nonabelian Minimal NormalSubgroup139 6.2.5Implementation146 6.2.6AnElementaryVersion149 6.2.7ChiefSeries155 6.3QuotientswithSmallPermutationDegree156 6.3.1SolvableRadicalandp-Core157 Contents vii 7SolvablePermutationGroups162 7.1StrongGeneratorsinSolvableGroups162 7.2Power-ConjugatePresentations165 7.3WorkingwithElementaryAbelianLayers166 7.3.1SylowSubgroups167 7.3.2ConjugacyClassesinSolvableGroups172 7.4TwoAlgorithmsforNilpotentGroups175 7.4.1AFastNilpotencyTest176 7.4.2TheUpperCentralSeriesinNilpotentGroups179 8StrongGeneratingTests183 8.1TheSchreier–Todd–Coxeter–SimsProcedure184 8.1.1CosetEnumeration184 8.1.2Leon’sAlgorithm186 8.2Sims’sVerifyRoutine188 8.3TowardStrongGeneratorsbyaLasVegasAlgorithm191 8.4AShortPresentation197 9BacktrackMethods201 9.1TraditionalBacktrack202 9.1.1 Pruning the Search Tree: Problem-Independent Methods203 9.1.2 Pruning the Search Tree: Problemependent Methods205 9.2ThePartitionMethod207 9.3Normalizers211 9.4ConjugacyClasses214 10Large-BaseGroups218 10.1LabeledBranchings218 10.1.1Construction222 10.2AlternatingandSymmetricGroups225 10.2.1NumberTheoreticandProbabilisticEstimates228 10.2.2 Constructive Recognition: Finding the NewGenerators235 10.2.3ConstructiveRecognition:TheHomomorphismλ239 10.2.4ConstructiveRecognition:TheCaseofGiants244 10.3ARandomizedStrongGeneratorConstruction246 Bibliography254 Index262 1 Introduction Computational group theory (CGT) is a subfield of symbolic algebra; it deals with the design, analysis, and implementation of algorithms for manipulating groups. It is an interdisciplinary area between mathematics and computer sci- ence. The major areas of CGT are the algorithms for finitely presented groups, polycyclic and finite solvable groups, permutation groups, matrix groups, and representation theory. The topic of this book is the third of these areas. Permutation groups are the oldest type of representations of groups; in fact, the work of Galois on permutation groups, which is generally considered as the start of group theory as a separate branch of mathematics, preceded the abstract definition of groups by about a half a century. Algorithmic questions permeated permutation group theory from its inception. Galois group computations, and the related problem of determining all transitive permutation groups of a given degree, are still active areas of research (see [Hulpke, 1996]). Mathieu’s constructions of his simple groups also involved serious computations. Nowadays, permutation group algorithms are among the best developed parts of CGT, and we can handle groups of degree in the hundreds of thousands. The basic ideas for handling permutation groups appeared in [Sims, 1970, 1971a]; even today, Sims’s methods are at the heart of most of the algorithms. At first glance, the efficiency of permutation group algorithms may be surpris- ing. The input consists of a list of generators. On one hand, this representation is very efficient, since afew permutationsin Sn can describe an object of size up to n!. On the other hand, the succinctness of such a representation G =S ne- cessitates nontrivial algorithms to answer even such basic questions as finding the order of G or testing membership of agiven permutationin G. Initially, it is not even clear how to prove in polynomial time in the input length that a certain permutation g is in G, because writing g as a product of the given generators S for G may require an exponentially long word. Sims’s seminal 1 2 Introduction idea was to introduce the notions of base and strong generating set. This data structure enables us to decide membership in G constructively, by writing any given element of G as a short product of the strong generators. The technique for constructing a strong generating set can also be applied to other tasks such as computing normal closures of subgroups and handling homomorphisms of groups. Therefore, a significant part of this book is devoted to the description of variants and applications of Sims’s method. A second generation of algorithms uses divide-and-conquer techniques by utilizing the orbit structure and imprimitivity block structure of the input group, thereby reducing the problems to primitive groups. Although every abstract group has a faithful transitive permutation representation, the structure of prim- itive groups is quite restricted. This extra information, partly obtained as a consequence of the classification of finite simple groups, can be exploited in the design of algorithms. We shall also describe some of the latest algorithms, which use an even finer divide-and-conquer technique. A tower of normal subgroups is constructed such that the factor groups between two consecutive normal subgroups are the products of isomorphic simple groups. Abelian factors are handled by linear al- gebra, whereas the simple groups occurring in nonabelian factors are identified with standard copies of these groups, and the problems are solved in the stan- dard copies. This identification process works in the more general black-box group setting, when we do not use the fact that the input group is represented by permutations: The algorithms only exploit the facts that we can multiply and invert group elements and decide whether two group elements are equal. This generality enables us to use the same algorithms for matrix group inputs. Computations with matrix groups is currently the most active area of CGT. Dealing with permutation groups is the area of CGT where the complexity analysis of algorithms is the
Recommended publications
  • 4. Groups of Permutations 1
    4. Groups of permutations 1 4. Groups of permutations Consider a set of n distinguishable objects, fB1;B2;B3;:::;Bng. These may be arranged in n! different ways, called permutations of the set. Permu- tations can also be thought of as transformations of a given ordering of the set into other orderings. A convenient notation for specifying a given permutation operation is 1 2 3 : : : n ! , a1 a2 a3 : : : an where the numbers fa1; a2; a3; : : : ; ang are the numbers f1; 2; 3; : : : ; ng in some order. This operation can be interpreted in two different ways, as follows. Interpretation 1: The object in position 1 in the initial ordering is moved to position a1, the object in position 2 to position a2,. , the object in position n to position an. In this interpretation, the numbers in the two rows of the permutation symbol refer to the positions of objects in the ordered set. Interpretation 2: The object labeled 1 is replaced by the object labeled a1, the object labeled 2 by the object labeled a2,. , the object labeled n by the object labeled an. In this interpretation, the numbers in the two rows of the permutation symbol refer to the labels of the objects in the ABCD ! set. The labels need not be numerical { for instance, DCAB is a well-defined permutation which changes BDCA, for example, into CBAD. Either of these interpretations is acceptable, but one interpretation must be used consistently in any application. The particular application may dictate which is the appropriate interpretation to use. Note that, in either interpre- tation, the order of the columns in the permutation symbol is irrelevant { the columns may be written in any order without affecting the result, provided each column is kept intact.
    [Show full text]
  • An Exploration of the Relationship Between Mathematics and Music
    An Exploration of the Relationship between Mathematics and Music Shah, Saloni 2010 MIMS EPrint: 2010.103 Manchester Institute for Mathematical Sciences School of Mathematics The University of Manchester Reports available from: http://eprints.maths.manchester.ac.uk/ And by contacting: The MIMS Secretary School of Mathematics The University of Manchester Manchester, M13 9PL, UK ISSN 1749-9097 An Exploration of ! Relation"ip Between Ma#ematics and Music MATH30000, 3rd Year Project Saloni Shah, ID 7177223 University of Manchester May 2010 Project Supervisor: Professor Roger Plymen ! 1 TABLE OF CONTENTS Preface! 3 1.0 Music and Mathematics: An Introduction to their Relationship! 6 2.0 Historical Connections Between Mathematics and Music! 9 2.1 Music Theorists and Mathematicians: Are they one in the same?! 9 2.2 Why are mathematicians so fascinated by music theory?! 15 3.0 The Mathematics of Music! 19 3.1 Pythagoras and the Theory of Music Intervals! 19 3.2 The Move Away From Pythagorean Scales! 29 3.3 Rameau Adds to the Discovery of Pythagoras! 32 3.4 Music and Fibonacci! 36 3.5 Circle of Fifths! 42 4.0 Messiaen: The Mathematics of his Musical Language! 45 4.1 Modes of Limited Transposition! 51 4.2 Non-retrogradable Rhythms! 58 5.0 Religious Symbolism and Mathematics in Music! 64 5.1 Numbers are God"s Tools! 65 5.2 Religious Symbolism and Numbers in Bach"s Music! 67 5.3 Messiaen"s Use of Mathematical Ideas to Convey Religious Ones! 73 6.0 Musical Mathematics: The Artistic Aspect of Mathematics! 76 6.1 Mathematics as Art! 78 6.2 Mathematical Periods! 81 6.3 Mathematics Periods vs.
    [Show full text]
  • Constructive Recognition of a Black Box Group Isomorphic to GL(N,2)
    DIMACS Series in Discrete Mathematics and Theoretical Computer Science Volume 00, 19xx Constructive Recognition of a Black Box Group Isomorphic to GL(n, 2) Gene Cooperman, Larry Finkelstein, and Steve Linton Abstract. A Monte Carlo algorithm is presented for constructing the natu- ral representation of a group G that is known to be isomorphic to GL(n, 2). The complexity parameters are the natural dimension n and the storage space required to represent an element of G. What is surprising about this result is that both the data structure used to compute the isomorphism and each invo- cation of the isomorphism require polynomial time complexity. The ultimate goal is to eventually extend this result to the larger question of construct- ing the natural representation of classical groups. Extensions of the methods developed in this paper are discussed as well as open questions. 1. Introduction The principal objective of this paper is a demonstration of the feasibility of obtaining the natural (projective) matrix representation for a classical group ini- tially presented as a black box group. In this model, group elements are encoded by binary strings of uniform length N, and group operations are performed by an oracle (the black box). The oracle can compute the product of elements, the inverse and recognize the identity element in time polynomial in N. The most important examples of black box groups are matrix groups and permutation groups. This effort was initially motivated by recent efforts to identify the structure of matrix groups defined over finite fields (see [3] [7] and [9] in this volume).
    [Show full text]
  • 18.703 Modern Algebra, Permutation Groups
    5. Permutation groups Definition 5.1. Let S be a set. A permutation of S is simply a bijection f : S −! S. Lemma 5.2. Let S be a set. (1) Let f and g be two permutations of S. Then the composition of f and g is a permutation of S. (2) Let f be a permutation of S. Then the inverse of f is a permu­ tation of S. Proof. Well-known. D Lemma 5.3. Let S be a set. The set of all permutations, under the operation of composition of permutations, forms a group A(S). Proof. (5.2) implies that the set of permutations is closed under com­ position of functions. We check the three axioms for a group. We already proved that composition of functions is associative. Let i: S −! S be the identity function from S to S. Let f be a permutation of S. Clearly f ◦ i = i ◦ f = f. Thus i acts as an identity. Let f be a permutation of S. Then the inverse g of f is a permutation of S by (5.2) and f ◦ g = g ◦ f = i, by definition. Thus inverses exist and G is a group. D Lemma 5.4. Let S be a finite set with n elements. Then A(S) has n! elements. Proof. Well-known. D Definition 5.5. The group Sn is the set of permutations of the first n natural numbers. We want a convenient way to represent an element of Sn. The first way, is to write an element σ of Sn as a matrix.
    [Show full text]
  • PERMUTATION GROUPS (16W5087)
    PERMUTATION GROUPS (16w5087) Cheryl E. Praeger (University of Western Australia), Katrin Tent (University of Munster),¨ Donna Testerman (Ecole Polytechnique Fed´ erale´ de Lausanne), George Willis (University of Newcastle) November 13 - November 18, 2016 1 Overview of the Field Permutation groups are a mathematical approach to analysing structures by studying the rearrangements of the elements of the structure that preserve it. Finite permutation groups are primarily understood through combinatorial methods, while concepts from logic and topology come to the fore when studying infinite per- mutation groups. These two branches of permutation group theory are not completely independent however because techniques from algebra and geometry may be applied to both, and ideas transfer from one branch to the other. Our workshop brought together researchers on both finite and infinite permutation groups; the participants shared techniques and expertise and explored new avenues of study. The permutation groups act on discrete structures such as graphs or incidence geometries comprising points and lines, and many of the same intuitions apply whether the structure is finite or infinite. Matrix groups are also an important source of both finite and infinite permutation groups, and the constructions used to produce the geometries on which they act in each case are similar. Counting arguments are important when studying finite permutation groups but cannot be used to the same effect with infinite permutation groups. Progress comes instead by using techniques from model theory and descriptive set theory. Another approach to infinite permutation groups is through topology and approx- imation. In this approach, the infinite permutation group is locally the limit of finite permutation groups and results from the finite theory may be brought to bear.
    [Show full text]
  • Binding Groups, Permutation Groups and Modules of Finite Morley Rank Alexandre Borovik, Adrien Deloro
    Binding groups, permutation groups and modules of finite Morley rank Alexandre Borovik, Adrien Deloro To cite this version: Alexandre Borovik, Adrien Deloro. Binding groups, permutation groups and modules of finite Morley rank. 2019. hal-02281140 HAL Id: hal-02281140 https://hal.archives-ouvertes.fr/hal-02281140 Preprint submitted on 9 Sep 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. BINDING GROUPS, PERMUTATION GROUPS AND MODULES OF FINITE MORLEY RANK ALEXANDRE BOROVIK AND ADRIEN DELORO If one has (or if many people have) spent decades classifying certain objects, one is apt to forget just why one started the project in the first place. Predictions of the death of group theory in 1980 were the pronouncements of just such amne- siacs. [68, p. 4] Contents 1. Introduction and background 2 1.1. The classification programme 2 1.2. Concrete groups of finite Morley rank 3 2. Binding groups and bases 4 2.1. Binding groups 4 2.2. Bases and parametrisation 5 2.3. Sharp bounds for bases 6 3. Permutation groups of finite Morley rank 7 3.1. Highly generically multiply transitive groups 7 3.2.
    [Show full text]
  • Permutation Group and Determinants (Dated: September 16, 2021)
    Permutation group and determinants (Dated: September 16, 2021) 1 I. SYMMETRIES OF MANY-PARTICLE FUNCTIONS Since electrons are fermions, the electronic wave functions have to be antisymmetric. This chapter will show how to achieve this goal. The notion of antisymmetry is related to permutations of electrons’ coordinates. Therefore we will start with the discussion of the permutation group and then introduce the permutation-group-based definition of determinant, the zeroth-order approximation to the wave function in theory of many fermions. This definition, in contrast to that based on the Laplace expansion, relates clearly to properties of fermionic wave functions. The determinant gives an N-particle wave function built from a set of N one-particle waves functions and is called Slater’s determinant. II. PERMUTATION (SYMMETRIC) GROUP Definition of permutation group: The permutation group, known also under the name of symmetric group, is the group of all operations on a set of N distinct objects that order the objects in all possible ways. The group is denoted as SN (we will show that this is a group below). We will call these operations permutations and denote them by symbols σi. For a set consisting of numbers 1, 2, :::, N, the permutation σi orders these numbers in such a way that k is at jth position. Often a better way of looking at permutations is to say that permutations are all mappings of the set 1, 2, :::, N onto itself: σi(k) = j, where j has to go over all elements. Number of permutations: The number of permutations is N! Indeed, we can first place each object at positions 1, so there are N possible placements.
    [Show full text]
  • 6 Permutation Groups
    Arkansas Tech University MATH 4033: Elementary Modern Algebra Dr. Marcel B. Finan 6 Permutation Groups Let S be a nonempty set and M(S) be the collection of all mappings from S into S. In this section, we will emphasize on the collection of all invertible mappings from S into S. The elements of this set will be called permutations because of Theorem 2.4 and the next definition. Definition 6.1 Let S be a nonempty set. A one-to-one mapping from S onto S is called a permutation. Consider the collection of all permutations on S. Then this set is a group with respect to composition. Theorem 6.1 The set of all permutations of a nonempty set S is a group with respect to composition. This group is called the symmetric group on S and will be denoted by Sym(S). Proof. By Theorem 2.4, the set of all permutations on S is just the set I(S) of all invertible mappings from S to S. According to Theorem 4.3, this set is a group with respect to composition. Definition 6.2 A group of permutations , with composition as the operation, is called a permutation group on S. Example 6.1 1. Sym(S) is a permutation group. 2. The collection L of all invertible linear functions from R to R is a permu- tation group with respect to composition.(See Example 4.4.) Note that L is 1 a proper subset of Sym(R) since we can find a function in Sym(R) which is not in L, namely, the function f(x) = x3.
    [Show full text]
  • The Mathematics Major's Handbook
    The Mathematics Major’s Handbook (updated Spring 2016) Mathematics Faculty and Their Areas of Expertise Jennifer Bowen Abstract Algebra, Nonassociative Rings and Algebras, Jordan Algebras James Hartman Linear Algebra, Magic Matrices, Involutions, (on leave) Statistics, Operator Theory Robert Kelvey Combinatorial and Geometric Group Theory Matthew Moynihan Abstract Algebra, Combinatorics, Permutation Enumeration R. Drew Pasteur Differential Equations, Mathematics in Biology/Medicine, Sports Data Analysis Pamela Pierce Real Analysis, Functions of Generalized Bounded Variation, Convergence of Fourier Series, Undergraduate Mathematics Education, Preparation of Pre-service Teachers John Ramsay Topology, Algebraic Topology, Operations Research OndˇrejZindulka Real Analysis, Fractal geometry, Geometric Measure Theory, Set Theory 1 2 Contents 1 Mission Statement and Learning Goals 5 1.1 Mathematics Department Mission Statement . 5 1.2 Learning Goals for the Mathematics Major . 5 2 Curriculum 8 3 Requirements for the Major 9 3.1 Recommended Timeline for the Mathematics Major . 10 3.2 Requirements for the Double Major . 10 3.3 Requirements for Teaching Licensure in Mathematics . 11 3.4 Requirements for the Minor . 11 4 Off-Campus Study in Mathematics 12 5 Senior Independent Study 13 5.1 Mathematics I.S. Student/Advisor Guidelines . 13 5.2 Project Topics . 13 5.3 Project Submissions . 14 5.3.1 Project Proposal . 14 5.3.2 Project Research . 14 5.3.3 Annotated Bibliography . 14 5.3.4 Thesis Outline . 15 5.3.5 Completed Chapters . 15 5.3.6 Digitial I.S. Document . 15 5.3.7 Poster . 15 5.3.8 Document Submission and oral presentation schedule . 15 6 Independent Study Assessment Guide 21 7 Further Learning Opportunities 23 7.1 At Wooster .
    [Show full text]
  • CS E6204 Lecture 5 Automorphisms
    CS E6204 Lecture 5 Automorphisms Abstract An automorphism of a graph is a permutation of its vertex set that preserves incidences of vertices and edges. Under composition, the set of automorphisms of a graph forms what algbraists call a group. In this section, graphs are assumed to be simple. 1. The Automorphism Group 2. Graphs with Given Group 3. Groups of Graph Products 4. Transitivity 5. s-Regularity and s-Transitivity 6. Graphical Regular Representations 7. Primitivity 8. More Automorphisms of Infinite Graphs * This lecture is based on chapter [?] contributed by Mark E. Watkins of Syracuse University to the Handbook of Graph The- ory. 1 1 The Automorphism Group Given a graph X, a permutation α of V (X) is an automor- phism of X if for all u; v 2 V (X) fu; vg 2 E(X) , fα(u); α(v)g 2 E(X) The set of all automorphisms of a graph X, under the operation of composition of functions, forms a subgroup of the symmetric group on V (X) called the automorphism group of X, and it is denoted Aut(X). Figure 1: Example 2.2.3 from GTAIA. Notation The identity of any permutation group is denoted by ι. (JG) Thus, Watkins would write ι instead of λ0 in Figure 1. 2 Rigidity and Orbits A graph is asymmetric if the identity ι is its only automor- phism. Synonym: rigid. Figure 2: The smallest rigid graph. (JG) The orbit of a vertex v in a graph G is the set of all vertices α(v) such that α is an automorphism of G.
    [Show full text]
  • Universal Invariant and Equivariant Graph Neural Networks
    Universal Invariant and Equivariant Graph Neural Networks Nicolas Keriven Gabriel Peyré École Normale Supérieure CNRS and École Normale Supérieure Paris, France Paris, France [email protected] [email protected] Abstract Graph Neural Networks (GNN) come in many flavors, but should always be either invariant (permutation of the nodes of the input graph does not affect the output) or equivariant (permutation of the input permutes the output). In this paper, we consider a specific class of invariant and equivariant networks, for which we prove new universality theorems. More precisely, we consider networks with a single hidden layer, obtained by summing channels formed by applying an equivariant linear operator, a pointwise non-linearity, and either an invariant or equivariant linear output layer. Recently, Maron et al. (2019b) showed that by allowing higher- order tensorization inside the network, universal invariant GNNs can be obtained. As a first contribution, we propose an alternative proof of this result, which relies on the Stone-Weierstrass theorem for algebra of real-valued functions. Our main contribution is then an extension of this result to the equivariant case, which appears in many practical applications but has been less studied from a theoretical point of view. The proof relies on a new generalized Stone-Weierstrass theorem for algebra of equivariant functions, which is of independent interest. Additionally, unlike many previous works that consider a fixed number of nodes, our results show that a GNN defined by a single set of parameters can approximate uniformly well a function defined on graphs of varying size. 1 Introduction Designing Neural Networks (NN) to exhibit some invariance or equivariance to group operations is a central problem in machine learning (Shawe-Taylor, 1993).
    [Show full text]
  • Lecture 9: Permutation Groups
    Lecture 9: Permutation Groups Prof. Dr. Ali Bülent EKIN· Doç. Dr. Elif TAN Ankara University Ali Bülent Ekin, Elif Tan (Ankara University) Permutation Groups 1 / 14 Permutation Groups Definition A permutation of a nonempty set A is a function s : A A that is one-to-one and onto. In other words, a pemutation of a set! is a rearrangement of the elements of the set. Theorem Let A be a nonempty set and let SA be the collection of all permutations of A. Then (SA, ) is a group, where is the function composition operation. The identity element of (SA, ) is the identity permutation i : A A, i (a) = a. ! 1 The inverse element of s is the permutation s such that 1 1 ss (a) = s s (a) = i (a) . Ali Bülent Ekin, Elif Tan (Ankara University) Permutation Groups 2 / 14 Permutation Groups Definition The group (SA, ) is called a permutation group on A. We will focus on permutation groups on finite sets. Definition Let In = 1, 2, ... , n , n 1 and let Sn be the set of all permutations on f g ≥ In.The group (Sn, ) is called the symmetric group on In. Let s be a permutation on In. It is convenient to use the following two-row notation: 1 2 n s = ··· s (1) s (2) s (n) ··· Ali Bülent Ekin, Elif Tan (Ankara University) Permutation Groups 3 / 14 Symmetric Groups 1 2 3 4 1 2 3 4 Example: Let f = and g = . Then 1 3 4 2 4 3 2 1 1 2 3 4 1 2 3 4 1 2 3 4 f g = = 1 3 4 2 4 3 2 1 2 4 3 1 1 2 3 4 1 2 3 4 1 2 3 4 g f = = 4 3 2 1 1 3 4 2 4 2 1 3 which shows that f g = g f .
    [Show full text]