DOCSLIB.ORG

Arxiv Preprint Arxiv:1905.11460, 2019

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Arxiv Preprint Arxiv:1905.11460, 2019 Universal Equivariant Multilayer Perceptrons Siamak Ravanbakhsh 1 2 Abstract necessity of parameter-sharing for invariance was used to prove the limitation of a single layer Perceptron. The follow- Group invariant and equivariant Multilayer Per- up work showed how parameter symmetries can be used ceptrons (MLP), also known as Equivariant Net- to achieve invariance to finite and infinite groups (Shawe- works and Group Group Convolutional Neural Taylor, 1989; Wood & Shawe-Taylor, 1996; Shawe-Taylor, Networks (G-CNN) have achieved remarkable 1993; Wood, 1996). These fundamental early works went success in learning on a variety of data structures, unnoticed during the resurgence of neural network research such as sequences, images, sets, and graphs. This and renewed attention to symmetry (Hinton et al., 2011; paper proves the universality of a broad class of Mallat, 2012; Bruna & Mallat, 2013; Gens & Domingos, equivariant MLPs with a single hidden layer. In 2014; Jaderberg et al., 2015; Dieleman et al., 2016; Cohen particular, it is shown that having a hidden layer & Welling, 2016a). on which the group acts regularly is sufficient for universal equivariance (invariance). For example, When equivariance constraints are imposed on feed-forward some types of steerable-CNNs become universal. layers in an MLP, the linear maps in each layer is constrained Another corollary is the unconditional universal- to use tied parameters (Wood & Shawe-Taylor, 1996; Ravan- ity of equivariant MLPs for all Abelian groups. bakhsh et al., 2017b). This model that we call an equivariant A third corollary is the universality of equivari- MLP appears in deep learning with sets (Zaheer et al., 2017; ant MLPs with a high-order hidden layer, where Qi et al., 2017), exchangeable tensors (Hartford et al., 2018), we give both group-agnostic bounds and group- graphs (Maron et al., 2018), relational data (Graham & Ra- specific bounds on the order of the hidden layer vanbakhsh, 2019), and sets of symmetric elements (Maron that guarantees universal equivariance. et al., 2020). Universality results for some of these models exists (Zaheer et al., 2017; Segol & Lipman, 2019; Keriven & Peyre´, 2019; Maron et al., 2020). Broader results for high 1. Introduction order invariant MLPs appears in (Maron et al., 2019). Uni- versality results for “non-standard” architectures appears Invariance and equivariance properties constrain the out- in (Yarotsky, 2018; Sannai et al., 2019). In addition to put of a function under various transformations of its input. proving universality of networks using polynomial layer, This constraint serves as a strong learning bias that has Yarotsky(2018) also prove universality for standard MLPs proven useful in sample efficient learning for a wide range equivariant to Abelian groups. A similar results follows as of structured data. In this work, we are interested in uni- a corollary to our main theorem. versality results for Multilayer Perceptrons (MLPs) that are constrained to be equivariant or invariant. This type of result A parallel line of work in equivariant deep learning studies guarantees that the model can approximate any continuous linear action of a group beyond permutations. The resulting equivariant (invariant) function with an arbitrary precision, equivariant linear layers can be written using convolution in the same way an unconstrained MLP can approximate an operations (Cohen & Welling, 2016b; Kondor & Trivedi, arbitrary continuous function (Hornik et al., 1989; Cybenko, 2018). When limited to permutation groups, group convolu- 1989; Funahashi, 1989). tion is simply another expression of parameter-sharing (Ra- vanbakhsh et al., 2017b); see also Section 2.3. However, Study of invariance in neural networks goes back to the in working with linear representations, one may move be- book of Perceptrons (Minsky & Papert, 2017), where the yond finite groups (Cohen et al., 2019a; Kondor & Trivedi, 2018); see also (Wood & Shawe-Taylor, 1996). Some appli- 1School of Computer Science, McGill University, Montreal Canada. 2Mila - Quebec AI Institute.. Correspondence to: Siamak cations include equivariance to isometries of the Euclidean Ravanbakhsh <[email protected]>. space (Weiler & Cesa, 2019; Worrall et al., 2017), and sphere (Cohen et al., 2018). Extension of this view to mani- th Proceedings of the 37 International Conference on Machine folds is proposed in (Cohen et al., 2019b). Finally, a third Learning, Online, PMLR 119, 2020. Copyright 2020 by the au- line of work in equivariant deep learning that involves a thor(s). Universal Equivariant Multilayer Perceptrons specialized architecture and learning procedure is that of Capsule networks (Sabour et al., 2017; Hinton et al., 2018); see (Lenssen et al., 2018) for a group theoretic generaliza- tion. 2. Preliminaries Let G = fgg be a finite group. We define the action of this group on two finite sets N and M of input and output units in a feedforward layer. Using these actions which define permutation groups we then define equivariance and invariance. In detail, G-action on the set N is a structure Figure 1. The equivariant MLP of (16). The symbol y indicates G-action on the units, W and W0 for all channels of the hidden preserving map (homomorphism) a : G ! SN, into the c c layer c = 1;:::;C are constrained by the parameter-sharing of (3). symmetric group SN, the group of all permutations of N. The image of this map is a permutation group G ≤ S . If G-action on the hidden layer is regular, the number of channels N N can grow to approximate any continuous G-equivariant function Instead of writing [a(g)](n) for g 2 G and n 2 N, we use with an arbitrary accuracy. Bias terms are not shown. the short notation g · n = g−1n to denote this action. Let M be another G-set, where the corresponding permutation action GM ≤ SM is defined by b : G ! SM. G-action on HnG = fHg; g 2 Gg, form a partition of G. G naturally RN : : N naturally extends to x 2 by g · xn = xg·n 8g 2 GN: acts on the right coset space, where g0 · (Hg) = H(gg0) More conveniently, we also write this action as Agx, where sends one coset to another. The significance of this action is Ag is the permutation matrix form of a(g; ·): N ! N. that “any” transitive G-action is isomorphic to G-action on some right coset space. To see why, note that in this action 2.1. Invariant and Equivariant Linear Maps any h 2 H stabilizes the coset He, because h · He = He.1 Let the real matrix W 2 RjN|×|Mj denote a linear map Therefore in any action the stabilizer identifies the coset W : RjNj ! RjMj. We say this map is G-equivariant iff space. N BgWx = WAgx 8x 2 R ; g 2 G: (1) 2.3. Parameter-Sharing and Group-CNNs View where similar to Ag, the permutation matrix Bg is defined Consider the equivariance condition of (1). Since the equal- N based on the action b(·; g): M ! M. In this definition, we ity holds for all x 2 R , and using the fact that the inverse assume that the group action on the input is faithful – that of a permutation matrix is its transpose, the equivariance ∼ is a is injective, or GN = G. If the action on the output constraint reduces to index set M is not faithful, then the kernel of this action > is a non-trivial normal subgroup of G, ker(b) / G. In this BgWAg = W 8g 2 G: (2) ∼ case GM = G= ker(b) is a quotient group, and it is more accurate to say that W is invariant to ker(b) and equivariant The equation above ties the parameters within the orbits of to G= ker(b). Using this convention G-equivariance and G-action on rows and columns of W: G-invariance correspond to extreme cases of ker(b) = G and ker(b) = feg. Moreover, composition of such invariant- W(m; n) = W(g · m; g · n)8g 2 G; n; m 2 N × M (3) equivariant functions preserves this property, motivating design of deep networks by stacking equivariant layers. where W(g · m; g · n) is an element of the matrix W. This type of group action on Cartesian product space is some- 2.2. Orbits and Homogeneous Spaces times called the diagonal action. In this case, the action is on the Cartesian product of rows and columns of W. GN partitions N into orbits N1;:::; NO, where GN is transi- tive on each orbit, meaning that for each pair n1; n2 2 No, We saw that any homogenous G-space is isomorphic to ∼ ∼ there is at least one g 2 GN such that g · n1 = n2. If GN a coset space. Using N = HnG and M = KnG, the has a single orbit, it is transitive, and N is called a homoge- 1More generally, when G acts on the coset Ha 2 HnG, all neous space for G. If moreover the choice of g 2 GN with g 2 a−1Ha stabilize Ha. Since g = a−1ha for some h 2 H, g · n1 = n2 is unique, then GN is called regular. we have (a−1ha) · Ha = H(aa−1ha) = Ha. This means that any transitive G-action on a set N may be identified with the Given a subgroup H ≤ G and g 2 G, the right coset : : stabilizer subgroup Gn = fg 2 G s:t: g · n = ng, for a choice of of H in G, defined as Hg = fhg; h 2 Hg is a subset n 2 N. This gives a bijection between N and the right coset space of G. For a fixed H ≤ G, the set of these right-cosets, GnnG. Universal Equivariant Multilayer Perceptrons parameter-sharing constraint of (2) becomes In practice, it is common to construct invariant networks by first constructing an equivariant network followed by 0 −1 −1 0 W(Kg; Hg ) = W(g · Kg; g · Hg ) (4) pooling over H(L).
Load more

Recommended publications
  • Symmetry Preserving Interpolation Erick Rodriguez Bazan, Evelyne Hubert
    Symmetry Preserving Interpolation Erick Rodriguez Bazan, Evelyne Hubert To cite this version: Erick Rodriguez Bazan, Evelyne Hubert. Symmetry Preserving Interpolation. ISSAC 2019 - International Symposium on Symbolic and Algebraic Computation, Jul 2019, Beijing, China. 10.1145/3326229.3326247. hal-01994016 HAL Id: hal-01994016 https://hal.archives-ouvertes.fr/hal-01994016 Submitted on 25 Jan 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Symmetry Preserving Interpolation Erick Rodriguez Bazan Evelyne Hubert Université Côte d’Azur, France Université Côte d’Azur, France Inria Méditerranée, France Inria Méditerranée, France [email protected] [email protected] ABSTRACT general concept. An interpolation space for a set of linear forms is The article addresses multivariate interpolation in the presence of a subspace of the polynomial ring that has a unique interpolant for symmetry. Interpolation is a prime tool in algebraic computation each instantiated interpolation problem. We show that the unique while symmetry is a qualitative feature that can be more relevant interpolants automatically inherit the symmetry of the problem to a mathematical model than the numerical accuracy of the pa- when the interpolation space is invariant (Section 3).
    [Show full text]
  • Equivariant and Isovariant Function Spaces
    UC Riverside UC Riverside Electronic Theses and Dissertations Title Equivariant and Isovariant Function Spaces Permalink https://escholarship.org/uc/item/7fk0p69b Author Safii, Soheil Publication Date 2015 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California UNIVERSITY OF CALIFORNIA RIVERSIDE Equivariant and Isovariant Function Spaces A Dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Mathematics by Soheil Safii March 2015 Dissertation Committee: Professor Reinhard Schultz, Chairperson Professor Julia Bergner Professor Fred Wilhelm Copyright by Soheil Safii 2015 The Dissertation of Soheil Safii is approved: Committee Chairperson University of California, Riverside Acknowledgments I would like to thank Professor Reinhard Schultz for all of the time and effort he put into being a wonderful advisor. Without his expansive knowledge and unending patience, none of our work would be possible. Having the opportunity to work with him has been a privilege. I would like to acknowledge Professor Julia Bergner and Professor Fred Wilhelm for their insight and valuable feedback. I am grateful for the unconditional support of my classmates: Mathew Lunde, Jason Park, and Jacob West. I would also like to thank my students, who inspired me and taught me more than I could have ever hoped to teach them. Most of all, I am appreciative of my friends and family, with whom I have been blessed. iv To my parents. v ABSTRACT OF THE DISSERTATION Equivariant and Isovariant Function Spaces by Soheil Safii Doctor of Philosophy, Graduate Program in Mathematics University of California, Riverside, March 2015 Professor Reinhard Schultz, Chairperson The Browder{Straus Theorem, obtained independently by S.
    [Show full text]
  • Definition 1.1. a Group Is a Quadruple (G, E, ⋆, Ι)
    GROUPS AND GROUP ACTIONS. 1. GROUPS We begin by giving a definition of a group: Definition 1.1. A group is a quadruple (G, e, ?, ι) consisting of a set G, an element e G, a binary operation ?: G G G and a map ι: G G such that ∈ × → → (1) The operation ? is associative: (g ? h) ? k = g ? (h ? k), (2) e ? g = g ? e = g, for all g G. ∈ (3) For every g G we have g ? ι(g) = ι(g) ? g = e. ∈ It is standard to suppress the operation ? and write gh or at most g.h for g ? h. The element e is known as the identity element. For clarity, we may also write eG instead of e to emphasize which group we are considering, but may also write 1 for e where this is more conventional (for the group such as C∗ for example). Finally, 1 ι(g) is usually written as g− . Remark 1.2. Let us note a couple of things about the above definition. Firstly clo- sure is not an axiom for a group whatever anyone has ever told you1. (The reason people get confused about this is related to the notion of subgroups – see Example 1.8 later in this section.) The axioms used here are not “minimal”: the exercises give a different set of axioms which assume only the existence of a map ι without specifying it. We leave it to those who like that kind of thing to check that associa- tivity of triple multiplications implies that for any k N, bracketing a k-tuple of ∈ group elements (g1, g2, .
    [Show full text]
  • AN INTERTWINING RELATION for EQUIVARIANT SEIDEL MAPS 3 Cohomology of the Classifying Space of S1
    AN INTERTWINING RELATION FOR EQUIVARIANT SEIDEL MAPS TODD LIEBENSCHUTZ-JONES Abstract. The Seidel maps are two maps associated to a Hamiltonian circle ac- tion on a convex symplectic manifold, one on Floer cohomology and one on quantum cohomology. We extend their definitions to S1-equivariant Floer cohomology and S1-equivariant quantum cohomology based on a construction of Maulik and Ok- ounkov. The S1-action used to construct S1-equivariant Floer cohomology changes after applying the equivariant Seidel map (a similar phenomenon occurs for S1- equivariant quantum cohomology). We show the equivariant Seidel map on S1- equivariant quantum cohomology does not commute with the S1-equivariant quan- tum product, unlike the standard Seidel map. We prove an intertwining relation which completely describes the failure of this commutativity as a weighted version of the equivariant Seidel map. We will explore how this intertwining relationship may be interpreted using connections in an upcoming paper. We compute the equivariant Seidel map for rotation actions on the complex plane and on complex projective space, and for the action which rotates the fibres of the tautological line bundle over projective space. Through these examples, we demonstrate how equi- variant Seidel maps may be used to compute the S1-equivariant quantum product and S1-equivariant symplectic cohomology. 1. Introduction For us, equivariant will always mean S1-equivariant. The Seidel maps on the quantum and Floer cohomology of a closed symplectic manifold M are two maps associated to a Hamiltonian S1-action σ on M [Sei97]. They are compatible with each other via the PSS isomorphisms, which are maps that identify quantum cohomology and Floer cohomology [Sei97, Theorem 8.2].
    [Show full text]
  • Equivariant Diagrams of Spaces
    Algebraic & Geometric Topology 16 (2016) 1157–1202 msp Equivariant diagrams of spaces EMANUELE DOTTO We generalize two classical homotopy theory results, the Blakers–Massey theorem and Quillen’s Theorem B, to G –equivariant cubical diagrams of spaces, for a discrete group G . We show that the equivariant Freudenthal suspension theorem for per- mutation representations is a direct consequence of the equivariant Blakers–Massey theorem. We also apply this theorem to generalize to G –manifolds a result about cubes of configuration spaces from embedding calculus. Our proof of the equivariant Theorem B involves a generalization of the classical Theorem B to higher-dimensional cubes, as well as a categorical model for finite homotopy limits of classifying spaces of categories. 55P91; 55Q91 Introduction Equivariant diagrams of spaces and their homotopy colimits have broad applications throughout topology. They are used in[12] for decomposing classifying spaces of finite groups, to study posets of p–groups in[19], for splitting Thom spectra in[18], and even in the definition of the cyclic structure on THH of[3]. In previous joint work with K Moi[7], the authors develop an extensive theory of equivariant diagrams in a general model category, and they study the fundamental properties of their homotopy limits and colimits. In the present paper we restrict our attention to G –diagrams in the category of spaces. The special feature of G –diagrams of spaces is the existence of generalized fixed-point functors that preserve and reflect equivalences. We study these functors and we use them to generalize the Blakers–Massey theorem and Quillen’s Theorem B to equivariant cubical diagrams.
    [Show full text]
  • Arxiv:Math/0411502V1 [Math.AT] 22 Nov 2004 Oii.Sm Fte Eentdi 3,Hwvraml Diinlhypoth Additional Mild a Result
    THE ACTION BY NATURAL TRANSFORMATIONS OF A GROUP ON A DIAGRAM OF SPACES RAFAEL VILLARROEL-FLORES Abstract. For C a G-category, we give a condition on a diagram of simplicial sets indexed on C that allows us to define a natural G-action on its homotopy colimit, and in some other simplicial sets and categories defined in terms of the diagram. Well-known theorems on homeomorphisms and homotopy equiv- alences are generalized to an equivariant version. 1. Introduction Let G be a group, and C be any small category. Consider a C-diagram of simplicial sets, where the values of the diagram have a G-action. Then several structures defined in terms of the diagram, like the colimit and the homotopy colimit, have an induced structure of G-object. However, it is often the case that one has a diagram F : C → D where C is a small G-category, D is an arbitrary category and the values of F do not necessarily have a G-action, however the homotopy colimit of F does have it. This situation was considered in [3], and independently, by this author in his Ph. D. thesis [9], where the concept of an action of a group G on a functor F by natural transformations is introduced. Here we define it formally in section 3, after the basic definitions in section 2. We show that there are induced G-actions on colimits, coends, and bar and Grothendieck constructions of functors on which G acts by natural transformations. In section 4 we consider the homotopy colimit, and show some basic identities involving the constructions defined so far.
    [Show full text]
  • Irreducible Finite-Dimensional Representations of Equivariant Map Algebras
    TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 364, Number 5, May 2012, Pages 2619–2646 S 0002-9947(2011)05420-6 Article electronically published on December 29, 2011 IRREDUCIBLE FINITE-DIMENSIONAL REPRESENTATIONS OF EQUIVARIANT MAP ALGEBRAS ERHARD NEHER, ALISTAIR SAVAGE, AND PRASAD SENESI Abstract. Suppose a finite group acts on a scheme X and a finite-dimensional Lie algebra g. The corresponding equivariant map algebra is the Lie algebra M of equivariant regular maps from X to g. We classify the irreducible finite- dimensional representations of these algebras. In particular, we show that all such representations are tensor products of evaluation representations and one-dimensional representations, and we establish conditions ensuring that they are all evaluation representations. For example, this is always the case if M is perfect. Our results can be applied to multiloop algebras, current algebras, the Onsager algebra, and the tetrahedron algebra. Doing so, we easily recover the known classifications of irreducible finite-dimensional representations of these algebras. Moreover, we obtain previously unknown classifications of irreducible finite-dimensional representations of other types of equivariant map algebras, such as the generalized Onsager algebra. Introduction When studying the category of representations of a (possibly infinite-dimensional) Lie algebra, the irreducible finite-dimensional representations often play an impor- tant role. Let X be a scheme and let g be a finite-dimensional Lie algebra, both defined over an algebraically closed field k of characteristic zero and both equipped with the action of a finite group Γ by automorphisms. The equivariant map algebra M = M(X, g)Γ is the Lie algebra of regular maps X → g which are equivariant with respect to the action of Γ.
    [Show full text]
  • An Equivariant Map F
    TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 274, Number 2, December 1982 EQUIVARIANT MINIMAL MODELS BY GEORGIA V, TRIANTAFILLOU I ABSTRACT. Let G be a finite group. We give an algebraicization of rational G-homo- topy theory analogous to Sullivan's theory of minimal models in ordinary homotopy theory. 1. Introduction. We consider simplicial complexes X on which a finite group G acts simplicially. We assume that xg = {x EO XI gx = x} is a simplicial complex for each g EO G; this can always be arranged by repeated triangulation. We assume once and for all that all G-spaces in sight are G-simple in the sense that the fixed point spaces XH are simple for all subgroups H of G. We also assume that the rational cohomology of each XH is of finite type. DEFINITION 1.1. A G-map f: X --> Y is a rational G-homotopy equivalence if each fH: XH --> yH induces an isomorphism on rational cohomology. DEFINITION 1.2. Two G-spaces X and Y have the same rational G-homotopy type if there is a chain of rational G-homotopy equivalences connecting them. These definitions are motivated by the following equivariant version of the Whi tehead theorem [1]: THEOREM 1.3 (G. BREDON). An equivariant map f: X --> Y between two G-complexes is an equivariant homotopy equivalence iff (f H )*: 'TT*(X H ) --> 'TT*(yH) is an isomor- phism for each subgroup H <;;; G. By using the same equivariant obstruction theory which leads to this result, we constructed in [5] an equivariant Postnikov decomposition of a G-complex X, i.e., a decomposition of X in a sequence of G-fibrations the fibers F" of which have the property that FnH is an Eilenberg-Mac Lane space of dimension n for each H <;;; G (we can speak of a G-action on the fiber since X has at least one fixed point).
    [Show full text]
  • Representation Theory of Symmetric Groups
    MATH 711: REPRESENTATION THEORY OF SYMMETRIC GROUPS LECTURES BY PROF. ANDREW SNOWDEN; NOTES BY ALEKSANDER HORAWA These are notes from Math 711: Representation Theory of Symmetric Groups taught by Profes- sor Andrew Snowden in Fall 2017, LATEX'ed by Aleksander Horawa (who is the only person responsible for any mistakes that may be found in them). This version is from December 18, 2017. Check for the latest version of these notes at http://www-personal.umich.edu/~ahorawa/index.html If you find any typos or mistakes, please let me know at [email protected]. The first part of the course will be devoted to the representation theory of symmetric groups and the main reference for this part of the course is [Jam78]. Another standard reference is [FH91], although it focuses on the characteristic zero theory. There is not general reference for the later part of the course, but specific citations have been provided where possible. Contents 1. Preliminaries2 2. Representations of symmetric groups9 3. Young's Rule, Littlewood{Richardson Rule, Pieri Rule 28 4. Representations of GLn(C) 42 5. Representation theory in positive characteristic 54 6. Deligne interpolation categories and recent work 75 References 105 Introduction. Why study the representation theory of symmetric groups? (1) We have a natural isomorphism V ⊗ W ∼ W ⊗ V v ⊗ w w ⊗ v We then get a representation of S2 on V ⊗V for any vector space V given by τ(v⊗w) = ⊗n w ⊗ v. More generally, we get a representation of Sn on V = V ⊗ · · · ⊗ V . If V is | {z } n times Date: December 18, 2017.
    [Show full text]
  • The Representation Theory of Equivariant Map Algebras
    The representation theory of equivariant map algebras Alistair Savage University of Ottawa March 28, 2011 Slides: www.mathstat.uottawa.ca/∼asavag2 Joint work with Neher-Senesi (arXiv:0906.5189, to appear in TAMS) Neher (arXiv:1103.4367) Fourier-Khandai-Kus (to be posted this week) Alistair Savage (Ottawa) Representation theory of EMAs March 28, 2011 1 / 40 Outline Review: Classification of irreducible finite-dimensional representations of equivariant map algebras. Goal: Describe extensions and block decompositions. Overview: 1 Equivariant map algebras 2 Examples 3 Evaluation representations 4 Classification of finite-dimensional irreducibles 5 Extensions 6 Block decompositions 7 Weyl modules Terminology: small = irreducible finite-dimensional Alistair Savage (Ottawa) Representation theory of EMAs March 28, 2011 2 / 40 (Untwisted) Map algebras Notation k - algebraically closed field of characteristic zero X - scheme (or algebraic variety) over k A = AX = OX (X ) - coordinate ring of X g - finite-dimensional Lie algebra over k Definition (Untwisted map algebra) M(X ; g) = Lie algebra of regular maps from X to g Pointwise multiplication: [α; β]M(X ;g)(x) = [α(x); β(x)]g for α; β 2 M(X ; g) ∼ Note: M(X ; g) = g ⊗ AX Alistair Savage (Ottawa) Representation theory of EMAs March 28, 2011 3 / 40 Examples Discrete spaces If X is a discrete variety, then ∼ Y M(X ; g) = g; α 7! (α(x))x2X ; α 2 M(X ; g): x2X In particular, if X = fxg is a point, then M(X ; g) =∼ g; α 7! (α(x)); α 2 M(X ; g): The isomorphisms are given by evaluation. Current algebras n X = k =) AX = k[t1;:::; tn] ∼ Thus, M(X ; g) = g ⊗ k[t1;:::; tn] is a current algebra.
    [Show full text]
  • Equivariant Maps and Bimodule Projections 1
    EQUIVARIANT MAPS AND BIMODULE PROJECTIONS VERN I. PAULSEN Abstract. We construct a counterexample to Solel’s[25] conjecture that the range of any contractive, idempotent, MASA bimodule map on B(H) is necessarily a ternary subalgebra. Our construction reduces this problem to an analogous problem about the ranges of idempotent maps that are equivariant with respect to a group action. Such maps are important to understand Hamana’s theory of G-injective operator spaces and G-injective envelopes. 1. Introduction 2 Let T denote the unit circle with arc-length measure, and let L (T) and ∞ L (T) denote the square-integrable functions and essentialy bounded func- ∞ 2 tions, respectively. If we identify L (T) ⊆ B(L (T)) as the multiplication operators, then it is a maximal abelian subalgebra(MASA). We construct a ∞ 2 unital, completely positive, idempotent L (T)-bimodule map on B(L (T)) 2 whose range is not a C*-subalgebra of B(L (T)), thus providing a coun- terexample to a conjecture of Solel[25]. Solel[25] proved that if H is a Hilbert space, M ⊆ B(H) is a MASA, and Φ: B(H) → B(H) is a weak*-continuous, (completely) contractive, idempo- tent M-bimodule map, then the range of Φ, R(Φ) is a ternary subalgebra of B(H), i.e., A, B, C ∈ R(Φ) implies that AB∗C ∈ R(Φ). For another proof of this fact see [20]. He also conjectured that the same result would hold even when Φ was not weak*-continuous. Our example provides a counterexample to this conjecture, since a ternary subalgebra containing the identity must be a C*-subalgebra.
    [Show full text]
  • Group Equivariant Convolutional Networks 2
    Group Equivariant Convolutional Networks Taco S. Cohen [email protected] University of Amsterdam Max Welling [email protected] University of Amsterdam University of California Irvine Canadian Institute for Advanced Research Abstract Convolution layers can be used effectively in a deep net- work because all the layers in such a network are trans- We introduce Group equivariant Convolutional lation equivariant: shifting the image and then feeding Neural Networks (G-CNNs), a natural general- it through a number of layers is the same as feeding the ization of convolutional neural networks that re- original image through the same layers and then shifting duces sample complexity by exploiting symme- the resulting feature maps (at least up to edge-effects). In tries. G-CNNs use G-convolutions, a new type of other words, the symmetry (translation) is preserved by layer that enjoys a substantially higher degree of each layer, which makes it possible to exploit it not just weight sharing than regular convolution layers. in the first, but also in higher layers of the network. G-convolutions increase the expressive capacity of the network without increasing the number of In this paper we show how convolutional networks can be parameters. Group convolution layers are easy generalized to exploit larger groups of symmetries, includ- to use and can be implemented with negligible ing rotations and reflections. The notion of equivariance is computational overhead for discrete groups gen- key to this generalization, so in section 2 we will discuss erated by translations, reflections and rotations. this concept and its role in deep representation learning.
    [Show full text]