DOCSLIB.ORG

Topologies How to Design

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Topologies How to Design Networks: Topologies How to Design Gilad Shainer, [email protected] TOP500 Statistics 2 TOP500 Statistics 3 World Leading Large-Scale Systems • National Supercomputing Centre in Shenzhen – Fat-tree, 5.2K nodes, 120K cores, NVIDIA GPUs, China (Petaflop) • Tokyo Institute of Technology – Fat-tree, 4K nodes, NVIDIA GPUs, Japan (Petaflop) • Commissariat a l'Energie Atomique (CEA) – Fat-tree, 4K nodes, 140K cores, France (Petaflop) • Los Alamos National Lab - Roadrunner – Fat-tree, 4K nodes, 130K cores, USA (Petaflop) • NASA – Hypercube, 9.2K nodes, 82K cores – NASA, USA • Jülich JuRoPa – Fat-tree, 3K nodes, 30K cores, Germany • Sandia National Labs – Red Sky – 3D-Torus, 5.4K nodes, 43K cores – Sandia “Red Sky”, USA 4 ORNL “Spider” System – Lustre File System • Oak Ridge Nation Lab central storage system – 13400 drives – 192 Lustre OSS – 240GB/s bandwidth – InfiniBand interconnect – 10PB capacity 5 Network Topologies • Fat-tree (CLOS), Mesh, 3D-Torus topologies • CLOS (fat-tree) – Can be fully non-blocking (1:1) or blocking (x:1) – Typically enables best performance • Non blocking bandwidth, lowest network latency • Mesh or 3D Torus – Blocking network, cost-effective for systems at scale – Great performance solutions for applications with locality 0,0 0,1 0,2 – Support for dedicate sub-networks 1,0 1,1 1,2 2,0 2,1 2,2 – Simple expansion for future growth 6 d-Dimensional Torus Topology • Formal definition – T=(V,E) is said to be d-dimensional torus of size N1xN2x…xNd if: • V={(v1,v2,…,vd) : 0 ≤ vi ≤ Ni-1} • E={(uv) : exists j s.t. 1) for each i≠j, vi=ui AND 2) vj=(uj±1) mod Nj} • Examples N1=5 N1=N2=3 0,0 0,1 0,2 0 1 2 3 4 1,0 1,1 1,2 2,0 2,1 2,2 7 3D-Torus System – Key Items • Multiple server nodes per cube junction • Smallest 3D cube size the better – Lowest latency between remote nodes – Minimizing throughput contention • Ability to connect storage • Support for separate networks – Dedicated network (links) for specific applications/usage – Example: links dedicated for collectives or specific jobs 8 InfiniBand 3D Torus 9 Routing for 3D Torus (Avoiding Deadlocks) • Setting routing might look simple – Just route packets on the shortest path between source - destination • In lossless networks trivial routing can be disastrous Communication pairs 1. 02 2. 13 3. 24 4. 30 0 2 1 3 2 4 3 0 4 1 5. 41 10 Avoiding Deadlock – Restrictive Approach • Idea – Define a set of rules forbidding usage of some resources or a (temporal) combination of resources which will guarantee freedom from deadlock – Design a routing complying with the rules 0 2 1 3 2 4 0 3 1 4 11 Avoiding Deadlock – Separation Approach • Idea – Decompose each (unidirectional) physical link into several logical channels with private buffer resources – Use logical channels to separate the network into virtual networks, each dependency-cycle-free – Assign communication pairs (with their paths) to the virtual networks • Back to our ring Routing: Shortest path Virtual mapping: If a 2 3 4 0 1 2 3 4 path uses 04 or 0 1 40 link map it to the red virtual network else to the black one 12 InfiniBand 3D Torus • InfiniBand drivers includes subnet management for – Fat Tree – min hop, up/down etc – 3D Torus - Dimension Ordered Routing 13 Mixed Topologies • Fat-tree topology provide the best performance solution • 3D-Torus can be more cost effective, easier to scale, good fit for applications with locality • Mixed topology – System connected as 3D Torus – Fast Fat-tree for collective operations 0,0 0,1 0,2 1,0 1,1 1,2 2,0 2,1 2,2 14 Notes • Following Fat-Tree network configurations – Flat network – No unused port – Two layer of switch fabric (L1 and L2) • Following 3D Torus configurations – Each 3D Torus junction is a 36-port switch – Number of switches refers to 36-port switches • InfiniBand is a great interconnect technology to enable flat connectivity of thousands and tens-of-thousands of servers in future Mega Warehouse Data Centers 15 Example: Non-blocking, Fat-Tree, 40Gb/s 648 L1 36-port switches 18 L2 648-port switches 18 Servers Total: 11664 servers (nodes) Non-blocking Throughput: 40Gb/s to the node Network 18 Servers 16 Example: 2:1 Oversubscription, Fat-Tree, 40Gb/s 648 L1 36-port switches 12 L2 648-port switches 24 Servers Total: 15552 servers (nodes) Non-blocking Throughput: 20Gb/s to the node Network 24 Servers 17 Example: 3:1 Oversubscription, Fat-Tree, 40Gb/s 648 L1 36-port switches 9 L2 648-port switches 27 Servers Total: 17496 servers (nodes) Non-blocking Throughput: 13Gb/s to the node Network 27 Servers 18 Example: 8:1 Oversubscription, Fat-Tree, 40Gb/s 324 L1 36-port switches 2 L2 648-port switches 32 Servers Total: 10368 servers (nodes) Non-blocking Throughput: 5Gb/s to the node Network 32 Servers 19 Example: 3D Torus + z 3D Torus Switch Junction + y 120Gb/s 120Gb/s 120Gb/s 120Gb/s + x - x 40Gb/s each 120Gb/s - y 120Gb/s - z 18 Servers (nodes) 3D Torus size: 8x8x8 (512 36-port switches) Total number of servers: 9216 20 3D Torus Connections Example ION1 Node 0 Node 1 Node 2 Node 3 Node 4 Node 5 Node 6 Node 7 Node 8 Node 9 Node 10 Node 11 36 Node 12 Node 13 - port Switch port Node 14 Node 15 Node 16 - z +z - y +y - x +x 21 Choosing the Right Topology • Performance: Fat Tree – Application locality? 3D can become an option – Multiple users/applications? Fat Tree – Non blocking? Fat Tree • Cost – Depends on the size of the system – Very large systems can be more cost effective with 3D Torus • Future expansion? 3D Torus will be easier to expend 22 Network Offloading • Transport offloads – critical for CPU efficiency • Congestion avoidance – must be done in the network • Applications offloading (MPI offloading) – For example: MPI Collectives Offloads Software MPI: Losing performance Lower is better beyond 20% CPU Collectives Offload computation based MPI: availability Beyond 80% CPU computation availability without any performance loss! 23 Thank You www.hpcadvisorycouncil.com [email protected] 24 24 .
Load more

Recommended publications
  • Note on 6-Regular Graphs on the Klein Bottle Michiko Kasai [email protected]
    Theory and Applications of Graphs Volume 4 | Issue 1 Article 5 2017 Note On 6-regular Graphs On The Klein Bottle Michiko Kasai [email protected] Naoki Matsumoto Seikei University, [email protected] Atsuhiro Nakamoto Yokohama National University, [email protected] Takayuki Nozawa [email protected] Hiroki Seno [email protected] See next page for additional authors Follow this and additional works at: https://digitalcommons.georgiasouthern.edu/tag Part of the Discrete Mathematics and Combinatorics Commons Recommended Citation Kasai, Michiko; Matsumoto, Naoki; Nakamoto, Atsuhiro; Nozawa, Takayuki; Seno, Hiroki; and Takiguchi, Yosuke (2017) "Note On 6-regular Graphs On The Klein Bottle," Theory and Applications of Graphs: Vol. 4 : Iss. 1 , Article 5. DOI: 10.20429/tag.2017.040105 Available at: https://digitalcommons.georgiasouthern.edu/tag/vol4/iss1/5 This article is brought to you for free and open access by the Journals at Digital Commons@Georgia Southern. It has been accepted for inclusion in Theory and Applications of Graphs by an authorized administrator of Digital Commons@Georgia Southern. For more information, please contact [email protected]. Note On 6-regular Graphs On The Klein Bottle Authors Michiko Kasai, Naoki Matsumoto, Atsuhiro Nakamoto, Takayuki Nozawa, Hiroki Seno, and Yosuke Takiguchi This article is available in Theory and Applications of Graphs: https://digitalcommons.georgiasouthern.edu/tag/vol4/iss1/5 Kasai et al.: 6-regular graphs on the Klein bottle Abstract Altshuler [1] classified 6-regular graphs on the torus, but Thomassen [11] and Negami [7] gave different classifications for 6-regular graphs on the Klein bottle. In this note, we unify those two classifications, pointing out their difference and similarity.
    [Show full text]
  • An Introduction to Topology the Classification Theorem for Surfaces by E
    An Introduction to Topology An Introduction to Topology The Classification theorem for Surfaces By E. C. Zeeman Introduction. The classification theorem is a beautiful example of geometric topology. Although it was discovered in the last century*, yet it manages to convey the spirit of present day research. The proof that we give here is elementary, and its is hoped more intuitive than that found in most textbooks, but in none the less rigorous. It is designed for readers who have never done any topology before. It is the sort of mathematics that could be taught in schools both to foster geometric intuition, and to counteract the present day alarming tendency to drop geometry. It is profound, and yet preserves a sense of fun. In Appendix 1 we explain how a deeper result can be proved if one has available the more sophisticated tools of analytic topology and algebraic topology. Examples. Before starting the theorem let us look at a few examples of surfaces. In any branch of mathematics it is always a good thing to start with examples, because they are the source of our intuition. All the following pictures are of surfaces in 3-dimensions. In example 1 by the word “sphere” we mean just the surface of the sphere, and not the inside. In fact in all the examples we mean just the surface and not the solid inside. 1. Sphere. 2. Torus (or inner tube). 3. Knotted torus. 4. Sphere with knotted torus bored through it. * Zeeman wrote this article in the mid-twentieth century. 1 An Introduction to Topology 5.
    [Show full text]
  • Graphs on Surfaces, the Generalized Euler's Formula and The
    Graphs on surfaces, the generalized Euler's formula and the classification theorem ZdenˇekDvoˇr´ak October 28, 2020 In this lecture, we allow the graphs to have loops and parallel edges. In addition to the plane (or the sphere), we can draw the graphs on the surface of the torus or on more complicated surfaces. Definition 1. A surface is a compact connected 2-dimensional manifold with- out boundary. Intuitive explanation: • 2-dimensional manifold without boundary: Each point has a neighbor- hood homeomorphic to an open disk, i.e., \locally, the surface looks at every point the same as the plane." • compact: \The surface can be covered by a finite number of such neigh- borhoods." • connected: \The surface has just one piece." Examples: • The sphere and the torus are surfaces. • The plane is not a surface, since it is not compact. • The closed disk is not a surface, since it has a boundary. From the combinatorial perspective, it does not make sense to distinguish between some of the surfaces; the same graphs can be drawn on the torus and on a deformed torus (e.g., a coffee mug with a handle). For us, two surfaces will be equivalent if they only differ by a homeomorphism; a function f :Σ1 ! Σ2 between two surfaces is a homeomorphism if f is a bijection, continuous, and the inverse f −1 is continuous as well. In particular, this 1 implies that f maps simple continuous curves to simple continuous curves, and thus it maps a drawing of a graph in Σ1 to a drawing of the same graph in Σ2.
    [Show full text]
  • Recognizing Surfaces
    RECOGNIZING SURFACES Ivo Nikolov and Alexandru I. Suciu Mathematics Department College of Arts and Sciences Northeastern University Abstract The subject of this poster is the interplay between the topology and the combinatorics of surfaces. The main problem of Topology is to classify spaces up to continuous deformations, known as homeomorphisms. Under certain conditions, topological invariants that capture qualitative and quantitative properties of spaces lead to the enumeration of homeomorphism types. Surfaces are some of the simplest, yet most interesting topological objects. The poster focuses on the main topological invariants of two-dimensional manifolds—orientability, number of boundary components, genus, and Euler characteristic—and how these invariants solve the classification problem for compact surfaces. The poster introduces a Java applet that was written in Fall, 1998 as a class project for a Topology I course. It implements an algorithm that determines the homeomorphism type of a closed surface from a combinatorial description as a polygon with edges identified in pairs. The input for the applet is a string of integers, encoding the edge identifications. The output of the applet consists of three topological invariants that completely classify the resulting surface. Topology of Surfaces Topology is the abstraction of certain geometrical ideas, such as continuity and closeness. Roughly speaking, topol- ogy is the exploration of manifolds, and of the properties that remain invariant under continuous, invertible transforma- tions, known as homeomorphisms. The basic problem is to classify manifolds according to homeomorphism type. In higher dimensions, this is an impossible task, but, in low di- mensions, it can be done. Surfaces are some of the simplest, yet most interesting topological objects.
    [Show full text]
  • Area-Preserving Diffeomorphisms of the Torus Whose Rotation Sets Have
    Area-preserving diffeomorphisms of the torus whose rotation sets have non-empty interior Salvador Addas-Zanata Instituto de Matem´atica e Estat´ıstica Universidade de S˜ao Paulo Rua do Mat˜ao 1010, Cidade Universit´aria, 05508-090 S˜ao Paulo, SP, Brazil Abstract ǫ In this paper we consider C1+ area-preserving diffeomorphisms of the torus f, either homotopic to the identity or to Dehn twists. We sup- e pose that f has a lift f to the plane such that its rotation set has in- terior and prove, among other things that if zero is an interior point of e e 2 the rotation set, then there exists a hyperbolic f-periodic point Q∈ IR such that W u(Qe) intersects W s(Qe +(a,b)) for all integers (a,b), which u e implies that W (Q) is invariant under integer translations. Moreover, u e s e e u e W (Q) = W (Q) and f restricted to W (Q) is invariant and topologi- u e cally mixing. Each connected component of the complement of W (Q) is a disk with diameter uniformly bounded from above. If f is transitive, u e 2 e then W (Q) =IR and f is topologically mixing in the whole plane. Key words: pseudo-Anosov maps, Pesin theory, periodic disks e-mail: [email protected] 2010 Mathematics Subject Classification: 37E30, 37E45, 37C25, 37C29, 37D25 The author is partially supported by CNPq, grant: 304803/06-5 1 Introduction and main results One of the most well understood chapters of dynamics of surface homeomor- phisms is the case of the torus.
    [Show full text]
  • 2 Non-Orientable Surfaces §
    2 NON-ORIENTABLE SURFACES § 2 Non-orientable Surfaces § This section explores stranger surfaces made from gluing diagrams. Supplies: Glass Klein bottle • Scarf and hat • Transparency fish • Large pieces of posterboard to cut • Markers • Colored paper grid for making the room a gluing diagram • Plastic tubes • Mobius band templates • Cube templates from Exploring the Shape of Space • 24 Mobius Bands 2 NON-ORIENTABLE SURFACES § Mobius Bands 1. Cut a blank sheet of paper into four long strips. Make one strip into a cylinder by taping the ends with no twist, and make a second strip into a Mobius band by taping the ends together with a half twist (a twist through 180 degrees). 2. Mark an X somewhere on your cylinder. Starting at the X, draw a line down the center of the strip until you return to the starting point. Do the same for the Mobius band. What happens? 3. Make a gluing diagram for a cylinder by drawing a rectangle with arrows. Do the same for a Mobius band. 4. The gluing diagram you made defines a virtual Mobius band, which is a little di↵erent from a paper Mobius band. A paper Mobius band has a slight thickness and occupies a small volume; there is a small separation between its ”two sides”. The virtual Mobius band has zero thickness; it is truly 2-dimensional. Mark an X on your virtual Mobius band and trace down the centerline. You’ll get back to your starting point after only one trip around! 25 Multiple twists 2 NON-ORIENTABLE SURFACES § 5.
    [Show full text]
  • Classification of Compact Orientable Surfaces Using Morse Theory
    U.U.D.M. Project Report 2016:37 Classification of Compact Orientable Surfaces using Morse Theory Johan Rydholm Examensarbete i matematik, 15 hp Handledare: Thomas Kragh Examinator: Jörgen Östensson Augusti 2016 Department of Mathematics Uppsala University Classication of Compact Orientable Surfaces using Morse Theory Johan Rydholm 1 Introduction Here we classify surfaces up to dieomorphism. The classication is done in section Construction of the Genus-g Toruses, as an application of the previously developed Morse theory. The objects which we study, surfaces, are dened in section Surfaces, together with other denitions and results which lays the foundation for the rest of the essay. Most of the section Surfaces is taken from chapter 0 in [2], and gives a quick introduction to, among other things, smooth manifolds, dieomorphisms, smooth vector elds and connected sums. The material in section Morse Theory and section Existence of a Good Morse Function uses mainly chapter 1 in [5] and chapters 2,4 and 5 in [4] (but not necessarily only these chapters). In these two sections we rst prove Lemma of Morse, which is probably the single most important result, even though the proof is far from the hardest. We prove the existence of a Morse function, existence of a self-indexing Morse function, and nally the existence of a good Morse function, on any surface; while doing this we also prove the existence of one of our most important tools: a gradient-like vector eld for the Morse function. The results in sections Morse Theory and Existence of a Good Morse Func- tion contains the main resluts and ideas.
    [Show full text]
  • How to Make a Torus Laszlo C
    DO THE MATH! How to Make a Torus Laszlo C. Bardos sk a topologist how to make a model of a torus and your instructions will be to tape two edges of a piece of paper together to form a tube and then to tape the ends of the tube together. This process is math- Aematically correct, but the result is either a flat torus or a crinkled mess. A more deformable material such as cloth gives slightly better results, but sewing a torus exposes an unexpected property of tori. Start by sewing the torus The sticky notes inside out so that the stitching will be hidden when illustrate one of three the torus is reversed. Leave a hole in the side for this types of circular cross purpose. Wait a minute! Can you even turn a punctured sections. We find the torus inside out? second circular cross Surprisingly, the answer is yes. However, doing so section by cutting a yields a baffling result. A torus that started with a torus with a plane pleasing doughnut shape transforms into a one with perpendicular to different, almost unrecognizable dimensions when turned the axis of revolu- right side out. (See figure 1.) tion (both such cross So, if the standard model of a torus doesn’t work well, sections are shown we’ll need to take another tack. A torus is generated Figure 2. A torus made from on the green torus in sticky notes. by sweeping a figure 3). circle around But there is third, an axis in the less obvious way to same plane as create a circular cross the circle.
    [Show full text]
  • Torus and Klein Bottle Tessellations with a Single Tile of Pied De Poule (Houndstooth)
    Bridges 2018 Conference Proceedings Torus and Klein Bottle Tessellations with a Single Tile of Pied de Poule (Houndstooth) Loe M.G. Feijs Eindhoven University of Technology, The Netherlands; [email protected] Abstract We design a 3D surface made by continuous deformation applied to a single tile. The contour edges are aligned according to the network topology of a Pied-de-poule tessellation. In a classical tessellation, each edge is aligned with a matching edge of a neighbouring tile, but here the single tile acts as a neighbouring tile too. The continuous deformation mapping the Pied-de-poule tile to the 3D surface preserves the staircase nature of the contour edges of the tile. It is a diffeomorphism. The 3D surface thus appears as a torus with gaps where the sides of the tile meet. Next we present another surface, also a single Pied-de-poule tile, but with different tessellation type, a Klein bottle. Both surfaces are 3D printed as innovative art works, connecting topological manifolds and the famous fashion pattern. Introduction Pied-de-poule (houndstooth) denotes a family of fashion patterns, see the Bridges 2012 paper [3] and Abdalla Ahmed’s work on weaving design [1] for more background information. In this project, we study tessellations obtained by continuous deformation of a Pied-de-poule’s basic tile. In particular, we construct tessellations with a single copy of one basic tile. The network topology of the tessellation was analysed in [3]. A typical piece of Pied-de-poule fabric can be seen in Figure 1 (left).
    [Show full text]
  • Mapping Class Group Notes
    MAPPING CLASS GROUP NOTES WADE BLOOMQUIST These notes look to introduce the mapping class groups of surfaces, explicitly compute examples of low complexity, and introduce the basics on projective representations that will be helpful going forward when looking at quantum representations of mapping class groups. The vast majority of the material is modelled off how it is presented in A Primer on Mapping Class Groups by Benson Farb and Dan Margalit. Unfortunately many accompanying pictures given in lecture are going to be left out due to laziness. 1. Fixing Notation Let Σ be a compact connected oriented surface potentially with punctures. Note that when the surface has punctures then it is no longer compact, but it is necessary to start with an un-punctured compact surface first. This is also what is called a surface of finite type. • g will be the genus of Σ, determined by connect summing g tori to the 2−sphere. • b will be the number of boundary components, determined by removing b open disks with disjoint closure • n will be the number of punctures determiend by removing n points from the interior of the surface b We will denote a surface by Σg;n, where the indices b and n may be excluded if they are zero. We will also use the notation S2 for the 2−sphere, D2 for the disk, and T 2 for the torus (meaning the genus 1 surface). The main invariant (up to homeomorphism) of surfaces is the Euler Char- acteristic, χ(Σ) defined as b χ(Σg;n) := 2 − 2g − (b + n): The classification of surfaces tells us that Σ is determined by any 3 of g; b; n; χ(Σ).
    [Show full text]
  • The Fundamental Polygon 3 3. Method Two: Sewing Handles and Mobius Strips 13 Acknowledgments 18 References 18
    THE CLASSIFICATION OF SURFACES CASEY BREEN Abstract. The sphere, the torus, and the projective plane are all examples of surfaces, or topological 2-manifolds. An important result in topology, known as the classification theorem, is that any surface is a connected sum of the above examples. This paper will introduce these basic surfaces and provide two different proofs of the classification theorem. While concepts like triangulation will be fundamental to both, the first method relies on representing surfaces as the quotient space obtained by pasting edges of a polygon together, while the second builds surfaces by attaching handles and Mobius strips to a sphere. Contents 1. Preliminaries 1 2. Method One: the Fundamental Polygon 3 3. Method Two: Sewing Handles and Mobius Strips 13 Acknowledgments 18 References 18 1. Preliminaries Definition 1.1. A topological space is Hausdorff if for all x1; x2 2 X, there exist disjoint neighborhoods U1 3 x1;U2 3 x2. Definition 1.2. A basis, B for a topology, τ on X is a collection of open sets in τ such that every open set in τ can be written as a union of elements in B. Definition 1.3. A surface is a Hausdorff space with a countable basis, for which each point has a neighborhood that is homeomorphic to an open subset of R2. This paper will focus on compact connected surfaces, which we refer to simply as surfaces. Below are some examples of surfaces.1 The first two are the sphere and torus, respectively. The subsequent sequences of images illustrate the construction of the Klein bottle and the projective plane.
    [Show full text]
  • Lectures on the Mapping Class Group of a Surface
    LECTURES ON THE MAPPING CLASS GROUP OF A SURFACE THOMAS KWOK-KEUNG AU, FENG LUO, AND TIAN YANG Abstract. In these lectures, we give the proofs of two basic theorems on surface topology, namely, the work of Dehn and Lickorish on generating the mapping class group of a surface by Dehn-twists; and the work of Dehn and Nielsen on relating self-homeomorphisms of a surface and automorphisms of the fundamental group of the surface. Some of the basic materials on hyper- bolic geometry and large scale geometry are introduced. Contents Introduction 1 1. Mapping Class Group 2 2. Dehn-Lickorish Theorem 13 3. Hyperbolic Plane and Hyperbolic Surfaces 22 3.1. A Crash Introduction to the Hyperbolic Plane 22 3.2. Hyperbolic Geometry on Surfaces 29 4. Quasi-Isometry and Large Scale Geometry 36 5. Dehn-Nielsen Theorem 44 5.1. Injectivity of ª 45 5.2. Surjectivity of ª 46 References 52 2010 Mathematics Subject Classi¯cation. Primary: 57N05; Secondary: 57M60, 57S05. Key words and phrases. Mapping class group, Dehn-Lickorish, Dehn-Nielsen. i ii LECTURES ON MAPPING CLASS GROUPS 1 Introduction The purpose of this paper is to give a quick introduction to the mapping class group of a surface. We will prove two main theorems in the theory, namely, the theorem of Dehn-Lickorish that the mapping class group is generated by Dehn twists and the theorem of Dehn-Nielsen that the mapping class group is equal to the outer-automorphism group of the fundamental group. We will present a proof of Dehn-Nielsen realization theorem following the argument of B.
    [Show full text]