DOCSLIB.ORG

Understanding Cloud-Based Data Center Networks

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Understanding Cloud-Based Data Center Networks Cloud Networking This page intentionally left blank Cloud Networking Understanding Cloud-based Data Center Networks Gary Lee AMSTERDAM • BOSTON • HEIDELBERG • LONDON NEW YORK • OXFORD • PARIS • SAN DIEGO SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO Morgan Kaufmann is an imprint of Elsevier Acquiring Editor: Todd Green Editorial Project Manager: Lindsay Lawrence Project Manager: Punithavathy Govindaradjane Designer: Russell Purdy Morgan Kaufmann is an imprint of Elsevier 225 Wyman Street, Waltham, MA 02451 USA Copyright # 2014 Gary Lee. Published by Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions. This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). Notices Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods or professional practices, may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information or methods described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility. To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions, or ideas contained in the material herein. Library of Congress Cataloging-in-Publication Data Lee, Gary Geunbae, 1961- Cloud networking : developing cloud-based data center networks / Gary Lee. pages cm ISBN 978-0-12-800728-0 1. Cloud computing. I. Title. QA76.585.L434 2014 004.67’82–dc23 2014006135 British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. ISBN: 978-0-12-800728-0 Printed and bound in the United States of America 141516171810987654321 For information on all MK publications visit our website at www.mkp.com Contents About the Author .................................................................................................. xiii Preface .....................................................................................................................xv CHAPTER 1 Welcome to Cloud Networking ................................ 1 Introduction.....................................................................................1 Networking Basics..........................................................................2 The network stack ......................................................................2 Packets and frames .....................................................................3 Network equipment ....................................................................4 Interconnect ................................................................................4 What Is a Cloud Data Center? .......................................................4 What Is Cloud Networking?...........................................................5 Characteristics of Cloud Networking.............................................5 Ethernet usage.............................................................................6 Virtualization ..............................................................................6 Convergence ...............................................................................7 Scalability ...................................................................................7 Software ......................................................................................8 Summary of This Book ..................................................................8 CHAPTER 2 Data Center Evolution—Mainframes to the Cloud ... 11 The Data Center Evolution...........................................................11 Early mainframes......................................................................12 Minicomputers..........................................................................12 Servers.......................................................................................13 Enterprise data centers..............................................................14 Cloud data centers ....................................................................14 Virtualized data centers............................................................15 Computer Networks......................................................................16 Dedicated lines .........................................................................17 ARPANET ................................................................................17 TCP/IP.......................................................................................18 Multi-Protocol Label Switching...............................................19 SONET/SDH.............................................................................20 Asynchronous Transfer Mode ..................................................21 Token Ring/Token Bus ............................................................22 Ethernet.....................................................................................23 v vi Contents Fibre Channel ...........................................................................23 InfiniBand .................................................................................23 Ethernet.........................................................................................24 Ethernet history.........................................................................24 Ethernet overview.....................................................................25 Carrier Ethernet ........................................................................27 Enterprise Versus Cloud Data Centers.........................................28 Enterprise data center networks ...............................................29 Cloud data center networks......................................................30 Movement to the Cloud................................................................31 Driving forces ...........................................................................31 Cloud types ...............................................................................32 Public cloud services ................................................................33 Review ..........................................................................................35 CHAPTER 3 Switch Fabric Technology..................................... 37 Switch Fabric Architecture Overview..........................................37 Shared bus architecture ............................................................38 Shared bus performance limitations.........................................39 Shared memory architecture.....................................................39 Shared memory performance limitations.................................40 Crossbar switch.........................................................................40 Crossbar switch performance limitations.................................41 Synchronous serial switching...................................................42 Synchronous serial performance limitations............................43 Switch Fabric Topologies.............................................................43 Ring topology ...........................................................................43 Mesh topology ..........................................................................44 Star topology.............................................................................45 Fat-tree topology.......................................................................46 Congestion Management ..............................................................47 Causes of congestion ................................................................47 Load balancing algorithms .......................................................48 Traffic buffering .......................................................................49 Flow Control.................................................................................50 Link-level flow control.............................................................51 Virtual output queuing..............................................................53 Multistage switch fabric flow control ......................................54 Traffic Management .....................................................................55 Frame classification engine......................................................55 Multilevel scheduler .................................................................55 Traffic shaping..........................................................................57 Contents vii Switch Chip Architecture Examples ............................................58 Cell-based designs ....................................................................58
Load more

Recommended publications
  • Cloud Workbench a Web-Based Framework for Benchmarking Cloud Services
    Bachelor August 12, 2014 Cloud WorkBench A Web-Based Framework for Benchmarking Cloud Services Joel Scheuner of Muensterlingen, Switzerland (10-741-494) supervised by Prof. Dr. Harald C. Gall Philipp Leitner, Jürgen Cito software evolution & architecture lab Bachelor Cloud WorkBench A Web-Based Framework for Benchmarking Cloud Services Joel Scheuner software evolution & architecture lab Bachelor Author: Joel Scheuner, [email protected] Project period: 04.03.2014 - 14.08.2014 Software Evolution & Architecture Lab Department of Informatics, University of Zurich Acknowledgements This bachelor thesis constitutes the last milestone on the way to my first academic graduation. I would like to thank all the people who accompanied and supported me in the last four years of study and work in industry paving the way to this thesis. My personal thanks go to my parents supporting me in many ways. The decision to choose a complex topic in an area where I had no personal experience in advance, neither theoretically nor technologically, made the past four and a half months challenging, demanding, work-intensive, but also very educational which is what remains in good memory afterwards. Regarding this thesis, I would like to offer special thanks to Philipp Leitner who assisted me during the whole process and gave valuable advices. Moreover, I want to thank Jürgen Cito for his mainly technologically-related recommendations, Rita Erne for her time spent with me on language review sessions, and Prof. Harald Gall for giving me the opportunity to write this thesis at the Software Evolution & Architecture Lab at the University of Zurich and providing fundings and infrastructure to realize this thesis.
    [Show full text]
  • Security Distributed and Networking Systems (507 Pages)
    Security in ................................ i Distri buted and /Networking.. .. Systems, . .. .... SERIES IN COMPUTER AND NETWORK SECURITY Series Editors: Yi Pan (Georgia State Univ., USA) and Yang Xiao (Univ. of Alabama, USA) Published: Vol. 1: Security in Distributed and Networking Systems eds. Xiao Yang et al. Forthcoming: Vol. 2: Trust and Security in Collaborative Computing by Zou Xukai et al. Steven - Security Distributed.pmd 2 5/25/2007, 1:58 PM Computer and Network Security Vol. 1 Security in i Distri buted and /Networking . Systems Editors Yang Xiao University of Alabama, USA Yi Pan Georgia State University, USA World Scientific N E W J E R S E Y • L O N D O N • S I N G A P O R E • B E I J I N G • S H A N G H A I • H O N G K O N G • TA I P E I • C H E N N A I Published by World Scientific Publishing Co. Pte. Ltd. 5 Toh Tuck Link, Singapore 596224 USA office: 27 Warren Street, Suite 401-402, Hackensack, NJ 07601 UK office: 57 Shelton Street, Covent Garden, London WC2H 9HE British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. SECURITY IN DISTRIBUTED AND NETWORKING SYSTEMS Series in Computer and Network Security — Vol. 1 Copyright © 2007 by World Scientific Publishing Co. Pte. Ltd. All rights reserved. This book, or parts thereof, may not be reproduced in any form or by any means, electronic or mechanical, including photocopying, recording or any information storage and retrieval system now known or to be invented, without written permission from the Publisher.
    [Show full text]
  • Distributed Computing Network System, Said to Be "Distributed" When the Computer Programming and the Data to Be Worked on Are Spread out Over More Than One Computer
    Praveen Balda et al, International Journal of Computer Science and Mobile Computing, Vol.4 Issue.4, April- 2015, pg. 761-767 Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320–088X IJCSMC, Vol. 4, Issue. 4, April 2015, pg.761 – 767 RESEARCH ARTICLE Security Enhancement in Distributed Networking Praveen Balda, Sh. Matish Garg Distributed Networking is a distributed computing network system, said to be "distributed" when the computer programming and the data to be worked on are spread out over more than one computer. Usually, this is implemented over a network. Prior to the emergence of low-cost desktop computer power, computing was generally centralized to one computer. Although such centers still exist, distribution networking applications and data operate more efficiently over a mix of desktop workstations, local area network servers, regional servers, Web servers, and other servers. One popular trend is client/server computing. This is the principle that a client computer can provide certain capabilities for a user and request others from other computers that provide services for the clients. (The Web's Hypertext Transfer Protocol is an example of this idea.) Enterprises that have grown in scale over the years and those that are continuing to grow are finding it extremely challenging to manage their distributed network in the traditional client/server computing model. The recent developments in the field of cloud computing has opened up new possibilities. Cloud-based networking vendors have started to sprout offering solutions for enterprise distributed networking needs.
    [Show full text]
  • Data Center Architecture and Topology
    CENTRAL TRAINING INSTITUTE JABALPUR Data Center Architecture and Topology Data Center Architecture Overview The data center is home to the computational power, storage, and applications necessary to support an enterprise business. The data center infrastructure is central to the IT architecture, from which all content is sourced or passes through. Proper planning of the data center infrastructure design is critical, and performance, resiliency, and scalability need to be carefully considered. Another important aspect of the data center design is flexibility in quickly deploying and supporting new services. Designing a flexible architecture that has the ability to support new applications in a short time frame can result in a significant competitive advantage. Such a design requires solid initial planning and thoughtful consideration in the areas of port density, access layer uplink bandwidth, true server capacity, and oversubscription, to name just a few. The data center network design is based on a proven layered approach, which has been tested and improved over the past several years in some of the largest data center implementations in the world. The layered approach is the basic foundation of the data center design that seeks to improve scalability, performance, flexibility, resiliency, and maintenance. Figure 1-1 shows the basic layered design. 1 CENTRAL TRAINING INSTITUTE MPPKVVCL JABALPUR Figure 1-1 Basic Layered Design Campus Core Core Aggregation 10 Gigabit Ethernet Gigabit Ethernet or Etherchannel Backup Access The layers of the data center design are the core, aggregation, and access layers. These layers are referred to extensively throughout this guide and are briefly described as follows: • Core layer—Provides the high-speed packet switching backplane for all flows going in and out of the data center.
    [Show full text]
  • Architecting a Vmware Vsphere Compute Platform for Vmware Cloud Providers
    VMware vCloud® Architecture Toolkit™ for Service Providers Architecting a VMware vSphere® Compute Platform for VMware Cloud Providers™ Version 2.9 January 2018 Martin Hosken Architecting a VMware vSphere Compute Platform for VMware Cloud Providers © 2018 VMware, Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. This product is covered by one or more patents listed at http://www.vmware.com/download/patents.html. VMware is a registered trademark or trademark of VMware, Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. VMware, Inc. 3401 Hillview Ave Palo Alto, CA 94304 www.vmware.com 2 | VMware vCloud® Architecture Toolkit™ for Service Providers Architecting a VMware vSphere Compute Platform for VMware Cloud Providers Contents Overview ................................................................................................. 9 Scope ...................................................................................................... 9 Use Case Scenario ............................................................................... 10 3.1 Service Definition – Virtual Data Center Service .............................................................. 10 3.2 Service Definition – Hosted Private Cloud Service ........................................................... 12 3.3 Integrated Service Overview – Conceptual Design .........................................................
    [Show full text]
  • A Dynamic Power Management Schema for Multi-Tier Data Centers
    A Dynamic Power Management Schema for Multi-Tier Data Centers By Aryan Azimzadeh April, 2016 Director of Thesis: Dr. Nasseh Tabrizi Major Department: Computer Science An issue of great concern as it relates to global warming is power consumption and efficient use of computers especially in large data centers. Data centers have an important role in IT infrastructures because of their huge power consumption. This thesis explores the sleep state of data centers’ servers under specific conditions such as setup time and identifies optimal number of servers. Moreover, their potential to greatly increase energy efficiency in data centers. We use a dynamic power management policy based on a mathematical model. Our new methodology is based on the optimal number of servers required in each tier while increasing servers’ setup time after sleep mode to reduce the power consumption. The Reactive approach is used to prove the validity of the results and energy efficiency by calculating the average power consumption of each server under specific sleep mode and setup time. We introduce a new methodology that uses average power consumption to calculate the Normalized-Performance-Per-Watt in order to evaluate the power efficiency. Our results indicate that the proposed schema is beneficial for data centers with high setup time. A Dynamic Power Management Schema for Multi-Tier Data Centers A Thesis Presented To the Faculty of the Department of Computer Science East Carolina University In Partial Fulfillment of the Requirements for the Degree Master of Science in Software Engineering By Aryan Azimzadeh April, 2016 © Aryan Azimzadeh, 2016 A Dynamic Power Management Schema for Multi-Tier Data Centers By Aryan Azimzadeh APPROVED BY: DIRECTOR OF THESIS: ____________________________________________________________________ Nasseh Tabrizi, PhD COMMITTEE MEMBER: ___________________________________________________________________ Mark Hills, PhD COMMITTEE MEMBER: ________________________________________________________ Venkat N.
    [Show full text]
  • Presentazione Di Powerpoint
    Fog Computing, its Applications in Industrial IoT, and its Implications for the Future of 5G Flavio Bonomi, CEO and Co-Founder, Nebbiolo Technologies IEEE 5G Summit, Honolulu, May 5th, 2017 Agenda • Fog Computing and 5G: High Level Introduction • Architectural Angles in “Fog” with Relevance to 5G • Fog Computing and 5G: Natural Partners for the Future of Industrial IoT, with Applications • Nebbiolo Technologies: Brief Introduction • Conclusions © Nebbiolo Technologies The Pendulum Swinging Back: A Renewed Focus on the Edge of the Network, Motivated by the Network Evolution, 5G and IoT Fog Computing Mobile Edge Computing (Modern, Real-Time Capable) Edge Computing Real-Time Edge Cloud © Nebbiolo Technologies 3 The Internet of Things: Information Technologies “Meet” Operational Technologies Public Clouds Private Clouds Information Technologies Today: 1. Clouds 2. Enterprise Datacenters 3. Traditional and Embedded Public and Private Endpoints Communications 4. Networking Infrastructure (Internet, Mobile, Enterprise Ethernet, WiFi) Enterprise Data Center The Internet of Things Brings Together Information Domain and Operations Domain through: Traditional ICT end-points Information Technologies 1. Connectivity 2. Data Sharing and Analysis 3. Technology Convergence Operational Technologies Machines, devices, sensors, actuators, things © Nebbiolo Technologies 4 The Future 5G Network and Industrial IoT Both Require More Distributed Computing Public Clouds Private Clouds The Future 5G networks and IoT require more virtualized, scalable, reliable,
    [Show full text]
  • The Raincore Distributed Session Service for Networking Elements
    The Raincore Distributed Session Service for Networking Elements Chenggong Charles Fan Jehoshua Bruck California Institute of Technology Mail-Stop 136-93 Pasadena, CA 91125 {fan, bruck}@paradise.caltech.edu Abstract devices naturally become key challenges facing the Internet infrastructure today. Motivated by the explosive growth of the Internet, we study efficient and fault-tolerant distributed session layer Networking protocols for networking elements. These protocols are elements Server2 Data designed to enable a network cluster to share the state information necessary for balancing network traffic and Server1 computation load among a group of networking elements. In addition, in the presence of failures, they allow Firewall network traffic to fail-over from failed networking Router elements to healthy ones. To maximize the overall network throughput of the networking cluster, we assume a unicast communication medium for these protocols. Router The Raincore Distributed Session Service is based on a fault-tolerant token protocol, and provides group Internet membership, reliable multicast and mutual exclusion Client Proxy Server services in a networking environment. We show that this service provides atomic reliable multicast with consistent ordering. We also show that Raincore token protocol Figure 1. An example of a traffic path consumes less overhead than a broadcast-based protocol between a client and a server farm. in this environment in terms of CPU task-switching. The Raincore technology was transferred to Rainfinity, a startup company that is focusing on software for Internet One promising way of improving the reliability and reliability and performance. Rainwall, Rainfinity’s first performance of the Internet is to cluster the networking product, was developed using the Raincore Distributed elements.
    [Show full text]
  • P2P Group Management Systems: a Conceptual Analysis
    P2P Group Management Systems: A Conceptual Analysis TIMO KOSKELA, OTSO KASSINEN, ERKKI HARJULA, and MIKA YLIANTTILA, University of Oulu Peer-to-Peer (P2P) networks are becoming eminent platforms for both distributed computing and interper- sonal communication. Their role in contemporary multimedia content delivery and communication systems is strong, as witnessed by many popular applications and services. Groups in P2P systems can originate from the relations between humans, or they can be defined with purely technical criteria such as proximity. In this article, we present a conceptual analysis of P2P group management systems. We illustrate how groups are formed using different P2P system architectures, and analyze the advantages and disadvantages of using each P2P system architecture for implementing P2P group management. The evaluation criteria in the analysis are performance, robustness, fairness, suitability for battery-powered devices, scalability, and security. The outcome of the analysis facilitates the selection of an appropriate P2P system architecture for implementing P2P group management in both further research and prototype development. Categories and Subject Descriptors: A.1 [Introductory and Survey]; C.2 [Computer-Communication Networks]: C.2.1 Network Architecture and Design—Network topology, C.2.4 Distributed Systems— Distributed databases;E.1[Data Structures]: Distributed Data Structures; H.3 [Information Storage and Retrieval]: H.3.4 Systems and Software—Distributed systems General Terms: Design, Management, Performance Additional Key Words and Phrases: Peer-to-peer, distributed hash table, overlay network, user community ACM Reference Format: Koskela, T., Kassinen, O., Harjula, E., and Ylianttila, M. 2013. P2P group management systems: A conceptual analysis. ACM Comput. Surv. 45, 2, Article 20 (February 2013), 25 pages.
    [Show full text]
  • UNIT- 1: Internet Basics 1.0 Objective 1.1 Concept of Internet
    UNIT- 1: Internet Basics UNIT STRUCTURE 1.0 Objective 1.1 Concept of Internet 1.2 Evolution of internet 1.3 Basic concepts 1.4 Communication on the Internet 1.5 Internet Domains 1.6 Internet Server Identities 1.7 Establishing Connectivity on Internet 1.8 Client IP Address 1.9 TCP/IP and its Services 1.10 Web Server 1.11 Web Client 1.12 Domain Registration 1.13 Summary 1.14 Question for Exercise 1.15 Suggested Readings 1.0 Objective Defense Advanced Research Project Agency (DARPA) of US initiated a research activity that eventually developed as a system for global data commmunication service known as the Internet. The internet, today, is being operated as a joint effort of many different organizations. In this unit, you will learn the basic concepts related to internet as well as the various mechanisms and technologies involved in the deployment of the internet. Upon completion of this unit, the readers shall be aware of the basic terms and terminologies, involved devices and mechnaisms and the applications of the Internet. 1.1 Concept of Internet The Internet is “the global system of interconnected computer networks that use the Internet protocol suite (TCP/IP) to link devices worldwide.” It has changed the way we do our daily chores. The usual tasks that we perform like sending an email, looking up train schedules, social networking, paying a utility bill is possible due to the Internet. The strucure of internat has become quite complex and it cannot be reperented as it is changing instanteniously. Every now and then some resources are being added while some are being romvwd.
    [Show full text]
  • Decentralized SDN Control Plane for a Distributed Cloud-Edge Infrastructure: a Survey David Espinel Sarmiento, Adrien Lebre, Lucas Nussbaum, Abdelhadi Chari
    Decentralized SDN Control Plane for a Distributed Cloud-Edge Infrastructure: A Survey David Espinel Sarmiento, Adrien Lebre, Lucas Nussbaum, Abdelhadi Chari To cite this version: David Espinel Sarmiento, Adrien Lebre, Lucas Nussbaum, Abdelhadi Chari. Decentralized SDN Control Plane for a Distributed Cloud-Edge Infrastructure: A Survey. [Research Report] RR-9352, INRIA. 2020, pp.40. hal-02868984 HAL Id: hal-02868984 https://hal.inria.fr/hal-02868984 Submitted on 16 Jun 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Decentralized SDN Control Plane for a Distributed Cloud-Edge Infrastructure: A Survey David Espinel, Adrien Lebre, Lucas Nussbaum, Abdelhadi Chari RESEARCH REPORT N° 9352 June 2020 Project-Teams STACK ISSN 0249-6399 ISRN INRIA/RR--9352--FR+ENG Decentralized SDN Control Plane for a Distributed Cloud-Edge Infrastructure: A Survey David Espinel∗†, Adrien Lebre∗, Lucas Nussbaum∗, Abdelhadi Chari † Project-Teams STACK Research Report n° 9352 — June 2020 — 40 pages Abstract: Today’s emerging needs (Internet of Things applications, Network Function Virtual- ization services, Mobile Edge computing, etc.) are challenging the classic approach of deploying a few large data centers to provide cloud services. A massively distributed Cloud-Edge architecture could better fit the requirements and constraints of these new trends by deploying on-demand in- frastructure services in Point-of-Presences within backbone networks.
    [Show full text]
  • Aneris: a Mechanised Logic for Modular Reasoning About Distributed Systems
    Aneris: A Mechanised Logic for Modular Reasoning about Distributed Systems Morten Krogh-Jespersen, Amin Timany ?, Marit Edna Ohlenbusch, Simon Oddershede Gregersen , and Lars Birkedal Aarhus University, Aarhus, Denmark Abstract. Building network-connected programs and distributed sys- tems is a powerful way to provide scalability and availability in a digital, always-connected era. However, with great power comes great complexity. Reasoning about distributed systems is well-known to be difficult. In this paper we present Aneris, a novel framework based on separation logic supporting modular, node-local reasoning about concurrent and distributed systems. The logic is higher-order, concurrent, with higher- order store and network sockets, and is fully mechanized in the Coq proof assistant. We use our framework to verify an implementation of a load balancer that uses multi-threading to distribute load amongst multiple servers and an implementation of the two-phase-commit protocol with a replicated logging service as a client. The two examples certify that Aneris is well-suited for both horizontal and vertical modular reasoning. Keywords: Distributed systems · Separation logic · Higher-order logic · Concurrency · Formal verification 1 Introduction Reasoning about distributed systems is notoriously difficult due to their sheer complexity. This is largely the reason why previous work has traditionally focused on verification of protocols of core network components. In particular, in the context of model checking, where safety and liveness assertions [29] are consid- ered, tools such as SPIN [9], TLA+ [23], and Mace [17] have been developed. More recently, significant contributions have been made in the field of formal proofs of implementations of challenging protocols, such as two-phase-commit, lease-based key-value stores, Paxos, and Raft [7, 25, 30, 35, 40].
    [Show full text]