Servers—From Scale to Hyperscale

Total Page:16

File Type:pdf, Size:1020Kb

Servers—From Scale to Hyperscale INDUSTRY | IN DEPTH Manish Gupta [email protected] Servers—From Scale to Hyperscale As the efficiency and flexibility offered by hyperscale computing is making noise, enterprises are curious to know how to apply the hyperscale design principles to their more mainstream datacenter needs he requirements placed on the datacenter of volume of data and types or volume of workloads can an average organization have today trans- be accommodated quickly and in a cost-effective man- formed in scale. Organizations require stor- ner. Hyperscale environments have hardware and service age, processing, and network capabilities of needs that are distinct from traditional datacenters. Be- a much larger scale than before and also have cause these environments have a process and focussed Tthe ability to adapt quickly in order to stay competitive methodology of operations, organizations do not want to in today’s dynamic business environment. The answer to pay for capabilities they do not need. this lies in hyperscale computing, a term that has been For example, because the high availability in hyperscale derived from the datacenter efficiency displayed by large- environments is achieved primarily through software, or- scale web companies such as Google, Facebook, and ganizations do not need many of the redundant hardware Amazon. components or availability tools included with other servers. Hyperscale computing or web-scale IT, simply put is a In addition, these organizations do not typically use same- distributed computing environment where increase in the day parts replacement services, instead, they typically have 64 | October 15, 2015 www.dqindia.com A CyberMedia Publication | INDUSTRY | IN DEPTH on-site parts kiosks they can use to service multiple systems tectures for different workloads does not make business during regularly scheduled maintenance windows. sense from a capital and operating expenditure and ef- ficiency point of view. THE SCALING HYPERSCALE COMPUTING The fundamental premise of a hyperscale environment Hyperscale computing in the mainstream datacenter has is to build the environment based on what is most prob- become possible with several vendors investing in build- ably required with blocks of compute, storage, IO, etc, ing such capabilities and making it accessible to the larger which can be mixed and matched based on the need of market. With greater awareness about the flexibility and the application. This allows organizations to maintain a efficiency offered by such technologies, businesses are single pool of infrastructure which can be allocated as paying attention to the possibility of hyperscale comput- the needs arise. Let’s take the example of 3 very differ- ing. They are curious to know how to apply the hyperscale ent workloads a Hadoop environment requires memory, design principles to their mainstream datacenter needs. IO, and a lot of disk space but not CPU cycles, and disk So, while it’s true, there are still sharp contrasts between IOPS. A database requires disk IOPS and a lot of CPU hyperscale and mainstream enterprise computing archi- clock cycles, but may not require significant disk space. tectures, with leading enterprises starting to adopt the A typical environment consists of many such applications guiding principles of hyperscale. from web delivery to a CRM putting all of this on one elas- The concept has caught on the awareness and inter- tic hyperscale environment which allows the organization est of India IT decision makers. In 2014, Dell in associa- to optimize utilization and at the same time minimize the tion with PSB research conducted the Global IT Decision operating expenses. Maker’s survey, according to which 90% of IT decision makers (ITDMs) in India are interested in making IT work THE EMERGENCE OF CONVERGENCE more like the organizations that are primarly hyperscale New converged architectures are available that provide, and have adopted or are developing some of the con- for the first time, a common, scalable platform that eas- cepts, with 77% seeing operational efficiencies as an ily adapts to the ever-shifting business and technology important benefit of hyperscale computing. This is much landscape. By leveraging such a building block concept higher than the global average where 75% of IT decision derived from the large hyperscale IT operations, organiza- makers have shown interest in the technology. tions can better manage, scale, and tailor infrastructure to meet business needs as they change over time. While EVOLUTION TO HYPERSCALE technology to converge server, storage, and networking The server market has changed in dynamics drastically is already here, these new converged architectures will in the past few years due to unique challenges, needs, revolutionize how modern enterprises consume and man- and workload requirements of server market segments. age IT in 2015. On the one hand, you have the large global Internet Leading analyst firms are bullish about the adoption companies that have evolved a seamless IT system that of hyperscale computing or web-scale IT. Research firm helps them achieve agility and scalability of another level Gartner recently predicted that by 2017 web-scale IT will through new processes, architectures, and practices. be an architectural approach found operating in 50% of This is followed by companies that are massive in scale the global enterprises. IDC predicts that in 2015, Asia is such as web-tech and HPC, traditional larger enterprises, likely to focus on web-scale cloud systems. In the da- and small and medium businesses. These unique work- tacenter, the most efficient, cost-effective, and profitable load requirements have transpired into four different ap- technologies are branded fit to survive the market de- proaches to the server and resulted in the cross-pollina- mands and dynamics. We believe that hyperscale com- tion of best practices. puting stands among them as a result of its flexibility, ef- When it comes to hyperscale, we observed that when ficiency, and the business benefits it provide to working with massive Internet companies, IT architecture enterprises. needs to be common, but server, storage, and network- ing needs to be modified to suit specific verticals such as The author is Director, Enterprise Solutions analytics and web serving. To completely modify archi- Group, Dell India | A CyberMedia Publication www.dqindia.com October 15, 2015 | 65.
Recommended publications
  • Cloud Transformation/ Operation Services & Xaas
    Cloud Transformation/ A research report Operation Services & XaaS comparing provider strengths, challenges Global 2019 and competitive differentiators Quadrant Report Customized report courtesy of: November 2018 ISG Provider Lens™ Quadrant Report | November 2018 Section Name About this Report Information Services Group, Inc. is solely responsible for the content of this report. ISG Provider Lens™ delivers leading-edge and actionable research studies, reports and consulting services focused on technology and service providers’ strength and Unless otherwise cited, all content, including illustrations, research, conclusions, weaknesses and how they are positioned relative to their peers in the market. These assertions and positions contained in this report were developed by and are the sole reports provide influential insights accessed by our large pool of advisors who are property of Information Services Group, Inc. actively advising outsourcing deals as well as large numbers of ISG enterprise clients who are potential outsourcers. The research and analysis presented in this report includes research from the ISG Provider Lens™ program, ongoing ISG Research programs, interviews with ISG advisors, For more information about our studies, please email [email protected], briefings with services providers and analysis of publicly available market information call +49 (0) 561-50697537, or visit ISG Provider Lens™ under ISG Provider Lens™. from multiple sources. The data collected for this report represents information that ISG believes to be current as of September 2018, for providers who actively participated as well as for providers who did not. ISG recognizes that many mergers and acquisitions have taken place since that time but those changes are not reflected in this report.
    [Show full text]
  • Cloud Transformation/ Operation Services & Xaas
    Cloud Transformation/ A research report Operation Services & XaaS comparing provider strengths, challenges U.S. 2019 and competitive differentiators Quadrant Report Customized report courtesy of: November 2018 ISG Provider Lens™ Quadrant Report | November 2018 Section Name About this Report Information Services Group, Inc. is solely responsible for the content of this report. ISG Provider Lens™ delivers leading-edge and actionable research studies, reports and consulting services focused on technology and service providers’ strength and Unless otherwise cited, all content, including illustrations, research, conclusions, weaknesses and how they are positioned relative to their peers in the market. These assertions and positions contained in this report were developed by and are the sole reports provide influential insights accessed by our large pool of advisors who are property of Information Services Group, Inc. actively advising outsourcing deals as well as large numbers of ISG enterprise clients who are potential outsourcers. The research and analysis presented in this report includes research from the ISG Provider Lens™ program, ongoing ISG Research programs, interviews with ISG advisors, For more information about our studies, please email [email protected], briefings with services providers and analysis of publicly available market information call +49 (0) 561-50697537, or visit ISG Provider Lens™ under ISG Provider Lens™. from multiple sources. The data collected for this report represents information that ISG believes to be current as of September 2018, for providers who actively participated as well as for providers who did not. ISG recognizes that many mergers and acquisitions have taken place since that time but those changes are not reflected in this report.
    [Show full text]
  • Onvey White Paper C
    C onvey White Paper onvey Ramping Up Web Server Memcached Capabilities with Hybrid-Core Computing Convey Computer White Paper Convey White Paper Ramping Up Web Server Memcached Capabilities with Hybrid-Core Computing Introduction Constantly increasing network traffic and rapidly growing datasets present ever increasing scaling challenges for memcached, a high-performance, distributed memory caching system used by most of the top web sites in the world. Convey’s hybrid-core technology provides a solution. The rapid growth of the Internet, and the emergence of hyperscale computing are placing new demands on the flow of web traffic. For example, companies like Amazon, Google, and Facebook have created hyperscale data centers to handle exponentially increasing traffic driven by social networking and on-line commerce. The problem of delivering content to consumers in a real-time manner is compounded by this explosive growth. Contents Enter Memcached 1 Introduction Memcached is a key technology employed to accelerate the delivery of content that 1 Enter Memcached resides/persists in mass storage systems. 2 Rejuvenation Time Memcached, which stands for Memory Cache Daemon, is a general-purpose distributed 2 More is Less memory caching system. It was developed in 2003 because LiveJournal, an early social 3 The Hybrid-Core Computing blogging site, was experiencing rapid growth and its users were complaining about slow Solution response times. 4 Removing the Scalability Barrier 4 Summary of Benefits One of the major bottlenecks was the latency associated with reading from the 5 Conclusions database. To deal with this problem, the journal’s founder, Brad Fitzgerald, created memcached. It was a smashing success, eliminating the bottleneck to the delight of LiveJournal users.
    [Show full text]
  • Telco Edge Cloud: Edge Service Description and Commercial Principles Whitepaper October 2020
    Telco Edge Cloud: Edge Service Description and Commercial Principles Whitepaper October 2020 About the GSMA About the Telco Edge Cloud Group The GSMA represents the interests of The Telco Edge Cloud (TEC) group brings mobile operators worldwide, uniting more together over 20 operators, covering all than 750 operators with over 350 regions, who are working to promote a companies in the broader mobile collaborative deployment of cloud capabilities ecosystem, including handset at the edge of their networks. TEC is aiming to and device makers, software companies, align Multi-Access Edge Computing (MEC) equipment providers and internet business models, charging principles and companies, as well as organisations in commercial deployment considerations. adjacent industry sectors. The GSMA also produces the industry-leading MWC events TEC is working in partnership with the GSMA held annually in Barcelona, Los Angeles Operator Platform Group, which aims to create and Shanghai, as well as the Mobile 360 the architecture and technical requirements to Series of regional conferences. guide other Standard Developing Organisations (SDOs) in the development of For more information, please visit the specifications. GSMA corporate website at www.gsma.com. Follow the GSMA on Twitter: @GSMA. Executive Summary The Telco Edge Cloud taskforce was launched in the GSMA in March 2020 by 19 operators with the intention to design and develop a global edge computing service based on the federation of the edge infrastructures and platforms of a set of operators and edge service providers. Following its principle of being open and inclusive, the taskforce has grown to 25 members at the time of edition of this whitepaper and has set the basis for the global service launch.
    [Show full text]
  • Avril 2021 Mettre Le Cloud Européen Au Service De L’Économie De La Vie
    Le Cloud européen : de grands enjeux pour l’Europe et cinq scénarios avec des impacts majeurs d’ici 2027-2030 Avril 2021 Mettre le cloud européen au service de l’économie de la vie. Mettre les données, virtuelles par essence, dans un stockage virtuel, était depuis longtemps une évidence prévisible, que la technologie a fini par imposer. Malheureusement, comme souvent, l’Europe a mis plus longtemps que beaucoup d’autres à le comprendre, laissant à Microsoft, Amazon et Google plus de 60% du marché du cloud public mondial. Aujourd’hui, cette absence de l’Europe est très grave et il convient d’y remédier au plus vite. D’abord, c’est un enjeu économique : D’ici à 2027, le marché du cloud en Europe pourrait atteindre plus de 260 milliards d’euros (contre 53 milliards d’euros aujourd’hui), ce qui le mettrait au même niveau que le marché actuel des télécommunications (environ 250 milliards d’euros en 2020). Et si les opérateurs de Cloud localisaient leurs opérations et leurs investissements en Europe, cela pourrait permettre en plus de créer environ 550 000 emplois entre 2021 et 2027 et déclencher des investissements significatifs (de l’ordre de 200 Md€ s sur la période 2021-2027). Cela serait aussi l’occasion de soutenir l’industrie des applications : le cloud n’est rien sans l’ensemble des services qui l’utilisent ; un cloud européen pourrait permettre de développer plus rapidement les entreprises européennes du logiciel, dans toutes les acceptions du mot. Cela permettrait aussi de développer dans un contexte sécurisé, les industries de la santé, de l’éducation, de la culture, des médias, de la sécurité, de l’assurance, de la finance ; tous secteurs fondamentaux dans la future économie de la vie.
    [Show full text]
  • Enterprise Cloud Strategy Infrastructure As a Service
    Azure eBook series Enterprise Cloud Strategy Infrastructure as a Service Barry Briggs/Third edition Published by Microsoft Corporation One Microsoft Way Redmond, Washington 98052-6399 Copyright © 2019 by Microsoft Corporation All rights reserved. No part of the contents of this book may be reproduced or transmitted in any form or by any means without the written permission of the publisher. This book is provided ‘as-is’ and expresses the author’s views and opinions. The views, opinions and information expressed in this book, including URLs and other internet website references, may change without notice. Some examples depicted herein are provided for illustration only and are fictitious. No real association or connection is intended or should be inferred. Microsoft and the trademarks listed at www.microsoft.com on the ‘Trademarks’ web page are trademarks of the Microsoft group of companies. All other marks are property of their respective owners. Author: Barry Briggs Introduction 4 04 / The Economics of 01 / Infrastructure as a Service Why the Cloud? Comparing on-premises application Data centres are expensive 6 costs to IaaS 21 Needed: Computing on demand 7 Subscriptions 23 Considerations when choosing How you’re charged for Azure IaaS 24 a cloud provider 8 Return on investment 25 02 / 05 / Cloud Computing: Infrastructure as a Service: Terms to Know A Deep Dive Infrastructure as a Service 10 Overview 27 Platform as a Service 11 Compute 27 Software as a Service 12 Storage 29 Overview of capabilities 13 Networking 31 Advantages and disadvantages
    [Show full text]
  • Edge Computing for 5G Networks
    5G PPP Technology Board Edge Computing for 5G Networks 5GPPP Technology Board Working Group 5G-IA’s Trials Working Group Edge Computing for 5G Networks Version 1.0 Date: 29-01-2021 Version: 1.0 DOI 10.5281/zenodo.3698117 URL https://doi.org/10.5281/zenodo.3698117 Dissemination level: Public Page 1 / 96 5G PPP Technology Board Edge Computing for 5G Networks Table of Contents Executive Summary ........................................................................................................ 4 1. Introduction - Why Edge Computing is key for 5G and beyond............................ 6 1.1 What is Edge Computing ............................................................................... 6 1.2 Why is Edge Computing critical for 5G ....................................................... 7 1.3 Where is the Edge of the Network ................................................................ 9 1.4 How does the Edge look like? ...................................................................... 12 1.5 Introduction to the 5G Edge Cloud Ecosystem.......................................... 13 2. Key Technologies for 5G on Edge Computing ..................................................... 15 2.1 Resources Virtualization framework .......................................................... 15 2.1.1 Virtual Machines and Containerization ................................................................................... 15 2.1.2 Lightweight virtualization ......................................................................................................
    [Show full text]
  • Download Accenture Technology Vision 2014
    Accenture Technology Vision 2014 Every Business Is a Digital Business From Digitally Disrupted to Digital Disrupter CONTENTS FOREWORD 3 INTRODUCTION 4 TRENDS 01 04 Digital–physical blur: Harnessing hyperscale: Extending intelligence to the edge 12 Hardware is back (and never really 02 went away) 56 From workforce to crowdsource: 05 The rise of the borderless enterprise 28 The business of applications: 2 03 Software as a core competency Data supply chain: in a digital world 72 Putting information into circulation 42 06 Architecting resilience: “Built to survive failure” becomes the mantra of the nonstop business 84 CONCLUSION 98 RESEARCH METHODOLOGY 102 END NOTES 104 CONTACTS 111 #techvision2014 FOREWORD FOREWORD When we declared “every business is a digital business” in the Accenture Technology Vision 2013, we didn’t see it as a trend for last year or this year. We saw it as the future. The future of technology. The future of business. Enterprises are embracing technology in the way they do The future of our increasingly interconnected and business and also as a catalyst to create something new— interdependent world. new markets, new products, and new areas of growth Last year, we saw the beginnings of business transformation and revenues. based on a digital model. Organizations looking to The change is revolutionary. Industrial companies are reimagine themselves in a technology-driven world set becoming customer service companies. Consumer forth on their journey to becoming digital businesses. 3 products companies are becoming Internet companies. Many organizations were experimenting, while others Energy companies are becoming information companies. were making larger investments. But all were counting Pierre Nanterme And media and entertainment companies are becoming Chairman & CEO on technology to fuel their next waves of growth.
    [Show full text]
  • Open Computing Is for Everyone and Is Here to Stay
    Publication date: 27 July 2021 Author: Vladimir Galabov Open Computing is for Everyone and is Here to Stay A blueprint for how the open source community is driving global innovation Brought to you by Informa Tech Commissioned by: Brought to you by Informa Tech Open Computing is for Everyone and is Here to Stay 01 Contents Catalyst 2 Open computing is born 3 Adoption takes off 9 Latest open compute initiatives 13 Conclusion and recommendations 16 Appendix 18 © 2021 Omdia. All rights reserved. Unauthorized reproduction prohibited. Open Computing is for Everyone and is Here to Stay 02 Catalyst Over the last 20 years, the world has become more and more digital and the data center (DC) has become key to business success, especially when it comes to the skyrocketing e-commerce, internet content, and cloud services industries. The larger the scale, the bigger the impact simple design improvements have, be that in the physical or IT aspects of a data center. It is no surprise then that, as companies like Facebook, Amazon, and Alibaba became leaders in digital industry, the re- engineering of their DC equipment became a top priority. Three design considerations stand out: power efficiency, manageability, and ease of deployment. In 2009, Facebook began an initiative to design its own DC IT and physical equipment to create the world’s most energy-efficient data center that would enable hyperscale computing at the lowest cost possible. Two years later, it shared its designs and results with the public, demonstrating a data center that was 38% more energy efficient with a 24% reduction in operational expenditure (opex).
    [Show full text]
  • Accenture Technology Vision 2014 Every Business Is a Digital Business from Digitally Disrupted to Digital Disrupter CONTENTS
    Accenture Technology Vision 2014 Every Business Is a Digital Business From Digitally Disrupted to Digital Disrupter CONTENTS FOREWORD 3 INTRODUCTION 4 TRENDS 01 04 Digital–physical blur: Harnessing hyperscale: Extending intelligence to the edge 12 Hardware is back (and never really 02 went away) 56 From workforce to crowdsource: 05 The rise of the borderless enterprise 28 The business of applications: 2 03 Software as a core competency Data supply chain: in a digital world 72 Putting information into circulation 42 06 Architecting resilience: “Built to survive failure” becomes the mantra of the nonstop business 84 CONCLUSION 98 RESEARCH METHODOLOGY 102 END NOTES 104 CONTACTS 111 #techvision2014 FOREWORD FOREWORD When we declared “every business is a digital business” in the Accenture Technology Vision 2013, we didn’t see it as a trend for last year or this year. We saw it as the future. The future of technology. The future of business. Enterprises are embracing technology in the way they do The future of our increasingly interconnected and business and also as a catalyst to create something new— interdependent world. new markets, new products, and new areas of growth Last year, we saw the beginnings of business transformation and revenues. based on a digital model. Organizations looking to The change is revolutionary. Industrial companies are reimagine themselves in a technology-driven world set becoming customer service companies. Consumer forth on their journey to becoming digital businesses. 3 products companies are becoming Internet companies. Many organizations were experimenting, while others Energy companies are becoming information companies. were making larger investments. But all were counting Pierre Nanterme And media and entertainment companies are becoming Chairman & CEO on technology to fuel their next waves of growth.
    [Show full text]
  • Enterprise Cloud Strategy 2Nd Edition
    Barry Briggs Eduardo Kassner Enterprise Cloud Strategy 2nd Edition Microsoft Press PUBLISHED BY Microsoft Press A division of Microsoft Corporation One Microsoft Way Redmond, Washington 98052-6399 Copyright © 2017 by Microsoft Corporation All rights reserved. No part of the contents of this book may be reproduced or transmitted in any form or by any means without the written permission of the publisher. Microsoft Press books are available through booksellers and distributors worldwide. If you need support related to this book, email Microsoft Press Support at [email protected]. Please tell us what you think of this book at http://aka.ms/tellpress. This book is provided “as-is” and expresses the author’s views and opinions. The views, opinions and information expressed in this book, including URL and other Internet website references, may change without notice. Some examples depicted herein are provided for illustration only and are fictitious. No real association or connection is intended or should be inferred. Microsoft and the trademarks listed at http://www.microsoft.com on the “Trademarks” webpage are trademarks of the Microsoft group of companies. All other marks are property of their respective owners. Acquisitions Editor: Janine Patrick Developmental Editor: Bob Russell, Octal Publishing, Inc. Editorial Production: Dianne Russell, Octal Publishing, Inc. Copyeditor: Bob Russell Defining correct enterprise cloud strategy is a complex task that is easy to understand but hard to master. That is why the Enterprise Cloud Strategy book represents one of the best publications for cloud experts who want to learn how to shape the efficient enterprise cloud transformation. This book provides a clear yet deep level of detail on all aspects of cloud strategy, offering a large collection of case studies and repeatable patterns, and even providing cloud architectural blueprints to accelerate specific cloud use cases.
    [Show full text]
  • Data Center Optimization Planning Guide
    PLANNING GUIDE Data Center Optimization Evaluating Your Data Center Strategy to Optimize Cloud Service Delivery and Move toward a Software-Defined Infrastructure WHY YOU SHOULD READ THIS DOCUMENT This planning guide provides IT managers with insight on why you should optimize your data center to deliver competitive advantage and: • Achieve operational efficiency • Deliver modern services such as cloud computing • Take advantage of new business opportunities such as big data, high-performance computing, enterprise mobility, and social and collaborative computing Most importantly, this guide offers practical guidance for getting started on your data center optimization effort in four steps that comprise: • Creating a data center strategy • Enabling an agile IT organization through virtualization and cloud • Building out a cloud and turning IT into a broker of services • Measuring your success Contents 3 Data Centers under Stress 5 A Balanced and Optimized Data Center 7 How to Optimize your Data Center: Four Steps 12 Setting the Foundation for Software-Defined Infrastructure 14 Case Study: Intel IT 15 Summary 16 Next Steps: Where Are You in the Data Center Optimization Process? 17 Intel Resources for Learning More Data Centers under Stress These days, IT is expected to serve as a strategic partner Aging Infrastructure Isn’t Helping for business innovation, while at the same time keeping the business running and reducing operating costs. At the Cost or Performance focal point of this dilemma is the data center, traditionally The most recent economic downtown has left many data centers a workhorse for enterprises that increasingly need more of behind in their infrastructure upgrade cycle.
    [Show full text]