Of Traditional Storage?
Total Page:16
File Type:pdf, Size:1020Kb
Table of Contents Introduction ................................................................................................................................ 4 Storage Solutions for Cloud-Based Information Services: Is SAN Dead for Cloud? ................... 6 What Is Cloud Computing? ..................................................................................................... 6 Cloud Computing from the Perspective of Storage Services ................................................... 6 Cloud Friendly and Unfriendly Applications ............................................................................ 7 Cloud Data Management Interface ......................................................................................... 8 Impact of Cloud Computing Requirements on Development of Storage Technologies ........... 9 DAS Solutions for Cloud ........................................................................................................10 Just DAS ............................................................................................................................10 High-Availability DAS .........................................................................................................10 Distributed Host-Cache ......................................................................................................11 SAN Solutions for Cloud ........................................................................................................12 Transformation of SAN Solutions Driven by Cloud Requirements ......................................12 “Cloudization” of Existing Storage Solutions .......................................................................13 VCE: Integrated Infrastructure-as-a-Service Solution .........................................................13 Scale-up vs. Scale-out Solutions ...........................................................................................15 Object-Based Storage ...........................................................................................................16 Atmos ................................................................................................................................18 Open Source Solutions and Cloud Computing ..........................................................................21 Storage Solutions in OpenStack ............................................................................................21 Comparison of Object-Based Storage with Features Required for Enterprise Class Storage Service ..................................................................................................................................24 Software-Defined Storage .........................................................................................................26 Symbiosis of HA DAS and SDS .............................................................................................29 NAS and Cloud .........................................................................................................................29 Data Mobility in Clouds .............................................................................................................29 Cloud Storage Gateways and EMC Cloud Tiering Appliance .................................................30 Big Data Meets Cloud Data .......................................................................................................31 Isilon Storage for Big Data .....................................................................................................35 EMC Greenplum Distributed Computing Appliance (DCA) .....................................................35 Object-Based Storage for Big Data ........................................................................................36 Fabric Storage for Big Data: SAN Functionality at DAS Pricing .............................................36 2013 EMC Proven Professional Knowledge Sharing 2 Conclusions ..............................................................................................................................37 References ...............................................................................................................................38 Disclaimer: The views, processes, or methodologies published in this article are those of the author. They do not necessarily reflect EMC Corporation’s views, processes, or methodologies. 2013 EMC Proven Professional Knowledge Sharing 3 Introduction How can a large company transform the storage services it currently uses to make them function as storage services for a private and/or hybrid cloud as well? If the ability to provide storage on demand is considered the key feature of cloud storage, what changes are required in the traditional storage infrastructure based on enterprise (i.e. EMC VMAX®) and midrange (i.e. VNX®) storage platforms to deliver cloud-based storage services? Companies have heavily invested in conventional storage systems and the question of how these systems can be re- used for cloud solutions becomes critical for development of the company IT infrastructure road map. Should traditional storage systems oriented to management of structured data be kept only for transactionally-consistent applications? Or can they be upgraded to become storage components of a new cloud infrastructure? What features make storage “cloud storage”? What are the evolving cloud storage standards (Cloud Data Management Interface [CDMI], etc.)? This Knowledge Sharing article will try to answer these questions although the author understands that this search for answers may lead to more questions. Recent years have witnessed the advent of two new phenomena in IT: cloud computing and Big Data. These two tectonic changes have been driven by business needs. They require new architectures and new service solutions and have affected all major components of IT infrastructure: server → server virtualization, network → network virtualization and software- defined network, storage → storage virtualization and software-defined storage, and security → security for cloud computing. In this article, I discuss cloud computing and Big Data only to the extent warranted by the discussion of the changes in storage services and technologies caused by these new phenomena. The reader can find many detailed reviews of cloud computing and Big Data storage in various publications, including books. I have included some of these publications in the References section.1-4 While we all agree that cloud-based storage and Big Data require new storage architectures that may be radically different from traditional storage infrastructure, there are arguments about the scope of these changes. Does it mean a “rip & replace” of the existing storage ecosystems? A Forrester publications posed a question in its title: “Do You Really Need a SAN Anymore?”4 Has Direct-Attached Storage (DAS) come back in new incarnations such as HA-DAS, “application-centric storage”, “software-defined storage”, etc.? 2013 EMC Proven Professional Knowledge Sharing 4 In my opinion, all of these storage technologies and solutions based on them are complementary to each other as there is a very broad spectrum of applications and services requirements which existing and emerging storage solutions have to meet. From a philosophical perspective, the evolution of storage solutions is an example of a dialectic process driven by internal contradictions and negation (thesis, antithesis) that lead to further development by synthesis. Conflict between the thesis and antithesis is solved by the progress from quantity to quality, the negation of the initial development of the status quo, the negation of that negation, and then by reconciling the common features at a higher level.5 In terms of economics, it can be seen as an example of "creative destruction," the term used in economics to describe the way in which capitalist economic development arises out of the destruction of some prior economic order.6 The goal of this article is to provide a brief overview of the holistic guidelines that can help readers select storage technologies for implementation of cloud-based information services and Big Data solutions. 2013 EMC Proven Professional Knowledge Sharing 5 Storage Solutions for Cloud-Based Information Services: Is SAN Dead for Cloud? What Is Cloud Computing? We have to start with the definition of cloud computing. The definition offered by NIST is the most widely accepted: “Cloud computing is a model for enabling ubiquitous, convenient, on- demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. This cloud model is composed of five essential characteristics, three service models, and four deployment models.”7 The essential characteristics are: On-demand self-service Broad network access Resource pooling Rapid elasticity Measured service Note that the cloud-computing definition does not refer to any specific technologies. Rather, it is a model for the use of “a shared pool of configurable computing resources.”7 What is important for us when we consider the storage component of cloud services is rapid elasticity, resource pooling, measured service, and on-demand self-service. Cloud Computing from the Perspective of Storage Services The storage solution we choose for our cloud implementation should have the above