RAID Is Certainly Not Dead but Its Future Looks Small,My

Total Page:16

File Type:pdf, Size:1020Kb

RAID Is Certainly Not Dead but Its Future Looks Small,My RAID is Certainly not Dead But Its Future Looks Small The month of October saw a sizeable uptick in the readership of a blog entry that appeared nearly two years ago on DCIG’s website on the topic of data loss on SATA storage systems. While this blog entry received a fair amount of interest when it was first published, exactly what prompted a resurgence of interest in this topic this month is unclear. Maybe it is just an anomoly driven by the whimsical interests of Internet users who are for whatever reason searching on this topic, finding this blog entry and then reading it. However it may be a more ominous indication that SATA disk drives, which became popular 2 – 3 years ago in enterprises, are wearing out and that the traditional RAID technologies used to protect them are failing. As a result, users are looking for information as to why RAID, in some circumstances, is not doing the job in their environment. The death of RAID (or at least RAID 5) has previously been forecast by some analysts. But even now, when I look at the features of new storage arrays, the number of RAID options that they support is always prominently mentioned. A good example is earlier this week Overland Storage announced its new SnapSAN S1000. It offered at least 10 different possible ways that RAID could be configured (including RAID 5) on a storage array that starts under $10K in price so do not tell me that RAID is dead or even on its last legs. But there is no disputing that the capacities of SATA disk drives are forecast and expected to cross the 4, 8, 16 and 32 TB thresholds over the next decade. As that occurs, it becomes questionable if current RAID technologies are adequate to protect these size disk drives. If the increased interest in DCIG’s 2008 blog entry is any indication, it would appear no. So am I predicting the death of RAID? Clearly I am not. RAID technology is as much a part of the storage landscape as tape and odds are that innovation will continue to occur in RAID that will make it a relevant technology for the foreseeable future. Yet it was clear from speaking to a few users and storage providers in attendance at Storage Networking World (SNW) in Dallas, TX, earlier this month, that new approaches to protecting data stored on larger capacity SATA disk drives are going to be needed in the next decade in order to meet their anticipated needs. One specific company that I met with at length while at SNW was a company called Amplidata. It is already innovating in this space to overcome two of the better known limitations of RAID to include. The increasing length of time to rebuild larger capacity drives. Rebuild times for 2 TB drives are already known to take four hours or longer to complete though I have heard that in some cases, depending on how busy the storage system is, it can take days for a rebuild of a disk drive of this size to finish. The need to keep all disks in its RAID group spinning so no power savings can be realized. Spin down is likely to become more important in the years to come as more data is archived to disk. Intelligently managing data placement is likely to become a function of the storage array as opposed to the software to facilitate the spin down of these drives. So what Amplidata’s AmpliStor does is distribute and store data redundantly across a large number of disks. The algorithm that AmpliStor uses first puts the data into an object and then stores the data across multiple disks in the AmpliStor system. By storing the data as an object, Amplidata can reconstruct the original data from any of the disks on which the data within the object resides. This technique eliminates the growing concerns about the rebuild times associated with large disk drives since the original data can be retrieved and reconstructed even if a one, two or even more disks fail. Also, should disk drives in the system be spun down to save energy, they do not need to be spun up to retrieve needed data since the data can be retrieved and reconstructed from other spinning disks on the system. While it unlikely that AmpliStor or its underlying technology will be widely adopted in the next few year, the simple fact is that increasing capacities of disk drives will eventually make technologies like what AmpliStor has embedded inside of it a prerequisite in almost any high capacity enterprise storage system. So in the same way that enterprise storage vendors started to adopt RAID 6 about five years ago to prevent the loss of data should two SATA drives fail, look for some variation of the technology that Amplidata has implemented in its AmpliStor to begin to find its way into enterprise storage systems over the next decade to prevent the loss of data on these ever largeer disk drives. At the same time, expect RAID to find a new home on smaller storage arrays where the level of protection and speed of recovery that RAID provides should be more than adequate. My introduction to HP's Converged Infrastructure As 3PAR is integrated into HP, there is a lot of new stuff to for us to figure out. One of the most important concepts at HP is Converged Infrastructure (CI). The basic idea of CI is to maximize a customer's investement in technology by consolidating resources in common, modular building blocks. 3PAR customers are already accustomed to the idea from with our InServ storage systems, but CI goes far beyond 3PAR's storage vision by including server and network technologies. It's a big idea with huge implications for product engineering, manufacturing, maintenance and support – and it raises the importance of software in data center solutions. As 3PAR is integrated into HP, there is a lot of new stuff to for us to figure out. One of the most important concepts at HP is Converged Infrastructure (CI). The basic idea of CI is to maximize a customer's investement in technology by consolidating resources in common, modular building blocks. 3PAR customers are already accustomed to the idea from with our InServ storage systems, but CI goes far beyond 3PAR's storage vision by including server and network technologies. It's a big idea with huge implications for product engineering, manufacturing, maintenance and support – and it raises the importance of software in data center solutions. InMage vContinuum Taps into VMware to Provide a Near Zero Impact and Recovery Solution for SMBs Small and medium businesses (SMBs) are rapidly moving towards virtualizing their physical servers using VMware. But as they do so, they are also looking to minimize the cost, complexity and overhead that the backup of VMware servers introduces while increasing their ability to recover their newly virtualized applications. It is these concerns that InMage’s new vContinuum software addresses by using a new technique to tap into VMware that provides near zero impact backups with near real time recoveries. Right now Gartner estimates that as many as 28% of all physical servers currently run virtualization with that percentage expected to grow to 50% by 2012. Further, it is expected that server virtualization among SMBs (companies with fewer than 999 employees and less than $500 million in revenue) will grow much faster than the overall market during this same period of time. The problem that these SMBs are encountering as they adopt server virtualization is automating the non-disruptive protection and recovery of VMware’s guest OSes. While backup software providers have adapted to take advantage of new backup techniques as well as new features found in VMware vSphere, these approaches still have the following shortcomings: Array based snapshots. Snapshots move backup overhead off the host but require the deployment of an external storage array of the same or similar kinds- not always a cost-effective or practical option for SMBs. VMware vStorage APIs for Data Protection. vSphere’s new vStorage APIs can create snapshots on the vSphere host without the need for external storage. However backing up the snapshot still creates overhead on the primary storage used by the VMware host. vSphere Change Block Tracking (CBT).CBT was also included with VMware vSphere 4.0 and tracks changes to blocks on a VM since its last backup. While it eliminates the need for external storage, it is not enabled by default plus it incurs server overhead when turned on and is not widely supported by backup applications. VMware Site Recovery Manager (SRM). Primarily used for highly available and clustered configurations, it requires compatible arrays on both local and remote sites with separate management of replication and recovery policies. This means additional learning curves and load on already constrained IT resources plus the storage requirements alone usually put the cost of this solution beyond the reach of most SMBs. Each of these techniques introduces varying levels cost, complexity or overhead or, in some cases, a combination of all three in order to be implemented in a VMware environment. It is these challenges that InMage’s new vContinuum software addresses. vContinuum is based upon InMage’s existing and proven enterprise data protection software that is already in use by many enterprise organizations and resold by enterprise storage providers. However, InMage has specifically built vContinuum for VMware implementations in SMB environments in the following ways: First, vContinuum integrates with VMware at the hypervisor level to discover, provision and manage protection policies at a VM granularity.
Recommended publications
  • View Annual Report
    TO OUR SHAREHOLDERS, CUSTOMERS, PARTNERS AND EMPLOYEES: It is a humbling experience to write this letter to you as only the third CEO in Microsoft’s history. As I said when I took this role, I originally joined Microsoft to have an opportunity to change the world through technology and empower people to do amazing things. Many companies aspire to change the world, but very few have the talent, resources and perseverance of Microsoft. I believe this is a landmark moment for the company and for our industry as a whole. Cloud and mobile technologies are redefining how people work and play. Three billion people will soon be connected to Internet-enabled devices; 212 billion sensors will come online in a few short years; trillions will be spent in consumer and business technologies. But it’s not about technology for technology’s sake! It’s our mission to enable the use of technology to realize the true potential of people, teams and organizations. As I shared in my email to employees in July, we will be the productivity and platform company for this mobile-first and cloud-first world. We will empower every person and every organization on the planet to do more and achieve more. And we will accomplish this by building incredible Digital Work and Life Experiences, supported by our Cloud Operating System, the Device Operating System and Hardware platforms. In the same way that we aspired to and achieved our original vision of a PC on every desk and in every home, we will reinvent productivity. This clarity of purpose and boldness of our aspiration inspires me and all of us at Microsoft.
    [Show full text]
  • Hybrid Cloud Infrastructure-As-A-Service (Iaas) Antonius Susanto | Partner Business & Development Lead | Microsoft
    Hybrid Cloud Infrastructure-as-a-Service (IaaS) Antonius Susanto | Partner Business & Development Lead | Microsoft Cloud Channel Summit 2015 | @rhipecloud #RCCS15 75% 49% ~49%75%10K40%new allowgrowth of federal work personal in & 62%93%80%only can’t ofof 24% employeesemployees use info requiresmobileindustryglobal data devices networkregulations for foradmitare effectivehave ineffective to a violating BYOD decision at - 10K 40% contributionbusinesscreatedgenerated in use last/ year 5 years making!compliancecollaboration!policy in place policies ¥ Computing Technology Industry Association's (CompTIA) 2nd annual Trends in Enterprise Mobility study from February 2013. *The Future of Corporate IT 2013-2017 ** CEB Survey of 165,000 employees †2012 Survey on Self-Service BI and Analytics, Unisphere Research 2017 $107Bil 67% 84% Spending on public IT cloud services $107 59%84%67% oflookwant customers toan their established cloud expect provider relationshipto for is expected to be more than planning,withpurchase a vendor aintegration wide to varietytrust and them of ongoing cloud as a Cloud Billion 59% management$107BillionServiceservices Provider from ain single 2017 vendor Datacenters are being transformed 71% 70% 45% of companies see of CIOs will embrace of total IT services will rising demand for IT a “cloud first" strategy be spent on cloud projects in 2013 in 2016 services by 2020 -InformationWeek -IDC -Forrester Sources: “Outlook 2013,” InformationWeek Report, 12/06/2012; “Worldwide CIO Agenda 2013 Top 10 Predictions,” IDC, doc #238464,
    [Show full text]
  • Using EMC VNX Storage with Vmware Vsphere Techbook CONTENTS
    Using EMC® VNX® Storage with VMware vSphere Version 4.0 TechBook P/N H8229 REV 05 Copyright © 2015 EMC Corporation. All rights reserved. Published in the USA. Published January 2015 EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC2, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other countries. All other trademarks used herein are the property of their respective owners. For the most up-to-date regulatory document for your product line, go to EMC Online Support (https://support.emc.com). 2 Using EMC VNX Storage with VMware vSphere TechBook CONTENTS Preface Chapter 1 Configuring VMware vSphere on VNX Storage Technology overview................................................................................... 18 EMC VNX family..................................................................................... 18 FLASH 1st.............................................................................................. 18 MCx multicore optimization..................................................................
    [Show full text]
  • RECOVER Recover Systems Directly from Networker Backups
    NBMR RECOVER Recover systems directly from NetWorker backups With Cristie NBMR you can protect critical servers from the consequences of failure or disaster by recovering them directly from your EMC NetWorker backups. Recover your protected servers, including; operating systems, applications, user configuration and data to any point in time provided by NetWorker. Highlights Features Benefits 9 Leverage existing NetWorker 9 Saves storage space, network Integrated system backups without extra infrastructure, bandwidth, processing power and recovery or management management resources Point in time 9 Recover to any point in time 9 Recoveries can be rolled back to a recoveries provided by the NetWorker backups time before the disaster occurred 9 Supports Windows, Linux, AIX and Support for multiple 9 Most systems can be protected Solaris and dissimilar hardware, OS and cloud using NBMR virtual and cloud environments 9 Recover entire workloads including; 9 The recovered machine does not Recovered system OS, applications, data and need to be calibrated and tuned to identical configuration information run as it did before 9 Improve recovery time objectives 9 Meet aggressive service level by restoring your server in as little as Fast recovery times agreements recovery time and point ten minutes. Multiple servers can be objectives recovered simultaneously Flexible recovery 9 Recover to a range of system 9 Flexibility to suit most environments targets recovery targets Remote 9 Manage multiple, simultaneous 9 Easy, secure, mobile access management system recoveries on site, or remotely 9 NBMR is re-sold globally by EMC Recommended 9 NBMR is a recommended recovery and its channel partners as a solution solution for NetWorker recommended recovery solution for NetWorker Support is very cooperative and give a timely response to any technical issues raised with them.
    [Show full text]
  • DMFS - a Data Migration File System for Netbsd
    DMFS - A Data Migration File System for NetBSD William Studenmund Veridian MRJ Technology Solutions NASAAmes Research Center" Abstract It was designed to support the mass storage systems de- ployed here at NAS under the NAStore 2 system. That system supported a total of twenty StorageTek NearLine ! have recently developed DMFS, a Data Migration File tape silos at two locations, each with up to four tape System, for NetBSD[I]. This file system provides ker- drives each. Each silo contained upwards of 5000 tapes, nel support for the data migration system being devel- and had robotic pass-throughs to adjoining silos. oped by my research group at NASA/Ames. The file system utilizes an underlying file store to provide the file The volman system is designed using a client-server backing, and coordinates user and system access to the model, and consists of three main components: the vol- files. It stores its internal metadata in a flat file, which man master, possibly multiple volman servers, and vol- resides on a separate file system. This paper will first man clients. The volman servers connect to each tape describe our data migration system to provide a context silo, mount and unmount tapes at the direction of the for DMFS, then it will describe DMFS. It also will de- volman master, and provide tape services to clients. The scribe the changes to NetBSD needed to make DMFS volman master maintains a database of known tapes and work. Then it will give an overview of the file archival locations, and directs the tape servers to move and mount and restoration procedures, and describe how some typi- tapes to service client requests.
    [Show full text]
  • Setting up Rep Pair
    InMage Scout Standard Release Notes Version – 8.0.1 GA Table: Document History Document Document Remarks Version Date 1.0 March 1, 2015 Standard version 1.1 April 7, 2015 Minor update 1.2 Nov 20 ,2015 Updated CX and vContinuum MT known issues and limitations sections. 2 Contents 1 Disclaimer of Warranty .................................................................................................................................... 4 2 About this document ........................................................................................................................................ 4 3 Overview ............................................................................................................................................................. 5 3.1 Scout ........................................................................................................................................................ 5 3.2 ScoutCloud RX ....................................................................................................................................... 5 4 What’s new in this release? ............................................................................................................................. 5 5 Upgrade Path ...................................................................................................................................................... 5 5.1 Agents ....................................................................................................................................................
    [Show full text]
  • Data Protection and Recovery in the Small and Mid-Sized Business (SMB)
    Data Protection and Recovery in the Small and Mid-sized Business (SMB) An Outlook Report from Storage Strategies NOW By Deni Connor, Patrick H. Corrigan and James E. Bagley Intern: Emily Hernandez October 11, 2010 Storage Strategies NOW 8815 Mountain Path Circle Austin, Texas 78759 Note: The information and recommendations made by Storage Strategies NOW, Inc. are based upon public information and sources and may also include personal opinions both of Storage Strategies NOW and others, all of which we believe are accurate and reliable. As market conditions change however and not within our control, the information and recommendations are made without warranty of any kind. All product names used and mentioned herein are the trademarks of their respective owners. Storage Strategies NOW, Inc. assumes no responsibility or liability for any damages whatsoever (including incidental, consequential or otherwise), caused by your use of, or reliance upon, the information and recommendations presented herein, nor for any inadvertent errors which may appear in this document. This report is purchased by Geminare, who understands and agrees that the report is furnished solely for its internal use only and may not be furnished in whole or in part to any other person other than its directors, officers and employees, without the prior written consent of Storage Strategies NOW. Copyright 2010. All rights reserved. Storage Strategies NOW, Inc. 1 Sponsor 2 Table of Contents Sponsor ..................................................................................................................................................................
    [Show full text]
  • [1 ] Storagetek Automated Cartridge System
    StorageTek[1] Automated Cartridge System Library Software Product Information Release 8.4 E62371-05 March 2018 StorageTek Automated Cartridge System Library Software Product Information, Release 8.4 E62371-05 Copyright © 2015, 2018, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs.
    [Show full text]
  • Networker Data Domain Integration Guide
    PROTECTING IT WITH NETWORKER Aaron Kleinsmith Principal Technical Instructor EMC [email protected] Table of Contents Protecting the Modern Information Technology Environment .......................................... 5 NetWorker Modules......................................................................................................... 7 Diagram 1: NetWorker Module Backups .................................................................. 7 NetWorker Module for Microsoft .................................................................................. 8 NetWorker Module for Databases and Applications ..................................................... 8 Other NetWorker Modules ........................................................................................... 8 Configuring the NetWorker Modules ............................................................................ 9 NetWorker Snapshot Management and Block Based Backup ......................................... 9 When would these different snapshot technologies be used? ...................................... 9 NetWorker Snapshot Management for NAS .................................................................. 10 NetWorker and Windows Bare Metal Recovery ............................................................. 10 Data Domain ................................................................................................................. 12 Data Domain CIFS and NFS ..................................................................................... 12
    [Show full text]
  • Compass™ Virtual Tape Library a High-Performance, Software-Defined Backup Solution to Manage Your Existing Infrastructure’S Tape Libraries
    COBALT IRON DATASHEET Compass™ Virtual Tape Library A high-performance, software-defined backup solution to manage your existing infrastructure’s tape libraries FEATURES What is Compass VTL Fully integrated VTL functionality within The VTL market is at the precipice of disruption where organizations are now directed to Compass data protection modernize and unify the enterprise data protection environment. Customers still have platform requirements for tape operations but they require operational simplicity and cost Eliminate physical tape effectiveness. Cobalt Iron introduces a software-defined VTL that is fully integrated media, transport, and into its Compass SaaS platform. Unlike any other VTL solution, Compass VTL is a storage costs software-enabled feature that is directly integrated within an end-to-end data protection Fully automated backup, restore, and disaster solution. With Compass VTL, organizations can deploy a single, unified solution that recovery of virtual tape unleashes data from traditional physical and virtual tape data silos all while modernizing libraries, drives, and tape environments which require tape resources for backup and recovery. Emulates multi-platform, heterogeneous tape environments Compass VTL Benefits Leverage multi-tier storage both on-premises and in the cloud Intelligently scales locally SIMPLICITY FEATURES SAVINGS and in the cloud Direct VTL integration Enterprise data protection With Compass VTL, organizations Incorporates AES 256 bit encryption and with industry-leading solution delivered in
    [Show full text]
  • Commvault Backup Appliance with Netapp a Powerful Combination of Commvault Simpana® Software and Netapp E-Series Storage
    CommVault Backup Appliance with NetApp A powerful combination of CommVault Simpana® software and NetApp E-Series storage Two leaders in data protection software and hardware have partnered to bring you a best-of-breed solution that closes the scalability, flexibility and manageability gaps in current offerings. You get powerful scalability • Plug-and-play scaling for capacity and compute power • Scale without reconfiguration • Software AND hardware resiliency • Rapid restores across simultaneous jobs You get broad flexibility • Choose a single appliance for smaller environments • Deploy multiple appliances for medium to large environments • Improve performance and resiliency through load balancing You get simple, comprehensive management • Central management, reporting and software deployment • Self-service access • Integration with NetApp E-Series node management COMMVAULT.COM | 888.746.3849 | [email protected] © 2015 COMMVAULT SYSTEMS, INC. ALL RIGHTS RESERVED. Two industry leaders. One truly integrated solution. COMMVAULT EMC AVAMAR/ SYMANTEC NETBACKUP FEATURE BENEFIT SIMPANA DATA DOMAIN APPLIANCES VM LIFECYCLE Manage the complete Y PARTIAL PARTIAL MANAGEMENT VM lifecycle from provisioning and monitoring to backup and replication to VM archiving and retirement DEDUPLICATION Inexpensively delivers Y PARTIAL N RESILIENCY WITH software load balancing PARALLEL and resiliency to DEDUPLICATION complement hardware availability SIMPANA ONEPASS™ Saves time, money Y N N SINGLE PASS BACKUP, and resources FILE ARCHIVING AND REPORTING ENDPOINT
    [Show full text]
  • Microsoft Azure
    Yesterday Datacenter, hardware, individual servers, and VMs Slow, expensive innovation Siloed infrastructure and operations Development constraints Tactical and reactive thinking Today and tomorrow People, cloud, apps, service-focused Standardized, automated processes and configurations Industry-standard, low-cost hardware Fast, cost-effective innovation, developer empowerment Holistic, strategic thinking Bringing the cloud to you What if you could have the control of the datacenter and the power of the cloud? Reduced developer chaos and shadow IT Simplified, abstracted experience Added consistency to modern development One portal, one user experience Write once, deploy anywhere Microsoft Azure Microsoft Private Cloud Microsoft Azure (on premises | hosted) Microsoft Private Cloud Microsoft Azure (on premises | hosted) MicrosoftMicrosoft Private Azure StackCloud Microsoft Azure (on(on(on- -premisespremisespremises/hosted) || hosted)hosted) App innovation MicrosoftMicrosoft Private Azure StackCloud Microsoft Azure (on(on -premisespremises/hosted) | hosted) Cloud-optimized application platform Cloud-consistent service delivery Cloud-inspired hybrid infrastructure MicrosoftMicrosoft Private Azure StackCloud (on(on -premisespremises/hosted) | hosted) . Server Roles/Features GUI Shell Windows/ Minimal Server Full Server WindowsNT Interface Server Core Server Core Windows NT to Windows Server 2008 Windows Server 2012 Windows Server and and 2003 Windows Server 2008 R2 Windows Server 2012 R2 . Basic Client . Experience . Server with Local Admin
    [Show full text]