Dell Fluid File System V3.0

Total Page:16

File Type:pdf, Size:1020Kb

Dell Fluid File System V3.0 Dell Fluid File System v3.0 A Dell Technology White Paper Dell Product Group June 2013 DELL TECHNOLOGY WHITE PAPER: Dell Fluid File System v3.0 THIS TECHNOLOGY WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND. © 2013 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express written permission of Dell Inc. is strictly forbidden. For more information, contact Dell. Dell, the DELL logo, and the DELL badge, EqualLogic, Compellent, PowerVault and NetVault are trademarks of Dell Inc. Microsoft and Windows are either trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Symantec, BackupExec, and NetBackup are trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. CommVault and Simpana are registered trademarks of CommVault Systems, Inc. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and trade names other than its own. June 2013, version 3.0 DELL TECHNOLOGY WHITE PAPER: Dell Fluid File System v3.0 Contents 1 Abstract ............................................................................................................................................................... 4 2 Dell Fluid File System Architecture ................................................................................................................. 5 2.1 Layered Approach to FluidFS Logical Architecture ........................................................................... 5 2.1.1 Network Load-Balancing Layer ....................................................................................................... 5 2.1.2 File Protocol Access ........................................................................................................................... 6 2.1.3 NAS Volumes ....................................................................................................................................... 6 2.1.4 NAS Pool .............................................................................................................................................. 6 2.1.5 Block Device LUNs .............................................................................................................................. 7 2.2 The Physical Building Blocks .................................................................................................................. 7 2.2.1 NAS Appliance ...................................................................................................................................... 7 2.2.2 Back-end SAN Storage ...................................................................................................................... 8 2.3 Summary ................................................................................................................................................... 8 3 Data Integrity ....................................................................................................................................................... 10 3.1 Cache Mirroring and Metadata ........................................................................................................... 10 3.2 High availability ...................................................................................................................................... 10 3.3 Summary ................................................................................................................................................. 10 4 Data Protection ................................................................................................................................................. 11 4.1 Snapshots ................................................................................................................................................. 11 4.2 Backups .................................................................................................................................................... 11 4.3 Replication ...............................................................................................................................................12 4.4 Summary ..................................................................................................................................................12 5 Data Reduction .................................................................................................................................................13 5.1 Data Deduplication .................................................................................................................................13 5.2 Compression ...........................................................................................................................................13 5.3 Summary ................................................................................................................................................. 14 6 Fluid File System Solutions ............................................................................................................................. 15 6.1 Dell Compellent ...................................................................................................................................... 15 6.1.1 FS8600 ................................................................................................................................................ 15 6.2 Dell EqualLogic ...................................................................................................................................... 16 6.2.1 FS76x0 ................................................................................................................................................ 16 7 Summary ............................................................................................................................................................ 17 7.1 Additional Reading .................................................................................................................................. 17 DELL TECHNOLOGY WHITE PAPER: Dell Fluid File System v3.0 1 Abstract Traditional approaches to handling file data growth have proven to be costly, hard to manage, and difficult to scale effectively and efficiently. Dell™ Fluid File System (FluidFS) is designed to go beyond the limitations of traditional file systems with a flexible architecture that enables organizations to scale out and scale up non-disruptively. Hence, it addresses organizational challenges by allowing them to gain control of their data, reduce complexity, and meet growing data demands over time. The FluidFS architecture is an open-standards based network attached storage (NAS) file system that supports industry standard protocols including NFS v4 and CIFS/SMB v2.1. It provides innovative features proving high availability, performance, efficient data management, data integrity, and data protection. As a core component of the Dell Fluid Data architecture, FluidFS brings differentiated value to the various Dell storage offerings including the Dell Compellent FS8600 and FS8610 as well as the Dell EqualLogic FS7600 and FS7610. Continue reading to learn about additional features and enhancements that make it unique from other NAS products available in the market today. 4 DELL TECHNOLOGY WHITE PAPER: Dell Fluid File System v3.0 2 Dell Fluid File System Architecture The relentless growth of unstructured file data is accelerating the need for network file storage systems. Organizations coping with data growth are confronted with several challenges: Data silos prevent easy access to vital business information. Data migration, backup, and disaster recovery are complex, consuming administrative time and resources. Meeting data growth by deploying more and more storage systems increases both the administrative burden and capital expenditure at a time when businesses need to run lean. Traditional file systems have scalability limitations that make them unwieldy for organizations with rapidly expanding file data. FluidFS is an enterprise-class, fully distributed file system that provides customers with the tools necessary to manage file data in an efficient and simple manner. The underlying software architecture leverages a symmetric clustering model with distributed metadata, native load balancing, advanced caching capabilities and a rich set of enterprise-class features. FluidFS removes the scalability limitations such as limited volume size associated with traditional file systems and supports high capacity, performance-intensive workloads via scaling up (adding capacity to the system) and by scaling out (adding nodes, or performance, to the system). FluidFS operates across a symmetric cluster of purpose-built NAS controllers (housed in pairs within a 2U appliance), which interface over a fabric to shared back-end SAN storage, the EqualLogic PS Series and Compellent Storage Center in particular. The following sections provide descriptions of the logical and physical layers of FluidFS. 2.1 Layered Approach to FluidFS Logical Architecture The FluidFS architecture approaches layering with Network Load-Balancing performance in mind. The layered architecture presents a traditional file system
Recommended publications
  • Dell Equallogic Software All-Inclusive Software for Enterprise Power with Everyday Simplicity
    Dell EqualLogic Software All-inclusive software for enterprise power with everyday simplicity Built on patented peer storage architecture, the Dell™ EqualLogic™ PS Series Internet SCSI (iSCSI) storage arrays offer high performance, reliability, intelligent automation and seamless virtualization of storage to enable data protection and simplified enterprise storage deployment and management. To achieve highly scalable unified storage solutions, the EqualLogic block storage systems can be combined with the EqualLogic FS Series network-attached storage (NAS) appliances. The power behind EqualLogic The Dell difference Dell EqualLogic all-inclusive software gives you the power to do more with both your new and existing EqualLogic PS Series arrays and • All-inclusive software: New EqualLogic FS Series NAS appliances. From advanced functionality in the EqualLogic software releases will run on legacy EqualLogic systems under active service Array Software to the SAN Headquarters (SAN HQ) monitoring and ® ® agreement with Dell, allowing you to analysis tools to the Host Integration Tools for VMware , Microsoft , bring advanced enterprise-class SAN and Linux® platforms—EqualLogic equips you with an innovative features into your existing environment end-to-end solution that provides exceptional investment and data without additional licensing costs. protection, ease of use and virtualization capabilities. • Multi-generational storage: As your EqualLogic Software, built on the Dell™ Fluid Data™ architecture, is storage and business requirements inspired by you. Our engineering team innovates with each release to grow, your existing SAN resources give you more of what you need to scale capacity and performance receive continuous advancements seamlessly, integrate and grow strategically and maximize your return and capabilities from software advances on investment—both in effort and cost.
    [Show full text]
  • Dell Equallogic Fs7500: Unified Storage Simplifies File Sharing and Accelerates Virtualization January 2012
    SOLUTION BRIEF DELL EQUALLOGIC FS7500: UNIFIED STORAGE SIMPLIFIES FILE SHARING AND ACCELERATES VIRTUALIZATION JANUARY 2012 With the introduction of the FS7500 NAS appliance for the EqualLogic PS Series, Dell customers now have a unified storage option to further reduce management overhead and improve efficiency. All too often, companies have been forced to de- ploy different storage platforms for different needs: NAS for file-based applications and user file shares and SAN for block-based applications and high-performance virtualized workloads. The FS7500 changes the game. Your unified storage solution should let you easily scale your file shares to handle today’s tremen- dous growth in unstructured data. It should also accelerate and simplify your virtualization efforts by giving you the freedom to choose the best storage protocol for each virtual workload based on your unique application requirements, skill sets, and existing storage investments. Moreover, your unified storage must handle unpredictable and spiky bursts in demand, without run- ning into traditional limits on file system size or adding more work for storage administrators. Per- formance must scale linearly with capacity, and you shouldn’t end up with islands of misfit and ineffi- cient storage due to the limitations of any one array architecture. In this technology brief, we explore how Dell’s customers can benefit from the addition of scale-out NAS to the leading scale-out iSCSI SAN storage family. UNIFIED VIRTUALIZED STORAGE: THE BEST OF BOTH STORAGE WORLDS In the virtual world, storage administrators need more from their networked storage: It must handle the massive growth in unstructured file data of various types It must help to virtualize more workloads without compromising storage efficiency Traditionally, customers have often chosen distinct storage solutions for these challenges.
    [Show full text]
  • Dell Fluidfs V3 NAS Solutions for Powervault NX3500,NX3600, And
    Dell FluidFS V3 NAS Solutions For PowerVault NX3500, NX3600, And NX3610 Administrator's Guide Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your computer. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. Copyright © 2014 Dell Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. Dell™ and the Dell logo are trademarks of Dell Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. 2014 - 01 Rev. A02 Contents 1 Introduction.............................................................................................................. 11 How PowerVault FluidFS NAS Works ................................................................................................. 11 FluidFS Terminology............................................................................................................................ 11 Key Features Of PowerVault FluidFS Systems.................................................................................... 12 Overview Of PowerVault FluidFS Systems..........................................................................................13 Internal Cache..............................................................................................................................
    [Show full text]
  • Magic Quadrant for General-Purpose Disk Arrays
    Magic Quadrant for General-Purpose Disk Arrays http://www.gartner.com/technology/reprints.do?id=1-1EL3WXN&... Magic Quadrant for General-Purpose Disk Arrays 21 March 2013 ID:G00237599 Analyst(s): Stanley Zaffos, Roger W. Cox, Valdis Filks VIEW SUMMARY EVALUATION CRITERIA DEFINITIONS Ability to Execute Improvements in scalability, availability, performance and functionality of midrange storage systems Product/Service: Core goods and services offered by have blurred the boundaries between network-attached, midrange and high-end storage systems. This the vendor that compete in/serve the defined market. Magic Quadrant will help IT leaders understand storage vendors' strategies and market strengths. This includes current product/service capabilities, quality, feature sets, skills and so on, whether offered natively or through OEM agreements/partnerships as defined in the market definition and detailed in the subcriteria. Market Definition/Description Overall Viability (Business Unit, Financial, Strategy, Organization): Viability includes an General-purpose disk storage systems are designed to address shared storage requirements within a assessment of the overall organization's financial single system that can support multiple virtual or physical servers, hosted virtual desktop health, the financial and practical success of the infrastructures, multiple databases, and applications such as, but not limited to, SAP, Microsoft business unit, and the likelihood that the individual Exchange and Microsoft SharePoint. This Magic Quadrant (see Figure 1) includes midrange, high-end business unit will continue investing in the product, will and network-attached storage (NAS) systems as defined in Gartner's market definitions and continue offering the product and will advance the state of the art within the organization's portfolio of methodology (see Recommended Reading).
    [Show full text]
  • Dell Fluid File System: Scale-Out Unified Storage, Enhanced 2
    ESG Solution Showcase Dell Fluid File System: Scale-out Unified Storage, Enhanced Date: May 2015 Author: Scott Sinclair, Analyst Abstract: Few forces are as pervasive in the IT industry as the massive growth in digital content seen over recent years, and the effects of this particular force are being felt across multiple industries and applications. In response to demands for greater scale, capability, and affordability to meet the demands of an ever increasing and evolving digital landscape, Dell recently augmented its Fluid File System scale-out NAS technology. This latest release, Dell Fluid File System Version 4, is available now on the FS8600 appliance and provides scale-out unified storage capability with Dell’s SC storage. The ultimate result is a scale-out unified storage solution with the capability and scale to consolidate and serve multiple workloads, from file sharing, through virtualization, even to industry-specific digital content storage, such as storage for media and entertainment or life sciences. Overview For several years now, a deluge of data has consumed the IT industry. Few organizations are immune—data growth is not just isolated to a few applications or workloads, but experienced at a pervasive level permeating a significant portion of the IT ecosystem. During the second half of 2014, ESG conducted an in-depth qualitative storage research project by participating in discussions with 25 senior IT executives responsible for their organization’s data storage environments on a wide range of storage-focused topics. Out of these discussions, the number one most critical storage challenge identified was data growth and the associated costs of storing that data and managing the increasing capacity demands.1 External storage was designed to help curb storage management costs.
    [Show full text]
  • Dell Fluid File System Version 3 Support Matrix
    Dell Fluid File System Version 3 Support Matrix FluidFS v3 Support Matrix i Copyright © 2014 Dell Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. Dell and the Dell logo are trademarks of Dell Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. Information in this document is subject to change without notice. Published: June 2014 Part Number 680-088-002 FluidFS v3 Support Matrix ii Revision History Date Revision October 2013 A October 2013 B November 2013 C November 2013 D February 2014 E March 2014 F June 2014 G FluidFS v3 Support Matrix iii Contents 1 Introduction ............................................................................................. 1 2 FluidFS Models and Platforms ......................................................................... 3 Compellent Models ..................................................................................... 3 EqualLogic Models ...................................................................................... 4 PowerVault Models ..................................................................................... 5 3 Software Upgrade Path ................................................................................ 6 4 FluidFS File-System Metrics ........................................................................... 7 5 Customer Environment Protocols Support ..........................................................
    [Show full text]
  • Disaster Recovery Solutions Guide
    Disaster Recovery Solutions Guide Dell FS8600 Network-Attached Storage (NAS) FluidFS System Engineering January 2015 Revisions Revision Date Description A October 2013 Initial Release B January 2015 Updated for FluidFS v4 © 2015 Dell Inc. All Rights Reserved. Dell, the Dell logo, and other Dell names and marks are trademarks of Dell Inc. in the US and worldwide. All other trademarks mentioned herein are the property of their respective owners. 2 Disaster Recovery Solutions Guide Table of contents Revisions ............................................................................................................................................................................................. 2 1 Preface ......................................................................................................................................................................................... 4 1.1 Audience ........................................................................................................................................................................... 4 1.2 Purpose ............................................................................................................................................................................. 4 1.3 Disclaimer ......................................................................................................................................................................... 4 1.4 Customer support ..........................................................................................................................................................
    [Show full text]
  • Comparing Dell Compellent Network-Attached Storage to an Industry- a Principled Technologies Test Report 2 Leading NAS Solution
    COMPARING DELL EQUALLOGIC DELL COMPELLENT PS6110XS ENTERPRISE NETWORK -VDIATTACHED STORAGE TO ANPERFORMANCE INDUSTRY-LEADING AND POWE NAS SOLUTIONR USAGE Traditionally, it has taken various types of storage platforms to meet an organization’s needs. Now, with network-attached storage (NAS) solutions, companies can address diverse storage requirements with a single solution. NAS solutions can do work as varied as hosting virtual machines and production databases, storing and sharing files, and even work as backup solutions. NAS solutions are not just flexible; they are highly scalable as well and can grow as business does. With NAS, administrators can add controllers and disks or even new types of disks as workloads increase. However, not all NAS solutions deliver the same performance. In the Principled Technologies labs, we tested the performance of two NAS solutions, the Intel Xeon processor-based Dell Compellent FS8600 and an industry- leading NAS solution, by backing up large volumes of data. We found the Dell Compellent FS8600 was up to 17.1 percent faster than a similarly configured, industry- leading NAS solution when backing up server files. This means that selecting the Dell Compellent FS8600 could deliver superior performance however you choose to use it. NOVEMBERAUGUST 20122013 A PRINCIPLEDA PRINCIPLED TECHNOLOGIES TECHNOLOGIES TEST REPORTREPORT CommissionedCommissioned by by Dell, Dell Inc.Inc. Dell Compellent FS8600 NAS delivered superior backup performance We compared the performance of an industry-leading NAS solution and a Dell Compellent FS8600 NAS solution using a Dell M1000e chassis and 20 Dell PowerEdge M420 server blades. We created two file corpuses: 1) a set of 12.2 million unique smaller files, each sized between 10 and 200 KB, and 2) a set of 12 thousand unique larger files, each sized between 10 and 200 MB.
    [Show full text]
  • Dell Compellent FS8600 Sales Aid
    Dell Compellent FS8600 Sales Aid What’s New Customer Benefits The FS8600 introduces the Dell Fluid File System to the Dell Compellent storage environment, adding scale-out Network Attached Storage (NAS) to Compellent’s IT agility product portfolio. Built on custom-designed Dell hardware, the FS8600 shares a backend infrastructure with the Dell Compellent Storage Center SAN, enabling an Scale easily as storage requirements grow efficient SAN and NAS ecosystem with a single pool of disk for all block and file stor- age. • Scale performance and capacity non-disruptively to accommodate growing storage needs without forcing a platform rip-and-replace The FS8600 is built on the Fluid File System, a clustered file system that avoids the • Support a single namespace across up to four FS8600 appliances with the architectural limitations of traditional file systems by allowing storage capacity and Fluid performance to be increased within a single namespace as needs grow over time. File System scale-out architecture Both storage capacity and performance can be scaled non-disruptively, avoiding the need for a painful and expensive platform rip-and-replace. Fluid File System also • Expand capacity up to 1PB manageable space supports a variety of reliability features to ensure robust data protection and high • Continually optimize performance with auto load-balancing as the FS8600 availability. system scales Target Market/Positioning Data efficiency IT environment: Many users, hosts and workloads; Windows/Linux/Unix systems; Manage data efficiently while controlling costs multi-protocol connectivity Ideal for: Prospects looking to solve the challenges related to storing a constantly • Avoid the overhead and complexity of two solutions with a single platform growing amount of block and file data, including controlling costs, managing growth and reducing risks.
    [Show full text]
  • Compatibility Guide © 2021 Quest Software Inc
    Quest® NetVault® Compatibility Guide © 2021 Quest Software Inc. ALL RIGHTS RESERVED. This guide contains proprietary information protected by copyright. The software described in this guide is furnished under a software license or nondisclosure agreement. This software may be used or copied only in accordance with the terms of the applicable agreement. No part of this guide may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for any purpose other than the purchaser’s personal use without the written permission of Quest Software Inc. The information in this document is provided in connection with Quest Software products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Quest Software products. EXCEPT AS SET FORTH IN THE TERMS AND CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, QUEST SOFTWARE ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL QUEST SOFTWARE BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF QUEST SOFTWARE HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Quest Software makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and product descriptions at any time without notice.
    [Show full text]
  • Administrator's Guide Notes, Cautions, and Warnings
    Dell FluidFS NAS Solutions Administrator's Guide Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your computer. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. © 2012 Dell Inc. Trademarks used in this text: Dell™, the Dell logo, Dell Precision™ , OptiPlex™, Latitude™, PowerEdge™, PowerVault™, PowerConnect™, OpenManage™, EqualLogic™, Compellent™, KACE™, FlexAddress™, Force10™ and Vostro™ are trademarks of Dell Inc. Intel®, Pentium®, Xeon®, Core® and Celeron® are registered trademarks of Intel Corporation in the U.S. and other countries. AMD® is a registered trademark and AMD Opteron™, AMD Phenom™ and AMD Sempron™ are trademarks of Advanced Micro Devices, Inc. Microsoft®, Windows®, Windows Server®, Internet Explorer®, MS-DOS®, Windows Vista® and Active Directory® are either trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Red Hat® and Red Hat® Enterprise Linux® are registered trademarks of Red Hat, Inc. in the United States and/or other countries. Novell® and SUSE® are registered trademarks of Novell Inc. in the United States and other countries. Oracle® is a registered trademark of Oracle Corporation and/or its affiliates. Citrix®, Xen®, XenServer® and XenMotion® are either registered trademarks or trademarks of Citrix Systems, Inc. in the United States and/or other countries. VMware®, Virtual SMP®, vMotion®, vCenter® and vSphere® are registered trademarks or trademarks of VMware, Inc. in the United States or other countries. IBM® is a registered trademark of International Business Machines Corporation.
    [Show full text]
  • Dynamically Unify Your Data Center Dell Compellent: Self-Optimized, Intelligently Tiered Storage
    Dell Fluid Data architecture Dynamically unify your data center Dell Compellent: Self-optimized, intelligently tiered storage Dell believes that storage should help you spend less while giving you the power to do more. Dell accomplishes this with the Dell™ Fluid Data™ architecture—the foundation of a portfolio of products designed to keep your data dynamic as your business grows by putting the right data in the right place at the right time for the right cost. Part of the Fluid Data architecture, Dell Compellent offers self-optimized, intelligently tiered storage that helps you capitalize on business-critical data with enterprise agility, efficiency and resiliency. Next-generation Dell Compellent offerings provide a unified platform for your block and file data while building on the agility, efficiency and resiliency you have come to expect from Dell Compellent. Leveraging 12 generations of design experience, the next-generation Dell Compellent SC8000 controller offers high performance and memory, advanced power efficiency, and improved diagnostics over previous generation systems. The new Dell Compellent FS8600 NAS solution introduces the highly scalable Dell Fluid File System to the Compellent family. With Dell hardware that has been custom-designed for Fluid File System products, the FS8600 shares a back-end infrastructure with Dell Compellent Storage Center, enabling you to create an efficient SAN and NAS system with a virtualized, scalable pool of disk to support your block and file storage needs. Together, Dell Compellent’s next-generation SC8000 and FS8600 allow you to scale non-disruptively while enjoying the long-term economic advantages of the Compellent architecture for both block and file.
    [Show full text]