Software Defined Storage Overview August 2019
Juan Jose Floristan Cloud Specialist Solution Architect
1 AGENDA
1. Why Red Hat Storage?
2. Red Hat Ceph Storage
3. Red Hat Gluster Storage
4. Red Hat Openshift Container Storage
2
Why Red Hat Storage?
3 Why Red Hat Storage? STORAGE IS EVOLVING
TRADITIONAL STORAGE OPEN, SOFTWARE-DEFINED STORAGE Complex proprietary silos Standardized, unified, open platforms
USER USER USER USER ADMIN
Control Plane (API, GUI) ADMIN ADMIN ADMIN
Software Ceph Gluster +++ Open Source
Custom GUI Custom GUI Custom GUI
Proprietary Hardware Proprietary Hardware Proprietary Hardware Standard Computers and Disks
Proprietary Proprietary Proprietary Standard Hardware Software Software Software
4 Why Red Hat Storage? WHY THIS MATTERS
PROPRIETARY Common, Lower cost, standardized supply chain HARDWARE off-the-shelf hardware
SCALE-UP Scale-out Increased operational flexibility ARCHITECTURE architecture
HARDWARE-BASED Software-based More programmability, agility, INTELLIGENCE intelligence and control
CLOSED DEVELOPMENT Open development More flexible, well-integrated PROCESS process technology
5 Why Red Hat Storage? A RISING TIDE
Software-Defined Storage is leading SDS-P MARKET SIZE BY SEGMENT $1,395M a shift in the global storage industry, Block Storage File Storage $1,195M with far-reaching effects. Object Storage $1,029M Hyperconverged “By 2020, between 70%-80% of unstructured $859M data will be held on lower-cost storage managed $705M $592M by SDS.” $475M Innovation Insight: Separating Hype From Hope for Software-Defined Storage
“By 2019, 70% of existing storage array products
will also be available as software-only versions.” 2013 2014 2015 2016 2017 2018 Innovation Insight: Separating Hype From Hope for Software-Defined Storage 2019 Source: IDC
6 Why Red Hat Storage? THE RED HAT STORAGE MISSION
To offer a unified, open software-defined storage portfolio that delivers a range of data services for next generation workloads, thereby accelerating the transition to modern IT infrastructures.
7
Red Hat Ceph Storage
8 Red Hat Ceph Storage BUSINESS BENEFITS
OPEN SOURCE
No proprietary lock-in, with a large commercial ecosystem and broad community
PEACE OF MIND
Over a decade of active development, proven in production and backed by Red Hat
LOWER COST
More economical than traditional NAS/SAN, particularly at petabyte scale
9 Red Hat Ceph Storage RED HAT CEPH STORAGE Distributed, enterprise-grade object storage, proven at web scale
Open, massively-scalable, software-defined
Flexible, scale-out architecture on clustered standard hardware
Single, efficient, unified storage platform (object, block, file)
User-driven storage lifecycle management with 100% API coverage
S3 compatible object API
Designed for modern workloads like cloud infrastructure and data lakes
10 Red Hat Ceph Storage ARCHITECTURAL COMPONENTS
APP HOST/VM CLIENT
RGW RBD CEPHFS A web services gateway for object A reliable, fully distributed block A distributed file system with POSIX storage, compatible with S3 and device with cloud platform semantics & scale-out metadata Swift integration LIBRADOS A library allowing apps to directly access RADOS (C, C++, Java, Python, Ruby)
RADOS A software-based reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes and lightweight monitors
11 Red Hat Ceph Storage COMPLETE OPENSTACK STORAGE
• Deeply integrated with modular OPENSTACK architecture and components for ephemeral & persistent storage Keystone API Swift API Glance API Manila API Cinder API Nova API
➢ Nova, Cinder, Manila, Glance, HYPERVISOR CEPH OBJECT GATEWAY CephFS Keystone, Ceilometer, Swift, CephFS (LibRBD) Gnocchi
• 64 TB bundled ’once’ in Red Hat OpenStack Platform for evaluation
RED HAT CEPH STORAGE
12 Red Hat Ceph Storage ADVANTAGES FOR OPENSTACK USERS
• Instantaneous booting of 1 or 100s VM of VMs
• Instant backups via seamless data migration between Glance, Cinder, Nova HYPERVISOR
• Tiered I/O performance within single cluster
• Multi-site replication for disaster recovery or archiving RED HAT CEPH STORAGE
13 Red Hat Ceph Storage TARGET USE CASES
• Private Cloud - enterprise deployments growing for test & dev and production application deployments. FSI, retail and technology sectors. • Archive & Backup: object storage as a replacement for tape and expensive dedicated appliances. Hybrid cloud compatibility critical. • NFVi (new) - OpenStack with Ceph dominant reference platform for next-generation telco networks. Global demand for Ceph now standalone and hyperconverged. • Enterprise Virtualization (new): legacy protocol support for legacy VM storage to be managed on same platform as modern, private cloud storage. • Big Data (new) - object storage providing common, data lake for multiple analytics applications for greater efficiencies and better business insights
14
Red Hat Gluster Storage
15 Red Hat Gluster RED HAT GLUSTER STORAGE ADVANTAGES
OPEN • Based on GlusterFS open source community project Open, software-defined distributed • Uses proven local file system (XFS) file and object storage system • Data is stored in native format
• Uses an elastic hashing algorithm for data placement SCALABLE • Uses local filesystem’s xattrs to store metadata No Metadata Server • Nothing shared scale-out architecture
• Global namespace ACCESSIBLE • NFS, SMB, object, Gluster native protocol Multi-Protocol the Same Data • Posix compliant
• GlusterFS is based on filesystem in userspace (FUSE) MODULAR • Modular stackable arch allows easy addition of features No Kernel Dependencies ...without being tied to any kernel version
ALWAYS-ON • Synchronous replication with self-healing for server failure High-Availability across data, systems and applications • Asynchronous geo-replication for site failure
16 Red Hat Gluster GLUSTER ARCHITECTURE
NFS CIFS FUSE
SERVERS WITH LOCAL DISKS
Aggregates systems to one cohesive unit and presents using common protocols
17 Red Hat Gluster WHAT IS A SYSTEM?
PHYSICAL VIRTUAL CLOUD
SERVER (CPU/MEM)
18 Red Hat Gluster VOLUMES
CLIENTS Bricks taken from multiple hosts become one addressable unit
SERVER SERVER
BRICK BRICK BRICK BRICK
19 Red Hat Gluster VOLUMES
STORAGE NODE STORAGE NODE STORAGE NODE
/export1 /export6 /export11
/export2 /export7 /export12
/export3 /export8 /export13
/export4 /export9 /export14
/export5 /export10 /export15
/scratchspace /homeshare
20 Red Hat Gluster NFS
Better performance reading many small files from a single client
21 Red Hat Gluster SAMBA/CIFS
Samba uses RHGS gfapi library to communicate directly with GlusterFS server process without going through FUSE
22 Red Hat Gluster OBJECT ACCESS
Implements objects as files and directories under the container (”Swift on File”)
23 Red Hat Gluster GEO-REPLICATION
One to One replication
Site A Site B
Cascading replication
Site B
Site A Site C
24
Red Hat Openshift Container Storage
25 Red Hat Openshift Container Storage
WHAT STORAGE OPTIONS DO YOU HAVE FOR YOUR CONTAINERS?
PORTABLE STORAGE ACROSS ON-PREM / PUBLIC CLOUDS SILOED OR POINT PLAY OUTDATED STORAGE STORAGE SOLUTIONS ARRAYS AND APPLIANCES
• No hybrid cloud support • Scalability and high availability • Runs to all 3 public clouds fall short of customer needs • No unified control plane (K8s) • Single Vendor Support model • Vendor lock in and high TCO • Lack of automated or dynamic • Seamless user experience for provisioning of storage • Monolithic appliance model developers and DevOps
26 Red Hat Openshift Container Storage WHAT IS OPENSHIFT CONTAINER STORAGE?
● Highly scalable, enterprise-grade storage ● 2 Deployment options: independent and converge mode
● Native integration with OpenShift APPLICATION APPLICATION APPLICATION CONTAINER CONTAINER CONTAINER ● Unified Orchestration using Kubernetes for STORAGE STORAGE STORAGE CONTAINER CONTAINER CONTAINER applications and storage
● Greater control & ease of use for developers DISTRIBUTED, SECURE, SCALE-OUT STORAGE CLUSTER ● Developed, maintained, and deployed in synch with Red Hat OpenShift releases ● Single vendor Support Red Hat Openshift Container Storage STORAGE SUPPORT BEFORE OCS
NFS*
GlusterFS GCE Persistent Disk **/***
Azure File * VMDK ***
Azure Block **/***
Cinder ***
AWS EBS **/***
Ceph RBD ***
28
* No dynamic provisioning ** No Cross-Availability Zone Support *** No Shared-Storage Red Hat Openshift Container Storage STORAGE SUPPORT AFTER OCS
Scalable Automated (1000+ volumes) (Dynamic Provisioning)
Highly-Available Integrated (across availability zones) (installs with / runs on OpenShift)
Persistent, resilient and … that travels with the elastic storage... platform.
29
* No dynamic provisioning ** No Cross-Availability Zone Support *** No Shared-Storage Red Hat Openshift Container Storage TWO FLAVORS OF CONTAINER STORAGE
OPENSHIFT CONTAINER STORAGE OPENSHIFT CONTAINER STORAGE INDEPENDENT MODE CONVERGED MODE
Use existing investment in traditional storage, Highly scalable, enterprise-grade storage, managed by storage admin – attach to standalone storage fully integrated into OpenShift Container Platform
30 Red Hat Openshift Container Storage CONVERGED MODE
OPENSHIFT NODE 1
APP CONTAINER
Co-Locate Storage and Apps OPENSHIFT NODE 2 OPENSHIFT NODE 3
APP Container APP Container MASTER Dynamic Provisioning OCS Container OCS Container
Managed by OpenShift
Infrastructure-Agnostic
OCS Container
OPENSHIFT NODE 4
31 Red Hat Openshift Container Storage STORAGE CONSOLIDATION IN THE CLOUD
vs.
EBS sc1
EBS gp2
EBS gp2
EBS st1
EBS io1 32 Red Hat Openshift Container Storage STORAGE CONSOLIDATION ON PREM
PERSISTENT VOLUMES PROVIDED BY OPENSHIFT CONTAINER STORAGE
OPENSHIFT OPENSHIFT OPENSHIFT OPENSHIFT OPENSHIFT CONTAINER CONTAINER CONTAINER CONTAINER CONTAINER STORAGE POD STORAGE POD STORAGE POD STORAGE POD STORAGE POD
BLOCK DEVICE BLOCK BLOCK BLOCK DEVICE BLOCK DEVICE DEVICE DEVICE
FIBRE-CHANNEL ISCSI SAN SHARED SAS ARRAY
33 Thank you
Red Hat is the world’s leading provider of enterprise
open source software solutions. Award-winning support,
training, and consulting services make Red Hat a trusted
adviser to the Fortune 500.
linkedin.com/company/red-hat facebook.com/redhatinc
youtube.com/user/RedHatVideos twitter.com/RedHat
34