OPEN HYBRID CLOUD
ALEXANDRE BLIN CLOUD BUSINESS DEVELOPMENT Red Hat France OPEN SOURCE : LA VOIE VERS L’INNOVATION
oVirt Ceph
CLOUD RDO Hadoop BIG DATA OpenStack
JBoss Community ManageIQ KVM 100,000+ PROJECTS Ansible Fedora I.T. MÉTIERS
Gluster OpenShift Origin
FuseSource Linux Kernel Apache
MOBILE IoT CLOUD APPS DES APPLICATIONS A L’INFRASTRUCTURE SOFTWARE-DEFINED STORAGE
Frédéric MARSAUD Yoann LEGRAND EMEA Senior Solutions Architect Sales Specialist Storage Email : [email protected] Email : [email protected] Tel : +33631536829 Tel : +33785943968 TODAY’S CHALLENGES
Costs Complexities Growth Downtime
VM sprawl consumes Managing complex RAID for GB : too much Concerned about expensive space on storage infrastructures in time for rebuild availability of virtual layer SAN infrastructures virtual environments along with physical layer
Over or under storage Staff training costs for Low storage utilization Long-term migration specialized expertise provisioning : adding SAN costs and less optimal costs. performance High Availability Costs
RED HAT'S UNIQUE APPROACH Harness Open Source innovation & deliver mission-critical IT solutions THE RED HAT STORAGE PORTFOLIO
Share-nothing, scale-out architecture provides durability and adapts to changing demands Ceph Gluster management management SOFTWARE
OPEN SOURCE OPEN Ceph Gluster Self-managing and self-healing data service data service features reduce operational overhead
Standards-based interfaces and full APIs ease integration with applications and systems STANDARD HARDWARE Supported by the experts at Red Hat
Standard x86 servers HOW STORAGE FITS
PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD RED HAT STORAGE Linux of Storage
Red Hat Confidential - NDA Required BUILT-IN RE-BALANCING FREES UP IT BUDGET
RED HAT STORAGE
Forklift upgrades Migration costs • Moves data to new node
• Upgrade without disruption
• Easily de-commission systems ENSURE DATA PROTECTION AND AVAILABILITY Geo-replication capability protects your data
Remote site / disaster recovery
Site A Site B SET OF USE CASES
Big Data analytics with Hadoop ANALYTICS Machine data analytics with Splunk
CLOUD Virtual machine storage with OpenStack INFRASTRUCTURE Object storage for tenant applications
RICH MEDIA Cost-effective storage for rich media streaming AND ARCHIVAL Active archives
SYNC AND SHARE File sync and share with ownCloud
ENTERPRISE Storage for conventional VIRTUALIZATION virtualization with RHEV RED HAT CEPH STORAGE
Red Hat Confidential - NDA Required THE CEPH PHILOSOPHY
Failure is normal
Scale out on commodity hardware
Everything runs on software
Solution must be 100% open source REDHAT CEPH STORAGE
OBJECT BLOCK STORAGE STORAGE
S3 & Swift Snapshots Multi-tenant Clones Keystone OpenStack Geo-Replication Linux Kernel Native API iSCSI REDHAT CEPH HIGH LEVEL ARCHITECTURE
APP HOST/VM
17 ARCHITECTURE COMPONENTS
S3/SWIFT HOST/HYPERVISOR iSCSI SDK
INTERFACES OBJECT BLOCK STORAGE STORAGE
MONITORS OBJECT STORAGE DAEMONS (OSD) CLUSTERS
STORAGE
18 CEPH DATA ACCESS
CRUSH
OBJECT 10 01 01 11
Pseudo-random placement algorithm 01 01 10 01 . Fast calculation, no lookup Repeatable, deterministic . Statistically uniform distribution 01 11 10 10 Stable mapping . Limited data migration on change 10 10 01 01 Rule-based configuration . Infrastructure topology aware RADOS CLUSTER . Adjustable replication . Weighting ERASURE CODING CEPH DATA ACCESS CEPH OPENSTACK INTEGRATION
RED HAT ENTREPRISE LINUX OPENSTACK GLANC NOVA KEYSTONE SWIFT CINDER E LIBRBD LIBRBD
HYPER- VISOR LIBRBD RADOSGW LIBRADOS
Volumes Ephemeral Copy-on-Write Snapshots RADOS CLUSTER CLOUD STORAGE
S3/Swift S3/Swift S3/Swift S3/Swift
23 MULTI-SITE OBJECT STORAGE RHCS Multi-site Use Case
Public Sector Customer
Business Needs: Solution:
Unsecure data storage(local, external) One RHCS Cluster for 3 sites
Consolidate various needs from different 750 TB Usable
entities(shares, private and public data) Scalability with capacity and performance
Built services offering: Security
- Object like owncloud Rely on the built-in data protection features
- Bloc for virtual machine Avoid downtime COMCAST NEEDED WEB-SCALE STORAGE
Object storage that is scalable, flexible, nimble, and cost-effective
Comcast’s XFINITY X1 Entertainment Operating System powers set-top boxes for their nationwide cable network.
Seasonal application surges create fluctuation in storage Comcast is the world’s largest needs that traditional hardware-based solutions cannot meet. broadcasting and cable company, and the largest internet service provider in the US. Red Hat Ceph Storage provides an object store that allows Comcast to deliver apps and content to millions of subscribers. WORKLOAD DESIGN CRITERIAS
OpenStack Starter S M L 100TB 500TB 1PB 2PB
IOPS OPTIMIZED
THROUGHPUT OPTIMIZED Object Storage COST- Suite Spot CAPACITY OPTIMIZED SERVICE TYPE DESIGN CHOICES
OpenStack Starter S M L 100TB 500TB 1PB 2PB
IOPS 2-4x PCIe/NVMe slot servers (PCIe) OPTIMIZED 12x 2.5” SSD bay servers (SAS/SATA)
THROUGHPUT 24-36x 3.5” bay OPTIMIZED servers 24-36x 3.5” bay 12-16x 3.5” bay servers COST- servers 60-72x 3.5” bay CAPACITY servers OPTIMIZED CONFIGURATION DESIGN CHOICES
OpenStack Starter S M L 100TB 500TB 1PB 2PB
• Ceph RBD (block) IOPS • OSDs on all flash media (SATA SSD or PCIe) • High-bin, dual-socket CPU OPTIMIZED • 2x replication w/ backup or 3x replication • Multiple OSDs per drive (if PCIe)
• Ceph RBD (block) or RGW (object) THROUGHPUT • OSDs on HDD media with dedicated SSD write journals (4:1 ratio) • Mid-bin, dual-socket CPU (single-socket adequate, servers <=12 OSDs) OPTIMIZED • 3x replication (RBD/RGW read intensive) or erasure-coded (RGW write-intensive) • High-bandwidth networking, >10Gb (for servers with >12 OSDs)
COST- • Ceph RGW (object) • OSDs on HDD media (write journals co-located on HDDs) CAPACITY • Mid-bin, single-socket CPU (dual-socket, servers >12 OSDs) OPTIMIZED • Erasure-coded data protection (v. replication) WHAT’S NEW IN 2016
Red Hat Confidential - NDA Required RED HAT STORAGE
November March
1.3.2 SELinux Satellite 5 support Container Ready (Preview)
3.1.2 Tiering, SMB Perf., Writable Snapshots Container Ready
8 (April) Hyper‐Converged Support (NFV) 64TB “Batteries Included”
3.1.2 Dedicated‐Tier Storage Native Kubernetes driver Support for RHGS 3.1 Support for RHCS 1.3 RED HAT CEPH STORAGE
v1.3 (June 2015) v1.3.z (Q3/Q4 2015) v2.0 and Beyond (2016)
OSD w/SSD optimization Performance Consistency More robust rebalancing Guided Repair SELinux Improved repair process New Backing Store (Tech Local and pyramid erasure codes Preview)
Improved read IOPS iSCSI LTTNG Tracepoints Faster booting from clones Mirroring BLOCK BLOCK BLOCK
S3 object versioning Swift Storage Policies NFS Bucket sharing SELinux Active/Active multi-site OBJECT OBJECT OBJECT
Foreman/puppet installer New UI CLI :: Calamari API parity Puppet Modules (Tech Preview) Alerts MGMT CORE MGMTMulti-user and multi-cluster CORE MGMT CORE
Ceph Hammer Ceph Hammer Ceph Jewel REDHAT STORAGE CONTROLLER
WEB CONSOLE API COMMAND LINE A robust, scriptable command- A browser interface designed for A full API for automation and line interface for expert managing distributed storage integration with outside systems operators
PROVISION INSTALL CONFIGURE TUNE MONITOR
Full lifecycle management for distributed, software-defined data services
VIRTUAL DISTRIBUTED OBJECT STORE BLOCK DEVICE FILE SYSTEM
Storage Cluster on commodity hardware
https://www.youtube.com/watch?v=lvYQlLnuyNY REDHAT STORAGE CONTROLLER The Red Hat Stack –From PaaS to Storage
DevOpsTools and User Experience
Language Runtimes and Middleware
Databases and Other Services
Container Orchestration and Management
Container API Container Host
Storage MORE INFORMATION
Red Hat General
Red Hat Gluster Storage - https://access.redhat.com/documentation/en-US/Red_Hat_Storage/ Red Hat Gluster Storage Compatibility ‐https://access.redhat.com/articles/66206#Red_Hat_Gluster_Storage_Compatibility Red Hat Ceph Storage ‐ https://access.redhat.com/documentation/en/red‐hat‐ceph‐storage/ Red Hat Ceph Storage Cluster Recommended Practices - https://access.redhat.com/articles/1273193
Where to find more information: http://redhatstorage.redhat.com http://www.youtube.com/user/redhatstorage http://docs.ceph.com/docs/master/rbd/rbd‐openstack/ Sales Tools Case studies - www.redhat.com/resourcelibrary/case-studies/ Datasheets and brochures - www.redhat.com/resourcelibrary/datasheets/ Online tools - www.redhat.com/resourcelibrary/onlinetools/ Reference architectures - www.redhat.com/resourcelibrary/reference-architectures/ Webinars - www.redhat.com/resourcelibrary/webinars/ Whitepapers - www.redhat.com/resourcelibrary/whitepapers/ Thank You