OPEN HYBRID CLOUD

ALEXANDRE BLIN CLOUD BUSINESS DEVELOPMENT France OPEN SOURCE : LA VOIE VERS L’INNOVATION

oVirt Ceph

CLOUD RDO Hadoop BIG DATA OpenStack

JBoss Community ManageIQ KVM 100,000+ PROJECTS Fedora I.T. MÉTIERS

Gluster OpenShift Origin

FuseSource Kernel Apache

MOBILE IoT CLOUD APPS DES APPLICATIONS A L’INFRASTRUCTURE SOFTWARE-DEFINED STORAGE

Frédéric MARSAUD Yoann LEGRAND EMEA Senior Solutions Architect Sales Specialist Storage Email : [email protected] Email : [email protected] Tel : +33631536829 Tel : +33785943968 TODAY’S CHALLENGES

Costs Complexities Growth Downtime

 VM sprawl consumes  Managing complex  RAID for GB : too much  Concerned about expensive space on storage infrastructures in time for rebuild availability of virtual layer SAN infrastructures virtual environments along with physical layer

 Over or under storage  Staff training costs for  Low storage utilization  Long-term migration specialized expertise provisioning : adding SAN costs and less optimal costs. performance  High Availability Costs

RED HAT'S UNIQUE APPROACH Harness Open Source innovation & deliver mission-critical IT solutions THE RED HAT STORAGE PORTFOLIO

Share-nothing, scale-out architecture provides durability and adapts to changing demands Ceph Gluster management management SOFTWARE

OPEN SOURCE OPEN Ceph Gluster Self-managing and self-healing data service data service features reduce operational overhead

Standards-based interfaces and full APIs ease integration with applications and systems STANDARD HARDWARE Supported by the experts at Red Hat

Standard x86 servers HOW STORAGE FITS

PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD RED HAT STORAGE Linux of Storage

Red Hat Confidential - NDA Required BUILT-IN RE-BALANCING FREES UP IT BUDGET

RED HAT STORAGE

Forklift upgrades Migration costs • Moves data to new node

• Upgrade without disruption

• Easily de-commission systems ENSURE DATA PROTECTION AND AVAILABILITY Geo-replication capability protects your data

Remote site / disaster recovery

Site A Site B SET OF USE CASES

Big Data analytics with Hadoop ANALYTICS Machine data analytics with Splunk

CLOUD Virtual machine storage with OpenStack INFRASTRUCTURE Object storage for tenant applications

RICH MEDIA Cost-effective storage for rich media streaming AND ARCHIVAL Active archives

SYNC AND SHARE File sync and share with ownCloud

ENTERPRISE Storage for conventional VIRTUALIZATION virtualization with RHEV RED HAT CEPH STORAGE

Red Hat Confidential - NDA Required THE CEPH PHILOSOPHY

 Failure is normal

 Scale out on commodity hardware

 Everything runs on software

 Solution must be 100% open source REDHAT CEPH STORAGE

OBJECT BLOCK STORAGE STORAGE

S3 & Swift Snapshots Multi-tenant Clones Keystone OpenStack Geo-Replication Linux Kernel Native API iSCSI REDHAT CEPH HIGH LEVEL ARCHITECTURE

APP HOST/VM

17 ARCHITECTURE COMPONENTS

S3/SWIFT HOST/HYPERVISOR iSCSI SDK

INTERFACES OBJECT BLOCK STORAGE STORAGE

MONITORS OBJECT STORAGE DAEMONS (OSD) CLUSTERS

STORAGE

18 CEPH DATA ACCESS

CRUSH

OBJECT 10 01 01 11

Pseudo-random placement algorithm 01 01 10 01 . Fast calculation, no lookup Repeatable, deterministic . Statistically uniform distribution 01 11 10 10 Stable mapping . Limited data migration on change 10 10 01 01 Rule-based configuration . Infrastructure topology aware RADOS CLUSTER . Adjustable replication . Weighting ERASURE CODING CEPH DATA ACCESS CEPH OPENSTACK INTEGRATION

RED HAT ENTREPRISE LINUX OPENSTACK GLANC NOVA KEYSTONE SWIFT CINDER E LIBRBD LIBRBD

HYPER- VISOR LIBRBD RADOSGW LIBRADOS

Volumes Ephemeral Copy-on-Write Snapshots RADOS CLUSTER CLOUD STORAGE

S3/Swift S3/Swift S3/Swift S3/Swift

23 MULTI-SITE OBJECT STORAGE RHCS Multi-site Use Case

 Public Sector Customer

 Business Needs: Solution:

 Unsecure data storage(local, external)  One RHCS Cluster for 3 sites

 Consolidate various needs from different  750 TB Usable

entities(shares, private and public data)  Scalability with capacity and performance

 Built services offering:  Security

- Object like owncloud  Rely on the built-in data protection features

- Bloc for virtual machine  Avoid downtime COMCAST NEEDED WEB-SCALE STORAGE

Object storage that is scalable, flexible, nimble, and cost-effective

Comcast’s XFINITY X1 Entertainment Operating System powers set-top boxes for their nationwide cable network.

Seasonal application surges create fluctuation in storage Comcast is the world’s largest needs that traditional hardware-based solutions cannot meet. broadcasting and cable company, and the largest internet service provider in the US. Red Hat Ceph Storage provides an object store that allows Comcast to deliver apps and content to millions of subscribers. WORKLOAD DESIGN CRITERIAS

OpenStack Starter S M L 100TB 500TB 1PB 2PB

IOPS OPTIMIZED

THROUGHPUT OPTIMIZED Object Storage COST- Suite Spot CAPACITY OPTIMIZED SERVICE TYPE DESIGN CHOICES

OpenStack Starter S M L 100TB 500TB 1PB 2PB

IOPS 2-4x PCIe/NVMe slot servers (PCIe) OPTIMIZED 12x 2.5” SSD bay servers (SAS/SATA)

THROUGHPUT 24-36x 3.5” bay OPTIMIZED servers 24-36x 3.5” bay 12-16x 3.5” bay servers COST- servers 60-72x 3.5” bay CAPACITY servers OPTIMIZED CONFIGURATION DESIGN CHOICES

OpenStack Starter S M L 100TB 500TB 1PB 2PB

• Ceph RBD (block) IOPS • OSDs on all flash media (SATA SSD or PCIe) • High-bin, dual-socket CPU OPTIMIZED • 2x replication w/ backup or 3x replication • Multiple OSDs per drive (if PCIe)

• Ceph RBD (block) or RGW (object) THROUGHPUT • OSDs on HDD media with dedicated SSD write journals (4:1 ratio) • Mid-bin, dual-socket CPU (single-socket adequate, servers <=12 OSDs) OPTIMIZED • 3x replication (RBD/RGW read intensive) or erasure-coded (RGW write-intensive) • High-bandwidth networking, >10Gb (for servers with >12 OSDs)

COST- • Ceph RGW (object) • OSDs on HDD media (write journals co-located on HDDs) CAPACITY • Mid-bin, single-socket CPU (dual-socket, servers >12 OSDs) OPTIMIZED • Erasure-coded data protection (v. replication) WHAT’S NEW IN 2016

Red Hat Confidential - NDA Required RED HAT STORAGE

November March

1.3.2 SELinux Satellite 5 support Container Ready (Preview)

3.1.2 Tiering, SMB Perf., Writable Snapshots Container Ready

8 (April) Hyper‐Converged Support (NFV) 64TB “Batteries Included”

3.1.2 Dedicated‐Tier Storage Native driver Support for RHGS 3.1 Support for RHCS 1.3 RED HAT CEPH STORAGE

v1.3 (June 2015) v1.3.z (Q3/Q4 2015) v2.0 and Beyond (2016)

OSD w/SSD optimization Performance Consistency More robust rebalancing Guided Repair SELinux Improved repair process New Backing Store (Tech Local and pyramid erasure codes Preview)

Improved read IOPS iSCSI LTTNG Tracepoints Faster booting from clones Mirroring BLOCK BLOCK BLOCK

S3 object versioning Swift Storage Policies NFS Bucket sharing SELinux Active/Active multi-site OBJECT OBJECT OBJECT

/puppet installer New UI CLI :: Calamari API parity Puppet Modules (Tech Preview) Alerts  MGMT CORE MGMTMulti-user and multi-cluster CORE MGMT CORE

Ceph Hammer Ceph Hammer Ceph Jewel REDHAT STORAGE CONTROLLER

WEB CONSOLE API COMMAND LINE A robust, scriptable command- A browser interface designed for A full API for automation and line interface for expert managing distributed storage integration with outside systems operators

PROVISION INSTALL CONFIGURE TUNE MONITOR

Full lifecycle management for distributed, software-defined data services

VIRTUAL DISTRIBUTED OBJECT STORE BLOCK DEVICE FILE SYSTEM

Storage Cluster on commodity hardware

https://www.youtube.com/watch?v=lvYQlLnuyNY REDHAT STORAGE CONTROLLER The Red Hat Stack –From PaaS to Storage

DevOpsTools and User Experience

Language Runtimes and Middleware

Databases and Other Services

Container Orchestration and Management

Container API Container Host

Storage MORE INFORMATION

Red Hat General

Red Hat Gluster Storage - https://access.redhat.com/documentation/en-US/Red_Hat_Storage/ Red Hat Gluster Storage Compatibility ‐https://access.redhat.com/articles/66206#Red_Hat_Gluster_Storage_Compatibility Red Hat Ceph Storage ‐ https://access.redhat.com/documentation/en/red‐hat‐ceph‐storage/ Red Hat Ceph Storage Cluster Recommended Practices - https://access.redhat.com/articles/1273193

Where to find more information: http://redhatstorage.redhat.com http://www.youtube.com/user/redhatstorage http://docs.ceph.com/docs/master/rbd/rbd‐openstack/ Sales Tools Case studies - www.redhat.com/resourcelibrary/case-studies/ Datasheets and brochures - www.redhat.com/resourcelibrary/datasheets/ Online tools - www.redhat.com/resourcelibrary/onlinetools/ Reference architectures - www.redhat.com/resourcelibrary/reference-architectures/ Webinars - www.redhat.com/resourcelibrary/webinars/ Whitepapers - www.redhat.com/resourcelibrary/whitepapers/ Thank You