Data Storage Systems

for Redundancy, Replication, Resilience and High Availability

Gerry George DigiSolv, Inc. (758) 716-2716 / (347) 450-3444 [email protected] Types of Storage

• Typically, hard drives: mechanical, SSDs • Issues: – Size/Capacity – Speed, Access & Latency – Availability, Durability • Location – Internal / External (directly connected) – NAS/SAN, Cloud / Remote (network connected) Storage Criteria

• Availability, Resilience, Performance How – Replication – Redundancy Why – Disaster Recovery – High Availability Storage Architecture

• Replication – Online / Offline / Nearline – Synchronous / Asynchronous • Availability • Recovery from Disasters • Types: DAS (hard drive/SSDs) / Arrays / RAID / NAS / SAN • Mirroring: File-level vs -level Storage Goals & Criteria

• Budget • Organizational Requirements – Fault Tolerance – Resilience – Provisioning & Compatibility – Disaster Recovery (time to recover) – Unified / Distributed Storage • Flexibility, Expansion & Extensibility • Hardware & Architecture, Bandwidth • PERFORMANCE Storage Performance Concerns

• Latency • IOPS • Compatibility • Flexibility: Expansion & Extensibility • Resilience & Recovery

• Extras: De-Duplication, Compression, Encryption, Snapshots & . • Costs & Support Storage Deployment Options

• Architecture: , iSCSI, Ethernet (NFS, SMB) • Commercial – Dell PowerVault, EqualLogic / HP / IBM / Fujitsu / NetApp • OpenSource – , GlusterFS, DRBD, OpenMediaVault, many others • Cloud Compatibility – OpenStack, Xen/VMWare/HyperV, CloudStack, etc….. Working Example

• DRBD + OCFS2 dual-primary w/realtime failover (14TB SATA) • 3rd node planned for offsite – asynchronous replication….. • iSCSI to XenServer Cluster – VM storage • SMB to LAN clients ( FileStorage) • 4Gbps direct cross-connect / 4Gbps into LAN / 4Gbps to Server LAN (Multipath w/DRBD, iSCSI – know exactly what/why you’re doing) • Real-time fail-over (<3s iSCSI; <5s SMB) • Managed using LCMC (http://lcmc.sourceforge.net/ http://clusterlabs.org/wiki/LCMC) Options

• RedHat Ceph (www.ceph.com) • DRBD (https://www.drbd.org/en/) • SheepDog (http://www.sheepdog-project.org/) • FreeNAS / NAS4Free / / OpenMediaVault (http://www.openmediavault.org/) • QuadStor (http://www.quadstor.com) • Cluster Management Console (LCMC) • Distributed File Systems: GFS2//ZFS/… Resources • 77 Open Source Storage Applications http://www.infostor.com/storage-management/virtualization/77-open-source-storage-applications- 1.html • Distributed Storage & Thinking Inside the Box http://ceph.com/openstack/distributed-storage-and-thinking-inside-the-box/

• Linux Cluster Management Console (http://lcmc.sourceforge.net/ http://clusterlabs.org/wiki/LCMC) • DRBD (https://www.drbd.org/en/)

• SheepDog Cluster Storage System http://www.sheepdog-project.org/

– GlusterFS (http://www.gluster.org/) – ZFS (http://zfsonlinux.org/) – BTRFS (https://btrfs.wiki.kernel.org) Thank You

Questions???

Gerry George DigiSolv, Inc. (758) 716-2716 / (347) 450-3444 [email protected]