By the Book: Open Source Reference Implementations for Key SNIA Terminology
By the Book: Open Source Reference Implementations for Key SNIA Terminology
Michael Dexter Gainframe, SNIA DPCO
1 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Motivations
r This journey began in a Data Protection BoF r Then a desire to draw from the SNIA Dictionary r The best dictionary of its kind r Mildly dated thanks to years of authority r Then DPCO Governing Committee participation
2 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Challenges
r Balance Vendor Authority with Vendor Neutrality r Vendors produce many de facto standards r Industry authority beyond SNIA projects r SNIA produces open standards r License the results for maximum adoption
3 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Common Ground
SNIA
Open THIS Open Standards Source
4 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Perfect Example: SNIA NDMPv4
r Network Data Management Protocol r www.snia.org/ndmp r Vendor originated r Open standard r Permissively-licensed v4 implementation (of 5) r Freely available
5 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Open Standards are Everywhere
r VendorNAS 2.0! r NFS! r iSCSI! r FibreChannel!
6 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Open Standards are Everywhere
r VendorNAS 2.0! r RFC 1813! r RFC 3720! r RFC 3643! r Shifts the discussion to Standards Conformance of Reference(able) Implementations
7 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Open Source is Everywhere
r Majority of non-Microsoft storage platforms r FreeBSD r Illumos r GNU/Linux r POSIX environments r Enterprise-proven reference implementations
8 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Vendor Motivations
r Validated standards compliance should be synonymous with standards delivery r Either failing to comply with a standards or extending a non-extensible standard is failure r Not a desirable point of distinction r Shared code is usually interoperable code
9 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
By the Book…
r RAID 0, 1, 5, 6 r FreeBSD graid(8) r GNU/Linux mdadm(8) r RaidZ r Illumos, FreeBSD, GNU/Linux zpool(8) r Replication, rebuild, latency, throughput…
10 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
By the Book…
r iSCSI r FreeBSD CTL r Illumos SCSI Target Mode Framework r GNU/Linux open-iscsi r NFSd r Virtually every Unix distribution, by definition
11 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
By the Book…
r FibreChannel r FreeBSD, Illumos and GNU/Linux Drivers r Various Erasure Coding Implementations r Most Networking Protocols r Increasingly Web Content Accessibility Guidelines (WCAG) for Applications
12 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
My Work: Replication Taxonomy
r File r rsync(8) r unison(8) r Block r OpenZFS send r Object…
13 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
My Work: Replication Taxonomy
r Understand the problem before addressing it r Block vs. File vs. Object r Active vs. Passive r Asynchronous vs. Synchronous r Point-in-time vs. Batch r Primary-Backup vs. Multi-Primary…
14 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Eyes on the Prize
r SNIA Linear Tape File System (LTFS) r SNIA NDMP r SNIA Swordfish r snia.org/forums/smi/swordfish r swordfishmockups.com r Watch for the DPCO Data Protection WP
15 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Calls to Action
r NDMP, OpenZFS, bhyve Hypervisor are all vendor contribution r Ever-present motivations to upstream, broad “thaw” regarding actually doing it r Identify what standards-based technologies outside or inside your core functionality may qualify for upstreaming.
16 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.
Discuss Thank You! Thank You! @MichaelDexter [email protected]
17 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.