Quick viewing(Text Mode)

By the Book: Open Source Reference Implementations for Key SNIA Terminology

By the Book: Open Source Reference Implementations for Key SNIA Terminology

By the Book: Reference Implementations for Key SNIA Terminology

Michael Dexter Gainframe, SNIA DPCO

1 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Motivations

This journey began in a Data Protection BoF r Then a desire to draw from the SNIA Dictionary r The best dictionary of its kind r Mildly dated thanks to years of authority r Then DPCO Governing Committee participation

2 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Challenges

r Balance Vendor Authority with Vendor Neutrality r Vendors produce many de facto standards r Industry authority beyond SNIA projects r SNIA produces open standards r License the results for maximum adoption

3 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Common Ground

SNIA

Open THIS Open Standards Source

4 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Perfect Example: SNIA NDMPv4

r Network Data Management Protocol r www.snia.org/ndmp r Vendor originated r Open standard r Permissively-licensed v4 implementation (of 5) r Freely available

5 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Open Standards are Everywhere

r VendorNAS 2.0! r NFS! r iSCSI! r FibreChannel!

6 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Open Standards are Everywhere

r VendorNAS 2.0! r RFC 1813! r RFC 3720! r RFC 3643! r Shifts the discussion to Standards Conformance of Reference(able) Implementations

7 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Open Source is Everywhere

r Majority of non-Microsoft storage platforms r FreeBSD r r GNU/ r POSIX environments r Enterprise-proven reference implementations

8 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Vendor Motivations

r Validated standards compliance should be synonymous with standards delivery r Either failing to comply with a standards or extending a non-extensible standard is failure r Not a desirable point of distinction r Shared code is usually interoperable code

9 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

By the Book…

r RAID 0, 1, 5, 6 r FreeBSD graid(8) r GNU/Linux mdadm(8) r RaidZ r Illumos, FreeBSD, GNU/Linux zpool(8) r Replication, rebuild, latency, throughput…

10 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

By the Book…

r iSCSI r FreeBSD CTL r Illumos SCSI Target Mode Framework r GNU/Linux open- r NFSd r Virtually every distribution, by definition

11 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

By the Book…

r FibreChannel r FreeBSD, Illumos and GNU/Linux Drivers r Various Erasure Coding Implementations r Most Networking Protocols r Increasingly Web Content Accessibility Guidelines (WCAG) for Applications

12 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

My Work: Replication Taxonomy

r File r rsync(8) r unison(8) r r OpenZFS send r Object…

13 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

My Work: Replication Taxonomy

r Understand the problem before addressing it r Block vs. File vs. Object r Active vs. Passive r Asynchronous vs. Synchronous r Point-in- vs. Batch r Primary- vs. Multi-Primary…

14 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Eyes on the Prize

r SNIA Linear Tape (LTFS) r SNIA NDMP r SNIA Swordfish r snia.org/forums/smi/swordfish r swordfishmockups.com r Watch for the DPCO Data Protection WP

15 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Calls to Action

r NDMP, OpenZFS, Hypervisor are all vendor contribution r Ever-present motivations to upstream, broad “thaw” regarding actually doing it r Identify what standards-based technologies outside or inside your core functionality may qualify for upstreaming.

16 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.

Discuss Thank You! Thank You! @MichaelDexter [email protected]

17 2017 Storage Developer Conference. © Michael Dexter. All Rights Reserved.