Craig Hendren Global OEM Alliances Manager for Lustre and HPC Orchestrator High Performance Data Division, Intel Corporation Legal information
Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit http://www.intel.com/performance. Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more at http://www.intel.com/content/www/us/en/software/intel- solutions-for-lustre-software.html.
You may not use or facilitate the use of this document in connection with any infringement or other legal analysis concerning Intel products described herein. You agree to grant Intel a non- exclusive, royalty-free license to any patent claim thereafter drafted which includes subject matter disclosed herein. No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document. Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade. This document contains information on products, services and/or processes in development. All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest forecast, schedule, specifications and roadmaps. The products described may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request.
A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. 3D Xpoint, Intel, the Intel logo, Intel Core, Intel Xeon Phi, Optane and Xeon are trademarks of Intel Corporation in the U.S. and/or other countries. * Other names and brands may be claimed as the property of others. © 2016 Intel Corporation
3 73% 9 of Top10 Sites 73% of Top100 Most Adopted PFS Most Scalable PFS 16% Open Source GPL v2 4% 7% Commercial Packaging Vibrant Community
Lustre GPFS other unknown
December 2015: Intel’s Analysis of Top 100 Systems (top100.org)
4 1.6 2.0 2.3 2.7
2013 2016 1999 2003 2009 2011
2001 2007 2010 2012 2015 1.0 1.8 2.1 2.5 2.8
* Other names and brands may be claimed as the property of others.
5 Commit per Organization Lines of codes per organization
2% 1% 1% 1%1% 2% 2% 2% 2% 3% 2% 3% 4% 6%
6% 18%
8% Intel Intel 65% 65%
Intel ORNL* Seagate* Cray* DDN* Intel ORNL Cray Atos Seagate Atos* LLNL* CEA* IU Other DDN IU CEA Other
1 Source: Chris Morrone, Lead of OpenSFS Lustre Working Group, April 2016
6 Intel® Scalable System Framework A Holistic Solution for All HPC Needs
Small Clusters Through Supercomputers
Compute Memory / Storage Compute and Data-Centric Computing Fabric Software Standards-Based Programmability On-Premise and Cloud-Based
Intel® Solutions for Lustre* Intel® HPC Orchestrator Intel® Xeon® Processors Intel® Omni-Path Architecture Intel® Optane™ Technology Intel® Software Tools Intel® Xeon Phi™ Processors Intel® Silicon Photonics 3D XPoint™ Technology Intel® Cluster Ready Program Intel® FPGAs and Server Solutions Intel® Ethernet Intel® SSDs Intel Supported SDVis
7 Bioscience Government research and defense Large-scale manufacturing Genomic data analysis, modeling and Government funded research. Surveillance, Mechanical, computer-aided design & simulations Signal Processing, encryption etc. computer-aided engineering systems
Weather and climate Energy Finance Highly complex CGI rendering Seismic processing, reservoir modeling / Fraud detection, Monte Carlo simulations, characterization, sensor data analysis risk management analysis
* Other names and brands may be claimed as the property of others.
8 Intel® Scalable System Framework for HPC
Intel® FOUNDATION Edition Intel® ENTERPRISE Edition Intel® CLOUD Edition for Lustre* software for Lustre* software for Lustre* software
Delivers the latest functions and Maximum performance with minimal Cost-effective access to parallel features, fully supported by Intel complexity and cost for multi- storage on Amazon Web Services* Ideal for organizations that prefer to petabyte file system. Management (AWS) and Microsoft Azure* to boost design and deploy their own open with Intel® Manager for Lustre* cloud-computing source configurations software
* Other names and brands may be claimed as the property of others.
9 10 DDN
. Proven Experience of #1 Lustre Provider
. Industry’s Fastest Storage –SFA
. DDN + Intel –Unique Features, Support
. Versatile –Embedded / External / Custom
. End2End Data Management
11 Select DDN EXAScaler& Lustre Customers
12 13 * Other names and brands may be claimed as the property of others.
14 Lustre 2.7
Software Core for Intel® EE for Management OpenZFS Latest updates and security Metadata Performance Lustre* software. Bulk IO storage. Jobstats Monitoring. patches to customers. Improvements. Snapshots Performance, Subdirectory LFSCK, Dynamic Lnet; Intel® Mounts Manager for Lustre*
Kerberos* Network Intel® Omni-Path Architecture Hadoop* Adapter for Lustre and Authentication and support. HPC Adapter for MapReduce. Encryption. SELinux* Lustre Client Support
New in v3.1 * Other names and brands may be claimed as the property of others.
15 Q4 ’16 Q1 ’17 Q2’17 Q3 ’17 Q4 ’17
Enterprise EE 3.0 Enterprise Edition 3.1 EE 4.0 HPC, commercial Lustre* 2.7.x Lustre 2.7.x Lustre
Cloud Cloud Edition 1.3 Cloud Edition 1.4 CE 1.5 HPC, commercial Lustre 2.8.x Lustre 2.9.x Lustre
Foundation FE 2.8 Foundation Edition 2.9 Foundation Edition 2.10 Community Lustre Lustre 2.8.x Lustre 2.9.x Lustre 2.10.x software coupled with Intel support DNE 2 UID/GID Mapping OpenZFS Snapshots Client m’data perf. Shared key crypto Multi-rail LNET Shipping LFSCK perf. Large Block IO Project quotas Development SELinux, Kerberos Subdirectory mounts
Planning
Product placement not representative of final launch date within the specified quarter * Other names and brands may be claimed as the property of others
16 Management Object Storage Object Storage Target (MGT) MetadataTarget (MDT) Targets (OSTs) Targets (OSTs)
Metadata Object Storage Servers Servers (1-10s) (10s-1000s)
Management Network Intel Manager for Lustre
High Performance Data Network (Infiniband*, 10GbE)
Lustre Clients (1 – 100,000+)
Native Lustre* Client for Intel® Xeon Phi™ processor Intel® Omni-Path Support Robin Hood OpenZFS, RAIDz Hadoop* Adapters HSM
* Other names and brands may be claimed as the property of others.
17 Community Lustre Intel support globally—24/7/365 Regular cadence of maintenance System integrators selling systems and patch releases based on community Lustre* do not receive maintenance releases from Intel Scheduled proven features and value-add major releases Reliant on open source community for support Enterprise Edition is bundled with features (IML, HSM, DSS, Hadoop*, ZFS, etc.) Patches, when available, are supplied as source code only
Integration and testing left to SI or end user to verify Optimizations for Intel® architecture – Intel® Scalable System Framework Deploying solutions based on community edition carries risk for end user Online training and testing for end users, channel partners and OEM partners www.intel.com/lustre-training & www.intel.com/lustre-reseller
* Other names and brands may be claimed as the property of others.
18