Cray Lustre and Scalable Storage Solutions Overview
LUG 2013 Vendor Presentations
1 Cray Inc. help changetheworld! to tools computational build We
Supercomputing Computation Hybrid Hybrid Architectures Flexible Clusters Clusters Flexible Supercomputers Supercomputers Modular, Systems Integrated Software Management Management Software Tools Component-based Solutions Solutions Component-based Storage Storage & Data Cray Inc.
Hadoop Analytics Analytics Graph Graph Analysis
Solutions Solutions Big Data Data Big 2 Community and Open Standards
● Linux-based OS’s in all products ● Industrial Partnership Programs ● NCSA ● ORNL ● BICB ● OpenSFS Lustre Community ● Founder ● OpenACC ● Founder ● OpenMP ● Member ● Infiniband Trade Assoc. ● Board Member ● Open Fabrics ● Member ● Cray User Group (CUG) ● Meetings yearly with 200-300 attendees. ● SparQL
3 Cray Inc. Cray Scalable Storage Solutions
Experts in Data- and IO- Intensive Big Data & HPC Best Practices
● Scalable Storage Systems ● Cray Sonexion™ ● Component-based Solutions Any Linux Cluster
● Data Management Platform ● Cray Lustre File System ● Cray Development and Login ● Cray Data Movers Cray Storage ● Cray Management Services Solutions
● Data Virtualization Services ● Virtualize IO to diverse file systems ● NFS, GPFS, PanFS, SAM QFS, Lustre ● Burst Buffer building blocks + SSD
4 Cray Inc. Cray Scalable Storage Solutions for Big Data and HPC Cray is your trusted storage expert for big data and HPC. Cray helps you utilize the right storage, build on open systems, and get results faster.
Your Trusted Expert Your Choice of Storage Get Results Faster
• Fastest production • Your choice of storage • Deliver solutions on- Lustre file system —utilizing Cray’s best time practices • Top 100 storage – 16% • Solutions perform as Cray installed • Flexible data advertised management services • Leading open source • Reduce storage community (Lustre 2/3 • Open systems footprint by 50% for of top 100 sites) petascale systems • Linux cluster agnostic • Exascale vision and leadership
Any Linux Cluster for Big Data and HPC
5 Cray Inc. Case Studies
6 Cray Inc. Enabling Scientific Breakthroughs at the Petascale
NCSANCSA Blue Today Waters Case Study Supercomputing at SustainedSize Petascale Used Performance Avail Use% Mounted on 2.0P 478T 1.5P 25% /mnt/a 2.0P 1.4P 607T 70% /mnt/b 20P 13P 6.7P 66% /mnt/c
Inodes IUsed IFree IUse% Mounted on 1,469,743,104 101,043,696 1,368,699,408 7% /mnt/a 1,469,743,104 12,751,040 1,456,992,064 1% /mnt/b 2,549,448,704 519,930,884 2,029,517,820 21% /mnt/c
● 216 Drawers,432 OSSs, 864 OSTs ● Integrated Storage at 1TB/sec ● Failover enabled ● 25+ PB of usable space ● 36 Top of Rack Switches ● Production Science at Full Scale ● Fine Grained Routing ● Cray Reliability and Service ● 632M files (4/16/2013) 7 Cray Inc. Blue Waters Cray Solution Cray XE6/XK6 - 276 Cabinets
22,640 XE6 Compute Nodes: 3,072 XK6 GPU Nodes 5,688 Blades 768 Blades 362,240 FP (bulldozer) Cores 24,576 FP Cores 724,480 Integer Cores 3,072 GPUs
LNET Routers Oct 7, 2012 Service Nodes 582 Nodes 1.137 TB/ sec Fastest parallel file Cray Login system in the world Boot SMW InfiniBand RAID 100GB/secCray Import/Export fabric Boot Cabinet Cray Data Movers 100GB/sec Sonexion 25+ usable PB 10/40/100 Gb (HPSS) Ethernet Switch online storage Cray Mgmt
Cray Component-based data management and Near-Line NCSAnet movement Storage 300+ usable PB 8 Cray Inc. ACES ACES, Advanced Computing at Extreme Scale, is a partnership of Sandia National Labs and Los Alamos National Lab. The Cielo computer is a 6136 processor Cray XE6 . File system capacities shown are before installation of Lustre.
Overview Total Capacity: 10 PBs Bandwidth 160 GB/s Multidisciplinary research; national security, space exploration, renewable energy, nanotechnology, medicine, and supercomputing.
Challenge
Processor performance increases are outpacing storage bandwidth increases.
Solution
Cray Lustre File System software NetApp 7900 storage arrays One 5 PB file system Two 2½ PB file systems InfiniBand Two small test file systems Cray Management Services Cray Development and Login Services
Lustre Success s1Lustre Lustre Lustre
Users are satisfied with bandwidth and reliability.
9 Cray Inc. The future is seldom the same as the past
Seymour Cray June 4, 1995
10 Cray Inc.