Intel® HPC Orchestrator Delivering Innovation, Integration, Validation, and Support Across the HPC System Software Stack

product brief

Intel® HPC Orchestrator Delivering innovation, integration, validation, and support across the HPC system software stack

High-Performance Computing (HPC) maintaining a validated, reliable system and compatibility challenges. This task is transforming our world and our software stack and more time develop- is never-ending because of the rapid businesses, delivering unprecedented ing differentiated capabilities for users. release cycles and updates of individual insight and innovation to scientists, components. engineers, analysts, companies, and The Challenge Intel® HPC Orchestrator — more. But integrating, testing, validat- HPC system software stacks are made ing, and maintaining an HPC system Solving HPC Integration and up of dozens of components that must software stack is a costly, ongoing, and Validation Challenges all be integrated and validated before time-consuming effort. an organization’s HPC applications Leveraging years of Intel HPC software Intel® HPC Orchestrator is changing all can run on top of that stack. Ensuring experience and expertise, Intel HPC of that. It enables HPC system design- stable, reliable versions of all stack Orchestrator is a family of Intel-sup- ers, installers, and managers to spend components is an enormous task due ported products designed to simplify less time integrating, configuring, and to the numerous interdependencies HPC system software stack implemen- tation and maintenance. It provides a modular pre-integrated, pre-tested, and pre-validated software stack that INTEL® HPC ORCHESTRATOR SYSTEM SOFTWARE PLATFORM can significantly reduce the time required to perform those tasks. Intel HPC Orchestrator is based on the community-developed system software stack from OpenHPC, a Linux* Foundation Collaborative Project. The OpenHPC community was formed to integrate commonly required HPC components, such as provisioning tools, resource management, I/O cli- ents, development tools, and a variety of scientific libraries. Intel has been an integral contributor to OpenHPC, including seeding the community with a fully integrated and validated system software framework. Intel HPC Orchestrator provides ad- vanced testing, validation, and ongoing Intel® HPC Orchestrator 2

support for the software platform. It preserving the application-facing inter- Intel Validated also includes proprietary software to face that enables Independent Software Intel HPC Orchestrator includes ad- aid in system support and application Vendor (ISV) applications and user vanced integration testing between development, such as the Intel® Parallel applications to run consistently across components, validation at scale (sys- Studio XE 2017 Cluster Edition suite, different systems utilizing Intel HPC tems up to 1,000 nodes) and testing on installed and ready for activation with a Orchestrator system software. specific platform configurations (e.g., 90-day evaluation license. processor and memory). Hardware- Benefits Unique to Intel® HPC specific testing and validation includes Intel HPC Orchestrator will continue new Intel components, including Intel® to implement new OpenHPC innova- Orchestrator Xeon® processor v4 family, Intel® Xeon tions and improvements into the future, Intel HPC Orchestrator builds on the Phi™ product family, and Intel® Omni- while working to ensure all components framework of the OpenHPC system Path Fabric, as well as the Lustre* file work together seamlessly so technical software stack with the addition of system client software. resources can focus on developing and proprietary software to add popular enhancing specific HPC solutions. development tools, compilers, and Intel Supported libraries—and to assist in supportabil- The Intel HPC Orchestrator system The Intel HPC Orchestrator system ity of the overall software platform. It software platform provides multiple software platform utilizes a hierarchi- also includes a full commercial license levels of support via OEM and channel cal structure, allowing the tracking of with technical support for the Altair partners. The support subscriptions dependencies across multiple MPI and PBS Professional* workload manager. include ongoing, validated system soft- compiler families. The system software The system software is integrated, ware updates across the software stack. stack is modular and customizable, en- validated, and supported with updates Professional Level 3 support is pro- abling components to be easily substi- and technical support provided by a vided by Intel HPC engineers, covering tuted and revalidated. It gives Original team of experienced Intel HPC software integration issues for key components Equipment Manufacturers (OEMs) the engineers. to resolution. Open source community ability to differentiate and add unique components are triaged and provided value for their HPC customers, while best-effort support. Level 1 and Level 2 technical support services are also INTEL® HPC ORCHESTRATOR SYSTEM SOFTWARE — KEY COMPONENTS available, as are standard and prior- ity service level agreements. Technical FUNCTIONAL AREAS COMPONENTS Support for Intel® Parallel Studio XE Base OS Compatibility1 SLES 12 SP2, RHEL 7.3, CentOS 7.3 2017 Cluster Edition and Lustre* file Administrative Tools Conman*, Ganglia*, Intel® Cluster Checker, Lmod*, LosF*, system client requires purchase of the Nagios*, pdsh, prun, EasyBuild*, Spack*, genders, mrsh, respective license and support contract, clustershell sold separately. Provisioning Warewulf Key Features and Capabilities Resource Management PBS Pro*, SLURM, MUNGE* Runtimes OpenMP*, Intel® Parallel Studio XE Runtimes for Intel® MPI Lib, • Stateless and Stateful Provisioning Intel® TBB Runtimes , Intel® MKL, Intel® DAAL and Intel® IPP • Warewulf based I/O Services Lustre* file system client software, shine • Bare metal installation Numerical/Scientific Libraries Boost*, GSL, FFTW, Metis, PETSc, Trilinos*, Hypre*, SuperLU*, • Image-based install MUMPS*, Intel® MKL • Templated installation scripts I/O Libraries HDF5 (pHDF5), NetCDF (including C++ and Fortran interfaces), Adios • Editable configuration input file Compiler Families GNU (gcc, g++, gfortran), Intel Parallel Studio XE 2017 Cluster • Hierarchical structure, multiple Edition (icc,icpc,ifort) development environment support MPI Families MVAPICH2, OpenMPI, Intel MPI • Multiple MPI families Development Tools Autotools (autoconf, automake, libtool), Valgrind,R, SciPy/ • Multiple compiler support NumPy, Intel® Inspector • Common scientific libraries Performance Tools PAPI, IMB, mpiP, pdtoolkit TAU, Intel® Advisor, Intel® Trace included for multiple MPI/compiler Analyzer and Collector, Intel® VTune Amplifier combinations Intel® HPC Orchestrator 3

• Includes integrated administrative tools INTEL® HPC ORCHESTRATOR INCLUDES INTEGRATED INSTALLATION OF INTEL® PARALLEL + and flexible development environment STUDIO XE 2017 CLUSTER EDITION • Utilizes common Linux update INTEL® PARALLEL STUDIO XE 2017 CLUSTER EDITION COMPONENTS INCLUDED mechanisms (e.g., YUM, Zypper) Intel® C/C++ Compiler - industry leading performance Intel® Parallel Studio XE Intel® Fortran Compiler - industry leading performance Cluster Edition Intel® Math Kernel Library - fast math library BUILD Makes it easier to boost application perfor- Intel® Integrated Performance Primitives - image, signal & data processing mance on today’s and tomorrow’s highly Intel® Threading Building Blocks - threading library parallel processors and coprocessors. Intel® Data Analytics Acceleration Library - machine learning & analytics Intel® Performance Libraries Intel® Distribution for Python* - integrated, high-performance Ramp up performance on the latest Python environment platforms with math, data analytics/ma- Intel® Vtune™ Amplifier XE - performance profiler chine learning, media, and parallel ANALYZE Intel® Advisor - vectorization optimization and thread prototyping template libraries. Intel® Inspector - memory and thread debugging Intel Analysis, Profiling Intel® MPI Library - message passing interface library & Architecture Profile and analyze shared and SCALE Intel® Trace Analyzer and Collector - MPI profiling, tuning, and analysis distributed memory architectures and Intel® Cluster Checker - cluster diagnostic expert system identify hotspots and performance + 90-day evaluation license provided for system installation. Renewals may be purchased through existing distribution partners. bottlenecks. Analyze and define parallel architecture methods for vectorization and threading.

Intel Compilers High-performance C/C++/Fortran stan- dards-driven compilers produce optimized code that can run significantly faster by BALANCING SIMPLICITY AND CUSTOMIZATION taking advantage of ever-increasing core counts and vector register widths.

The Right Balance of Simplicity and Customization Intel HPC Orchestrator is designed to provide a balance between simplicity and TURNKEY INTEL® HPC customizability. It combines ease-of-use, SOFTWARE STACK ORCHESTRATOR performance, and scalability, while allowing for customization. It is targeted at technical and commercial users—includ-

ing research, enterprise, and academic IPICI users—with vertical HPC applications. The software platform enables provisioning of compute nodes from the system head node, utilizing either diskless or diskful boot methods. Intel HPC Orchestrator simplifies system software component INTEGRATE YOUR OWN SOFTWARE STACK integration, validation, and configuration across the HPC system software stack. COIIO [email protected] | (303) 431-4606 | aspsys.com

At Aspen Systems our mission is to provide leading best-in-class solutions to High Performance Computing (HPC) users and administrators. We are proud to service all key market sectors including government, universities, corporations and anywhere research and science can be found. ISO 9001:2008 Certiﬁed. GSA Contract #GS-35F-0192K.

Aspen Systems, turning complex problems into simple solutions. [email protected] | (303) 431-4606 | aspsys.com