Intel® Software Development Tools Intel® Parallel Studio Seminar

From Serial to Parallel Intel® Software Products for HPC

Hubert Haberstock Technical Consulting Engineer

Software & Services Group, Developer Products Division

09:15 Saluto di benvenuto e apertura dei lavori (Assintel) 09:30 Architettura Parallela: lo sviluppo dell’hardware (Intel Italy) 10:00 Parallel Programming, today and tomorrow (Intel) 11:05 Dal seriale al parallelo Intel High-Performance Tools (Intel) Intel Parallel Studio (C. Fiorillo) 13:30 Un caso di studio (C. Fiorillo) 14:15 Parallel programming methods and tools (Intel) 15:00 Ottimizzazione di applicazioni (C. Fiorillo) 16:00 Wrap up, Q&A, seminar evaluation Intel Software Tools - Parallel Design Cycle Serial

Visualization of Architectural applications and the system Analysis

Highly optimizing Introducing compilers delivering scalable solutions Parallelism

Detect latent programming Validating to address unique Correctness challenges

Tune for performance Performance and scalability Tuning

Parallel

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 3 Intel® VTune™ Analyzer 9.1 "The Intel VTune Identifies hard to find Performance performance bottlenecks Analyzer took a multi-day task and • Features turned it into a sub- day task." – Tune process or thread parallel code – Low overhead sampling Randy Camp – Graphical call graph VP, Software R&D MUSICMATCH Inc. – View results on source or assembly • Applications – System-wide Analysis – Finding hotspots – Tuning libraries, drivers and applications – Remote Data Collector for Windows*/Linux* – Programming Lanugage and Compiler Independent – Supports latest Intel Processors

Windows* Linux* Mac* IA32 Intel64 IA64 Multicore √ √ √ √ √ √

Software & Services Group, Developer Products Division

Visualization of Architectural applications and the system Analysis

Highly optimizing Introducing compilers delivering scalable solutions Parallelism New

Detect latent programming Validating to address unique Correctness challenges New

Tune for performance Performance and scalability Tuning New Parallel

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 5 Intel® C++ & Fortran Compiler Professional Editions 11.1 • The Best C++ & Fortran Development Solutions for Today’s Multi-core World – Optimized for latest Intel Processor Architectures including Core i7, Atom – Initial implementation of future instructions set extensions. – Best support for creating multi-threaded applications with performance libraries, OpenMP* and C++ libraries for parallelism. – Windows* “In certain stand-alone – Plug-in compatibility with Microsoft Visual Studio* tests, such as linear – Compatibility with Microsoft Visual C++* & Compaq algebra matrix Visual Fortran* multiplication, the Intel – Standalone version of Intel® Visual Fortran now C++ compiler 10.0 is up includes Microsoft Visual Studio to 4 times faster than – Linux* 9.1, due to improved – Command line, Source and binary compatibility with automatic GCC parallelization and – Integration with Eclipse 4.0/CDT automatic vectorization with “unroll and jam” – Mac OS* X that fits hand in glove – Command line compatibility with GCC with Intel Core 2 – Integrates in XCode development environment microarchitecture.” Supports Windows* Linux* Mac* 64-Bit Multicore AMD* ® Gunnar Staff & Lars Intel C++ Compiler √ √ √ √ √ √ ® Petter Endresen Intel Fortran Compiler √ √ √ √ √ √ SPT Group

Software & Services Group, Developer Products Division

• Features – Multi-core ready with excellent scaling – Highly optimized, extensively threaded math routines for science, engineering and financial applications for maximum performance – Automatic runtime processor detection ensures great performance on whatever processor your application is running on. – Support for C and Fortran – Optimizations for latest Intel processors including Core i7 processors

Windows* Linux* Mac* IA32 Intel64 IA64 Multicore √ √ √ √ √ √ √

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 7 Intel® Integrated Performance Primitives (IPP) 6.1 Multicore Power for Multimedia and Data Processing • Features – Rapid Application Development – Cross-platform Compatibility & Code Re-Use – Highly optimized functions from 15 Domains – Images and Video – Communications and Signal Processing – Data Processing – Performance optimizations for latest Intel processors incl. Core i7 and Atom processors

Windows* Linux* Mac* IA32 Intel64 IA64 Multicore √ √ √ √ √ √ √

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 8 Intel® Threading Building Blocks 2.2 Extend C++ for parallelism • Features – A C++ runtime library that uses familiar task patterns, not threads (STL style) – A high level abstraction requiring less code for threading without sacrificing performance – Appropriately scales to the number of cores available – The thread library API is portable across Linux, Windows, or Mac OS platforms – Works with all C++ compilers (i.e. Microsoft, GNU and Intel) – Auto_partitioner for better parallel algorithms – Lambda support to match 11.1 Compiler – Open source version available at www.threadingbuildingblocks.org

Windows* Linux* Mac* IA32 Intel64 IA64 Multicore √ √ √ √ √ √ √

Software & Services Group, Developer Products Division

Visualization of Architectural applications and the system Analysis

Highly optimizing Introducing compilers delivering scalable solutions Parallelism

Detect latent programming Validating to address unique Correctness challenges

Tune for performance Performance and scalability Tuning

Parallel

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 11 Non deterministic Error Sources –Shared Resources –Locks can – „serialize‟ a require locks program – lead to Deadlocks Thread1 Thread2 X=0

X=X+1 Shared X=X+1 Memory X

X=1

time Wrong Result ( X should be 2)

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 12 Intel® Thread Checker v3.1 “We couldn’t have Confidently pinpoint threading errors gotten the networking up and running as quickly and as efficiently without • Features Thread Checker. Thread – Detects challenging data races and Checker is simply an deadlocks awesome tool and we are not going to develop – Pinpoints errors to the source code line multi-threaded code – Batch scripts integration for regression without it.” test runs Doug Service, Dir. of Tech. Dev. – Command line interface for Windows Chris Stark, Software Engineer and Linux Ritual Entertainment – Works on standard debug builds without recompiling – Drill down to source code – Intel Fortran/C++ Compilers, Microsoft Compilers, GNU C++ Linux Compilers – Windows/POSIX* threads – -VTune/Visual Studio integration (Windows* only)

Windows* Linux* Mac* IA32 Intel64 IA64 Multicore √ √ √ √ √

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 13 New Linux* Intel® Debugger (IDB) GUI and Support for Debugging Parallel Code

• Thread Shared Data Event Detection - Break on Thread Shared Data Access (read/write) • Re-entrant Function Detection • SIMD SSE Registers Window • Enhanced OpenMP* Support - Serialize OpenMP threaded application execution on the fly - Insight into thread groups, barriers, locks, wait lists etc. Windows* Linux* Mac* IA32 Intel64 IA64 Multicore VS add-in √ √ √ √

Software & Services Group, Developer Products Division

• Stepping Serial Execution parallel Problem: loops Breakpoint Parallel loop computes a wrong result. Is it a concurrency or … algorithm issue ? Normal • Problem: Step Parallel Debugger State investigation difficult . Disable parallel Threads stop at arbitrary Support positions (red line) Runtime access to the OpenMP • Parallel Debugger num_thread property Syncpoint Support Set to 1 for serial execution of • Add Syncpoint to stop next parallel block team threads at same Lock location Step • Apply execution to $LockStep set. Lock User Benefit Step Enable parallel Verification of a algorithm “on- • User Benefit Lock the-fly” without slowing down • Get and keep defined Step the entire application to serial program State execution … • Operations like private data comparison now On demand serial debugging meaningful without recompile/restart

15 Intel Software Tools - Parallel Design Cycle Serial

Visualization of Architectural applications and the system Analysis

Highly optimizing Introducing compilers delivering scalable solutions Parallelism

Detect latent programming Validating to address unique Correctness challenges

Tune for performance Performance and scalability Tuning

Parallel

Software & Services Group, Developer Products Division

- Load imbalances

Thread 1

Thread 2

- Inefficient Synchronisation & Communication overhead between threads

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 17 “Intel Thread Profiler was very useful for Intel® Thread Profiler v3.1 analyzing bottlenecks in Pinpoints threading inefficiencies our threaded code. Thread Profiler quickly • Features pinpointed problem areas and showed us – View application concurrency level the reasons for the slowdown, so we were to ensure full core utilization able to restructure the – Identify where thread related code for better threaded performance.” overhead impacts performance Martin Watt – Find out which created threads are Software Architect Alias active and which are inactive – Included with VTune™ Analyzer for Windows* – Support for Windows*/POSIX* threads, Threading Building Blocks API, OpenMP* – Concurrency and Timeline Views – Intel Fortran/C++ Compilers, Microsoft Compilers Windows* Linux* Mac* IA32 Intel64 IA64 Multicore √ √ √ √

Software & Services Group, Developer Products Division

What we have today, what’s upcoming

Software & Services Group, Developer Products Division

Intel Parallel Workstation/Server Tools Cluster Tools Studio Maximize Cluster Intuitive Parallelism Maximize Parallel Performance Performance Microsoft Visual Studio* Cluster developers Windows*, Linux*, Mac OS* developers C/C++ developers Linux*, Windows*

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 21 Scaling Performance Forward One Development Environment – Multi- to Many-core

Advise Architectural Analysis

Performance Code Optimize/Tune Add Parallelism

Confidence Correctness

Simplify Your Parallelism Development New Offerings in 2010 Accelerating Performance Forward

Next-generation Version 2 HPC Tools Cluster Tools 4.0

Intel Parallel Workstation/Server Tools Cluster Tools Studio Maximize Cluster Intuitive Parallelism Maximize Parallel Performance Performance Windows*, Linux*, Mac OS* developers Microsoft Visual Studio* Cluster developers *Single Bundle for Windows*, Linux* C/C++ developers Linux*, Windows* available

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 25 Guideline only – Providing Choice of Parallel Methods indicates majority use of method; also subject to mixing of methods

Vector Data Task Cluster Instructi paralle parallel Paralleli ons lism ism sm

Cilk++ Vector- Ct MPI New izer for SSE Open in MP 2010 Vector- CoArray izer for Fortran AVX TBB

Resource Management

Multi-core IA Platforms Many-core IA Platforms What’s new in next-generation HPC Tools?

1. Complete Product Suites – Single installer – Synchronized launch schedule – Support the latest Intel processors (Nehalem, Westmere, Sandy Bridge, …) 2. Compilers - Compiler Pro “12.0” – Fortran, C & C++ Compilers; Parallel Debugging – Enhanced MKL, IPP, TBB, OpenMP – Intel’s Ct technology - Data Level Parallelism – Cilk++ integration – Co-Array Fortran – Initial heterogeneous computing support for many-core 3. Correctness Analysis Tools - Thread Checker Next – Static and Dynamic Analysis tools for Parallel and Serial Code – Thread & Memory error checking – Security (in conjunction with compiler) – Timeline Visualization and Reporting capability – Intel ® TBB, OpenMP, Intel® Compiler Parallel Model support – C/C++, Fortran, and .NET support 4. Performance Analysis Tools – VTune Next – Updated micro-architecture analysis via PMU sampling; Hotspots, Concurrency and Locks & Waits analysis – .NET support

Software27 & Services Group, Developer Products Division

What’s new?

Software & Services Group, Developer Products Division

• Support for new OS, e.g. – Windows* 7 – Red Hat* EL 6 – Ubuntu* 10 • Support for new IDE versions, e.g. – Microsoft Visual Studio* 2010 – Eclipse* CDT 6.0 • Support for new processors, e.g. – Sandy Bridge (enhanced AVX support) – Initial support for heterogeneous computing on many-core • Timeline – Beta targeted for Q2 2010 – request beta access from [email protected] – Product release targeted for Q4 2010

Software & Services Group, Developer Products Division

• Support for CoArray Fortran – Shared memory – Distributed memory (available with cluster tool suite) – Uses Intel MPI technology – Can’t mix with OpenMP or explicit MPI calls • Other Fortran 2008 features – Submodules – DO CONCURRENT – CONTIGUOUS • More Fortran 2003 features – Complete type-bound procedures (GENERIC, OPERATOR,..) – FINALization

Software & Services Group, Developer Products Division

• More C++0x and C99 features – E.g. rvalue references – reduce temporary copies – Maintain Microsoft Visual Studio* compatibility • Optimized string intrinsics – Using SSE4 instructions • New array syntax for C/C++ – More readable; Helps the compiler vectorize and parallelize – Somewhat similar to Fortran90 concept – [ : [ : ] ] – E.g. a[0:s] += b[2:s:2] • Incorporation of Cilk technology – Simple keywords, especially for task parallelism – “Hyperobjects” to facilitate thread-safe access – Provide thread safe reduction operations

Software & Services Group, Developer Products Division

• More loop multi-versioning – auto-parallelization – memcpy generation • Vectorization improvements, e.g. – Loops with mixed data types – Enhanced AVX support – “Vectorize or fail” pragma • Improved auto-parallelization – Enhanced privatization analysis – declare functions whose calls can safely be parallelized – Guided Auto-Parallelization (Advice for vectorization, parallelization and data transformation) • Matrix multiply intrinsics may call into MKL • loop profile option • Statement-specific inlining pragmas

Software & Services Group, Developer Products Division

• Security enhancements – Improved source checking, static memory checker – Integrated with runtime checker and GUI in HE Studio (required) • Math library enhancements – faster, lower accuracy option – option for consistent results on different processors • Debugger enhancements – STL object visualization – Parallel debug extensions for Fortran (from 11.1 update) – AVX disassembly and register display • Standardize directory structure – Compiler knows about performance libraries even if they are installed independently • Improved compile time for release and debug builds

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 35 Intel’s Ct Technology Data Parallel Programming for Multi-core and Many-core Processors

• Productive Data Parallel Programming – High-level abstraction, natural notation – Ease of programming, portability – Abstracts away architectural details – Good (but not ultimate) application performance – Low-level coding may still run faster – Built-in thread safety (no data races) • Investment protection via Forward-scaling – Performance across present and future processor generations • Extends standard C++ using templates – Adds parallel containers & methods to C++ – Works with standard C++ compilers – Intel® C++ Compiler, GCC*, Microsoft Visual C++* – Interoperates with other Intel tools

Software & Services Group, Developer Products Division

• Intel’s Ct Technology offers a ApplicationC++ APIs Other Language standards compliant C++ library… calling Ct APIs Bindings …backed by a runtime • The runtime generates and manages JIT Compiler threads and vector code, via – Machine independent optimization Virtual Machine – Offload management Backend Virtual ISA Debug/ Memory Threading – Machine specific code generation and JIT Svcs Manager Runtime optimizations Compiler – Scalable threading runtime based on Intel® Threading Building Blocks (Intel® TBB)

Software & Services Group, Developer Products Division

•Extended AVX/Sandybridge support – Many optimized kernels •More C/C++ support – CLAPACK with row major matrices •Dynamic accuracy control for VML •Summary Statistics Library – threaded analysis of multi-dimensional data sets – Quantiles, moments, correlations See http://software.intel.com/en-us/whatif/

Software & Services Group, Developer Products Division

• Optimized for new processors – Westmere and new AES instructions – Sandy Bridge and AVX – Initial support for many-core • DMIP infrastructure and DMIP sample for 2D image processing – CPU and many-core • JPEG-XR CODEC • JPEG Sample Productization – enhanced tests, testing infrastructure

Software & Services Group, Developer Products Division

• Windows Imaging Component (WIC) API wrapper for Image Codecs • Data Compression Library support (bzip2, zlib, gzip) • C String library (limited scope) • Texture Compression Codecs (LRB) • DMIP DSL for Tighter Visual Studio integration • Reduced IPP package size – Deprecate obsolete CPU optimizations; Smart dispatcher • Improved documentation

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 40 Correctness and Performance Tools Intel’s next-generation Thread Checker and next-generation VTune

What’s new?

Software & Services Group, Developer Products Division

– Major changes to infrastructure of our analysis products – GUI improvements – Activity selection more in line with workflow – More intuitive information displays – Improved technology – PIN replaces bistro – Friendlier environment for network installs and execution – Improved filtering/sorting utilities – Intel’s next Thread Checker – Dynamic and static checking for memory and threading errors – Intel’s next Vtune Profiler – Next generation performance analyzer – Serial and parallel profilers

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 42 Intel’s next Thread Checker Ensures secure, reliable, high quality code • Built-in Static and Dynamic Analysis tools for Parallel and Serial Code – Memory checking that detects memory leaks and corruption issues – Thread checking finds threading errors – Source checking that detects memory and security vulnerabilities – Data race and deadlocks detection • Thread safety validation – verifies threads will operate correctly • Scalability – Analysis tool performance scales with available number of cores • Enhanced Developer Productivity – Intuitive GUI and CLI interface to access a wide range of functions – Displays detailed reports and comprehensive error data analysis • Supported parallel models: Intel® TBB, OpenMP, Intel® Cilk++, Ct, and Microsoft PPL/ConcRT • Supported environments: – C/C++, Fortran and .Net – Microsoft Visual Studio 2005, 2008, 2010 – Windows and Linux operating environments • Roadmap Q1/2010 Beta Q4/2010 FCS

Software & Services Group, Developer Products Division

• Simple Setup, Integrated Results – Easier to learn, easier to use • 2nd Generation Profiling Technology – Faster, more reliable – Improved Event-based sampling – Timeline display (like Thread Profiler) – Memory analysis (similar to PTU) • Windows and Linux native versions available – Stand-alone GUI, Command line, Visual Studio Integration • Rough schedule – Beta Q1 2010 – FCS Q4 2010

Software & Services Group, Developer Products Division

Dynamic Instrumentation (PIN): Event Based Sampling (EBS): • More reliable, • Very low overhead lower startup overhead – Uses on chip PMU (Performance Monitoring Unit) – Only functions that are called are instrumented – Event multiplexing reduces the number of runs – Long start up waits for instrumentation are required gone – “Uncore” event support for newer processors • Statistical call graph (chip level events for bandwidth and caching) – Statistical algorithm All: reduces run-time overhead • No special re-compiles required • Thread Profiler – Works with Microsoft, GCC, Intel and other – Correlate data with EBS results compilers that follow standards – Include symbols for best results

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 45 Tomorrow Today: Whatif.intel.com Best “not yet ready for prime-time” software Direct connection with the developers and researchers in Intel

Software & Services Group, Developer Products Division

Copyright © 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 46 Intel® Software Network Connect with Developers and Intel Engineers • http://software.intel.com

Software & Services Group, Developer Products Division

• Several Beta Programs are currently running: – Parallel Studio – Next-genration High-performance Tools: Compiler tools, VTune/Amplifier, Thread Checker/Inspector • Beta is not public – We want to provide very interactive support and get good feecback – If you are interested contact your local reseller

Software & Services Group, Developer Products Division

INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.

Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. For more information on performance tests and on the performance of Intel products, reference www.intel.com/software/products.

Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and other countries.

*Other names and brands may be claimed as the property of others.

http://intel.com/software/products