Next Generation Developer Tools from Intel Focusing on new Performance Analysis Tool 4th Parallel Tools Workshop HLRS, September 2010 Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. Developer Tools of Intel ---Today Fully Supported Developer Products: … and numerous unsupported tools like PIN, PTU, AVX Emulator,Emulator, CnC freely available from whatif.intel.com and other public sitessites 2 Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 2 Intel ®®® Parallel Studio –––Windows Only New Version 2011 Released Sep 2 ndndnd ! Intel ® Parallel Advisor Intel ® Parallel Composer • Demystifies and speeds parallel • C++ Compiler, libraries, debugger application design plug-in • Direct user where to parallelize • Intel ® Parallel Debugger Extension: • Explorer & Modeler tools give Simplify debugging parallel code parallelism design insight and • A family of Parallel models New! analysis Set of portable, reliable, future proof • Proposes parallelism scheme best parallel models for both data and suited for application task parallelism, includes Intel TBB, • Summary view for decision-making Cilk Plus • Support for Intel Array Building Blocks • Intel ® IPP, OpenMP * included Intel ® Parallel Inspector Intel ® Parallel Amplifier • Dynamic Memory & thread • Parallel performance analyzer Analysis for serial and parallel • Find both serial and parallel performance bottlenecks code • Scale application performance with • Finds thread data races & more processor cores deadlocks • No special compilers or builds • Finds memory leaks and necessary corruption Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 3 Future: Next Generation Tools Suite for HPC In Beta Testing Today; Planned to be Released in a few Months Complete Package for Linux* and Windows* – Single installer, single license, synchronized launch schedule – Supports the latest Intel® x86 processors, both IA32 and Intel64 Future Compiler Bundle – “Compiler release 12.0” – Fortran, C/C++ Compilers Version – New parallel programming models Cilk Plus and Co -Array Fortran – Vectorization enhancements: GAP, SIMD pragma, Array notation – Intel® Debugger IDB Next Generation Checking Tool – “ThreadChecker Next” – Thread, Memory and Security checking – Support of Parallel Programming Models: Intel ® TBB, OpenMP*, Intel® Cilk Plus – C/C++, Fortran, and .NET support Future Performance Analyzer– “VTune+ThreadProfiler Next” Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 4 Intel’s Family of Parallel Programming Models Fixed Intel® Parallel Established Research and Function Standards Exploration Building Blocks (PBB) Libraries Intel ® Intel ® Math Intel ® Threading Kernel MPI Concurrent Building Library (MKL) Collections Blocks (TBB) Intel® Cilk Intel ® Intel® Array Plus Integrated OpenCL* Building Performance OpenMP* Blocks (ArBB) Primitives (IPP) Intel® Cilk Plus, Intel® TBB: Part of Intel® Parallel Studio (XE) Intel® Array Building Blocks : Known by code names ‘Intel Ct’ or ‘Intel Firetown”; will start public beta around mid September 2010 Software & Services Group, Developer Products Division 5 Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 5 Future Performance Analysis Tool Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 6 Future Performance Analysis Tool Integrating Features from 4 Existing Performance Tools Intel® Parallel Amplifier Intel® Performance Tuning Utility ( PTU ) Unsupported tool freely available from whatif.intel.com 7 Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 7 Future Performance Analysis Tool • Integrates popular and mature features of Intel® VTune™ Performance Analyzer, Intel® Parallel Amplifier, Intel® Thread Profiler and Intel® Performance Tuning Utility – But not a super-set in all cases – Some additional features being worked on and will be added later; some are still being evaluated/might be added to future updates • Standalone GUI on Linux* and Windows* – GUI in all environments based on wxWidgets: Very fast and stable – Same look-and-feel for Linux & Windows – Fast and native implementation on Linux – No sluggish and fragile emulations anymore !! • Comprehensive Command Line interface • New instrumentation technologies for data collection Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 8 Future Performance Analysis Tool Feature Highlights ••EaseEase of use is key focus – Simple configuration of analysis session – Copy and modify existing analysis types to adapt to special needs – Intuitive filtering and display of data collected – Stand-alone GUI but also seamless integration into Microsoft Visual Studio* on Windows* •• Extended Platform Coverage – Windows* and Linux – Microsoft* .NET* C# applications ••AdvancedAdvanced Source / Assembler View – Analysis / event data mapped to the source / assembler code – View and analyze assembler code as basic blocks Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 9 Different ways to All available start the analysis analysis types Helps creating new analysis Copy the types commandline to clipboard Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 10 Future Performance Analysis Tool Analysis Techniques ••HotHot Spot Analysis Where is the execution time spend? – Includes statistical call graph – Minimal intrusiveness due to statistical data collection ••EventEvent Based Sampling (EBS): Where are architectural events like cache misses happening ? – Performance Event configuration – Event grouping ••ThreadThread Profiling Where is my concurrency poor and why? Which time do I spend in locks ? – Thread timeline visualizes thread activity and lock transitions – Optional integrates EBS data collection and view Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 11 Future Performance Analysis Tool Hotspot Analysis • For Hotspots analysis, only stack sampling is performed – For each sample, capture execution context, time passed since previous sample and thread CPU time – No specific filtering is done for Hotspots. – The amount of data collected in Hotspots is rather moderate Screenshots are subject to change Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 12 Future Performance Analysis Tool Hotspot Analysis –––Summary View Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 13 Future Performance Analysis Tool Hotspot Analysis Callstack Threads Timeline Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 14 Future Performance Analysis Tool Parallelism/Concurrency Analysis • For Parallelism / Concurrency analysis, – Stack sampling is done just like in Hotspots analysis – Wait functions are instrumented (e.g. WaitForSingleObject, EnterCriticalSection) – Signal functions are instrumented (e.g. SetEvent, LeaveCriticalSection) – I/O functions are instrumented (e.g. ReadFile, socket) Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 15 Future Performance Analysis Tool Concurrency Calculation Thread1 Waiting Thread1 Thread2 Waiting Thread2 Thread3 Waiting Thread3 Thread running Thread waiting 1sec 1sec 1sec 1sec 1sec 1sec Threads running 111222 111 111 222 333 Concurrency Summary 0 12 3 4 Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 16 Future Performance Analysis Tool Parallelism/Concurrency Analysis –––Summary View Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners. 17 Future Performance Analysis Tool Parallelism/Concurrency Analysis Software & Services Group, Developer Products Division Copyright© 2010, Intel Corporation. All rights reserved. *Other brands and names are the property of their