High Performance Computing Toolkit: Installation and Usage Guide | Appendix B
Total Page:16
File Type:pdf, Size:1020Kb
IBM Parallel Environment Developer Edition High Performance Computing Toolkit Version 2 Release 1 Installation and Usage Guide SC23-7287-00 IBM Parallel Environment Developer Edition High Performance Computing Toolkit Version 2 Release 1 Installation and Usage Guide SC23-7287-00 Note Before using this information and the product it supports, read the information in “Notices” on page 255. This edition applies to version 2, release 1, modification 0 of the IBM Parallel Environment Developer Edition High Performance Computing Toolkit (HPC Toolkit) (product number 5765-PD2) and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright IBM Corporation 2008, 2014. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures ..............vii | Part 3. Using the IBM PE Developer | Edition graphical performance Tables ...............ix || analysis tools ...........21 About this information ........xi | Chapter 6. Using the hpctView Who should read this information .......xi Conventions and terminology used in this || application .............23 information ..............xi || Preparing an application for analysis ......24 Prerequisite and related information ......xii || Working with the application ........25 Parallel Tools Platform component .....xii || Opening the application executable ......25 How to send your comments ........xiii || Instrumenting the application ........28 || Running the instrumented application .....29 Summary of changes ........xv || Viewing performance data .........37 | Chapter 7. Using hardware Limitations and restrictions .....xvii || performance counter profiling.....41 || Preparing an application for profiling......41 Part 1. Introduction .........1 || Instrumenting the application ........41 || Running the instrumented application .....43 Chapter 1. Introduction to the IBM HPC || Viewing hardware performance counter data . 45 Toolkit ...............3 IBM PE Developer Edition components .....3 || Chapter 8. Using MPI profiling ....47 || The HPC Toolkit ............3 || Preparing an application for profiling......47 || The PE DE Workbench ..........4 || Instrumenting the application ........47 Collecting performance data from a subset of parallel || Running the application ..........49 application tasks .............4 || Viewing MPI profiling data .........51 Performance measurement tools ........5 || Viewing MPI traces............52 Instrumentation models...........6 || Setting the user environment .........6 || Chapter 9. Using I/O profiling .....55 || Preparing an application for profiling......55 Part 2. Installation .........9 || Instrumenting the application ........55 || Running the application ..........57 || Viewing I/O Data ............58 | Chapter 2. Supported platforms and || software levels ...........11 || Chapter 10. Using Call Graph analysis 61 || Preparing the application ..........61 || Chapter 3. Installation media contents 13 || Running the application ..........61 || Viewing profile data ...........61 | Chapter 4. Installing the IBM High || Viewing the Call Graph ..........62 || Performance Computing Toolkit ....15 || Viewing gprof data ............63 || Installing the IBM HPC Toolkit on Linux systems . 15 || Installing the IBM HPC Toolkit xCAT kit ....17 | Chapter 11. Using the IBM PE | Installing the IBM HPC Toolkit hpctView || Developer Edition Workbench.....67 || application ..............17 || Preparing the application ..........67 || Working with the HPCT perspective ......67 | Chapter 5. Installing the IBM PE || Opening the application ..........68 || Developer Edition Workbench.....19 || Instrumenting the application ........69 | Installing the IBM PE Developer Edition HPCT || Running the application ..........69 || plug-in ................19 || Viewing performance data .........73 || Installing the IBM HPC Toolkit xCAT kit ....20 Part 4. The hardware performance counter tools ...........75 © Copyright IBM Corp. 2008, 2014 iii Chapter 12. Using the hardware hpcstat - Reports a system-wide summary of performance counter tools ......77 hardware performance counter statistics ....120 Using the hpccount command ........77 hpctInst - Instrument applications to obtain Using the hpcstat command .........78 performance data ............124 Using the libhpc library ..........79 Understanding CPU hardware counter multiplexing 80 Chapter 17. Application programming Understanding derived metrics ........81 interfaces .............127 Understanding MFlop issues ........81 hpm_error_count, f_hpm_error - Verify a call to a Understanding inheritance .........82 libhpc function .............129 Understanding inclusive and exclusive event counts 82 hpmInit, f_hpminit - Initialize the Hardware Understanding parent-child relationships ....83 Performance Monitor (HPM) run-time environment 131 Handling of overlap issues .........83 hpmStart, f_hpmstart - Identify the starting point Understanding measurement overhead .....84 for an instrumented region of code ......136 Handling multithreaded program instrumentation hpmStartx, f_hpmstartx - Identify the starting point issues ................84 for an instrumented region of code ......138 Considerations for MPI programs .......85 hpmStop, f_hpmstop - Identify the end point of an General considerations .........85 instrumented region of code ........141 Hardware performance counter plug-ins....85 hpmTerminate, f_hpmterminate - Generate HPM statistic files and shut down HPM ......143 Part 5. The MPI and I/O profiling hpmTstart, f_hpmtstart - Identify the starting point for an instrumented region of code ......145 libraries ..............91 hpmTstartx, f_hpmtstartx - Identify the starting point for an instrumented region of code ....147 Chapter 13. Using the MPI profiling hpmTstop, f_hpmtstop - Identify the end point of library ...............93 an instrumented region of code .......150 Compiling and linking with libmpitrace .....93 MT_get_allresults - Obtain statistical results . 152 Controlling traced tasks ..........94 MT_get_calleraddress - Obtain the address of the Additional trace controls ..........94 caller of an MPI function .........155 Customizing MPI profiling data .......95 MT_get_callerinfo - Obtain source code information 156 Understanding MPI profiling utility functions . 96 MT_get_elapsed_time - Obtains elapsed time . 158 Performance data file naming ........96 MT_get_environment - Returns run-time environment information .........159 Chapter 14. Using the I/O profiling MT_get_mpi_bytes - Obtain the accumulated library ...............97 number of bytes transferred ........160 MT_get_mpi_counts - Obtain the the number of Preparing your application .........97 times a function was called.........161 Setting I/O profiling environment variables . 97 MT_get_mpi_name - Returns the name of the Specifying I/O profiling library module options . 99 specified MPI function ..........162 Running your application .........102 MT_get_mpi_time - Obtain elapsed time ....163 Performance data file naming ........102 MT_get_time - Get the elapsed time ......164 MT_get_tracebufferinfo - Obtain information about Part 6. Using the hpctInst MPI trace buffer usage ..........165 command ............103 MT_output_text - Generate performance statistics 166 MT_output_trace - Control whether an MPI trace file is created .............167 Chapter 15. Instrumenting your MT_trace_event - Control whether an MPI trace application using hpctInst ......105 event is generated ............168 Instrumenting your application for hardware MT_trace_start, mt_trace_start - Start or resume the performance counters ..........105 collection of trace events .........170 Instrumenting your application for MPI profiling 106 MT_trace_stop, mt_trace_stop - Suspend the Instrumenting your application for I/O profiling 107 collection of trace events .........172 Part 7. Command and API Part 8. Appendixes ........173 reference ............109 Appendix A. Performance data file Chapter 16. Commands .......111 naming ..............175 hpccount - Report hardware performance counter File naming conventions..........175 statistics for an application .........112 File naming examples ..........176 hpcrun - Launch a program to collect profiling or trace data...............118 iv High Performance Computing Toolkit: Installation and Usage Guide | Appendix B. Derived metrics, events, Keyboard navigation ...........253 | and groups supported on POWER8 IBM and accessibility ...........253 || architecture ............181 || Derived metrics defined for POWER8 architecture 181 Notices ..............255 | Events and groups supported on POWER8 Privacy policy considerations ........257 || architecture ..............182 Trademarks ..............257 Appendix C. HPC Toolkit environment Index ...............259 variables .............249 Accessibility features for IBM PE Developer Edition .........253 Accessibility features ...........253 Contents v vi High Performance Computing Toolkit: Installation and Usage Guide Figures || 1. hpctView Welcome page ........24 || 18. MPI instrumentation tab ........48 || 2. hpctView main window ........25 || 19. Subtab containing MPI trace settings ....50 || 3. Remote file browser..........26 | 20. Performance Data view with MPI profiling || 4. New connection dialog.........27 || data ...............51 || 5. Initial instrumentation view .......28 || 21. MPI trace view ...........52 || 6. Expanded instrumentation view......29 || 22. MIO instrumentation