Front cover Performance Monitoring and Best Practices for WebSphere on z/OS Learn to build a monitoring and profiling environment Discover a comprehensive discussion of parameters Acquire knowledge about best practices Alex Louwe Kooijmans Tony J. Cox Ruud Huisman Magdalena Marsh Koelli Mungee Brian S Paskin Martina Schmidt Thomas Schulze Javier Voos Franck Yu ibm.com/redbooks International Technical Support Organization Performance Monitoring and Best Practices for WebSphere on z/OS April 2007 SG24-7269-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (April 2007) This edition applies to WebSphere Application Server Version 6.02 and Version 6.1 for z/OS. © Copyright International Business Machines Corporation 2007. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . x Preface . xi The team that wrote this IBM Redbooks publication . .xi Become a published author . xiii Comments welcome. xv Chapter 1. Introduction. 1 1.1 The structure of the book . 2 1.2 How do you use this book . 2 1.3 Other sources of information . 5 Part 1. Our environment . 7 Chapter 2. Our infrastructure . 9 Chapter 3. Our sample workload . 19 3.1 IBM Trade V6.1 . 21 3.2 ITSO Trader V6.1 . 23 3.3 Business transaction scenarios. 26 3.3.1 IBM Trade V6.1 business transaction scenarios. 27 3.3.2 ITSO Trader V6.1 business transaction scenarios . 29 3.4 Workloads . 30 3.4.1 Workload scripts . 32 Chapter 4. Using workload drivers . 33 4.1 Introduction . 34 4.2 WebSphere Studio Workload Simulator (WSWS). 34 4.3 Rational Performance Tester . 37 4.4 JMeter . 46 4.5 Others . 52 Chapter 5. Setting up and using monitoring tools. 55 5.1 Performance problem determination . 56 5.1.1 Introduction . 56 5.1.2 Problem symptoms and documentation for diagnosis . 56 5.2 Monitoring and profiling tools . 58 5.2.1 SMF/RMF . 58 5.2.2 Eclipse TPTP . 71 © Copyright IBM Corp. 2007. All rights reserved. iii 5.2.3 Performance Monitoring Infrastructure (PMI) . 92 5.2.4 IBM Tivoli Composite Application Manager . 109 5.3 Other techniques to analyze performance problems. 139 5.3.1 Dynamic MVS console commands . 139 Part 2. Best practices - infrastructure. 143 Chapter 6. How to determine the area of interest. 145 6.1 Introduction . 146 6.2 Configuration check. 146 6.2.1 z/OS components to check . 146 6.2.2 WebSphere Application Server components to check . 147 6.2.3 Application components to check . 148 6.3 Problem areas . 148 6.4 Slow response from the application server . 151 6.5 No response from the application server. 152 6.6 High CPU utilization . 154 6.7 High memory utilization . 155 Chapter 7. WebSphere Application Server and HTTP Server . 159 7.1 The WebSphere queuing network. 160 7.2 IBM HTTP Server and WebSphere Application Server plug-in . 161 7.2.1 IBM HTTP Server . 161 7.2.2 WebSphere plug-in . 162 7.2.3 References . 169 7.3 WebSphere Application Server . 170 7.3.1 Tracing . 170 7.3.2 Workload Profile . 171 7.3.3 Controlling the number of servants . 172 7.3.4 Timeouts effecting performance . 173 7.3.5 Security . 176 7.3.6 Dynamic Cache Service . 177 7.3.7 LogStream compression . 179 7.3.8 MonitoringPolicy Ping interval . 179 7.3.9 File synchronization . 180 7.3.10 Object Request Broker (ORB). 182 7.3.11 High Availability (HA) Manager . 183 7.3.12 Hot Deployment and Dynamic Application Reloading. 184 7.3.13 Web container . 186 7.3.14 EJB container . 189 Chapter 8. Java Virtual Machine . 191 8.1 Introduction . 192 8.2 JVM heap and Garbage Collection . 193 iv Performance Monitoring and Best Practices for WebSphere on z/OS 8.2.1 JVM storage allocation . 193 8.2.2 Garbage Collection policy . 195 8.2.3 Garbage Collection . 196 8.3 Analyzing VerboseGC . 197 8.3.1 Introduction . 197 8.3.2 Our GC Analyzer tool . 199 8.3.3 GC Analyzer charts . 200 8.4 Just in Time (JIT) compilation . 215 Chapter 9. z/OS subsystems . 217 9.1 UNIX Systems Services . 218 9.2 TCP/IP. 220 9.3 Workload Manager (WLM) . 222 9.3.1 WLM classification . 222 9.3.2 Temporal affinity workload balancing . 227 9.3.3 RMF Workload Activity Report . ..