Anderson_Index 6/17/04 10:35 AM Page 387

Index

Symbols & Numbers ALE (Application Link AutoController, 95, 145–48, Enabling), 231, 321 152, 158, 243, 256, 263, /n, 181 Allocation unit, 27, 85, 170, 268–69, 300, 303, 306–8, /o, 181 204 315, 322 %pc, 338–39 AMD, 227, 366 client driver, 271 % privileged time, 313 Apples-to-apples testing, 27, console, 272 % user time, 313 48, 60, 73, 78–79, 83, 121, virtual client, 269, 272 9iRAC, 132, 156 210, 232, 292, 316, 320, AutoIT, 136–139, 157, 183, A 325, 351, 354, 363 198, 232 ABAP, 21, 39–40, 61, 177, 185, API. See Application Automated data collection 212, 238, 285, 312, 360 Programming Interface (scripting), 93, 160, 165, ABAP dumps, 285 (API) 180, 182, 260–61, 323–24 ABAPers, 7, 313 APO (Advanced Planner and AutoTester ONE (AT1), Active users, 44, 285, 305, 324, Optimizer), 4, 18, 25, 74, 182–183, 249–50, 253, 256, 351 88, 225–26, 235 263, 268, 275, 283, 289 ActiveX, 123, 137, 139, 142, Application layer AutoTester ONE CTRL+S, 263 144, 157 heterogeneous system Availability, 7, 30–31, 59, Advanced Planner and landscape, 226 65–68, 94, 98, 101–2, 121, Optimizer (APO). See SAP: Application Link Enabling. See 132, 150, 171, 178–81, APO (Advanced Planner ALE 183–84, 201, 222, 226, 244, and Optimizer) Application Programming 288, 292, 299 AGate (Application Gate, Interface (API) Availability through component of SAP ITS), defined, 95 Redundancy (ATR), 369 204, 302 SAP, 132, 182–83, 241, 255, Average load testing, 19 agent, 122, 147, 163–64, 268, 271, 290, 338 176–79, 184, 322, 352 Application server response B CEN, 150, 183–184 time, 80 Background jobs, 67, 77, 183, defined, 184 Application Servers, 77, 104, 331, 336, 338–39 OpenView (HP) SMART 124–25, 127, 136, 147, 150, Background noise, 241 Plug–Ins, 177–78 172, 195, 203, 210, 214–15, Background work process, 336 AIX (IBM), 103, 168, 313, 218, 228, 238, 281–82, Bar charts, 115 377 353 Baselines, 43, 48, 54, 57, 62, AL02. See CCMS Application Service Provider 75, 76, 80, 211–14, AL03. See CCMS (ASP), 24 223–224, 229, 239, AL05. See CCMS AppManager (NetIQ). See 300–301, 304, 348, 350–54, AL08. See CCMS Systems management 356 AL11. See CCMS ATR, 369 establishing, 292–94

387 Anderson_Index 6/17/04 10:35 AM Page 388

388 Index

Basis, SAP, 2, 3, 10, 38–40, 42, Business Continuity Planning. RZ03, 312 90, 91, 96, 101, 105, 132, See DR (Disaster Recovery) RZ04, 312 158, 184, 223, 286, 310, Business processes RZ08, 311 335 documentation, 160–61, 242 RZ10, 239, 360 Batch jobs. See Background repeatable, 78–81 RZ20, 184, 239, 302, 308–9, jobs scripts, 242 323, 361, 386 Benchmark which to test and why, RZ21, 312 CRM CIC, 236 73–75 SA38, 312 generating new Perl code, Business Sandbox, 61–62 SAINT, 185 137, 140, 232 Business warehouse. See also SCC4, 240 high water, 123 SAP: Business Information SCC8, 239 repeatable, 136 Warehouse (BW) SCCL, 239 standard (SAP), 72, 86, 109, loads, 50, 225 scripting, 150, 182, 261, 341 137 stress testing, 47–50 SE13, 330 starting point for custom Buy–in, 32, 187, 191, 253, 268 SE38, 150–51, 312 testing, 25, 27, 225, 235, SM04, 150, 181, 200, 239, 257 C 310, 325 variables (control), 26–27, CA Unicenter, 177 SM12, 312, 326, 327 223, 246–51, 256, 261, Capacity on Demand (COD), SM13, 312, 326, 327 263 24–25 SM21, 312 Best practices, 1, 16, 118, 202, Capacity planning, 12, 37, 54, SM36, 238 223, 299, 330, 352, 366 123, 162, 192, 215, 218, SM37, 238, 311 network, 127 287, 295 SM50, 239, 310–11 performance tuning and Carrying capacity, 375–76 SM51, 239, 261, 300, 312 stress testing, 1, 16 CATT (SAP Computer-Aided SM59, 300, 312 rebooting prior to testing, Test Tool), 91, 143–49, 221, SM64, 238 234, 299 243 SM66, 239, 305–6, 310, script recording and writing, CCMon. See Monitoring tools 311, 323, 325, 353 142–43, 259–60 CCMS (SAP Computing Center SMGW, 311 security, 127 Management System and SMLG, 311, 318, 325 sources of, 352 T–codes) SMQS, 311 staffing testing AL02, 311 SSAA, 312, 381 organizations, 89, 92–97 AL03, 311 ST01, 312 test package assembly, AL05, 311 ST02, 215, 239, 310, 222–24 AL08, 77, 83, 181–82, 215, 329–30, 358, 361, 381 WAST, 118 239, 261, 281, 305, 310, ST03, 49, 150, 181–83, 215, Big hair, 31 325, 338 219, 227, 236–37, 263, Biztalk (Microsoft), 230 AL11, 239, 312 303, 310, 320, 330, 333, Blocksize. See Allocation unit DB02, 150, 181, 239, 302, 335–39, 356, 358, BMC Patrol. See Systems 325, 356 361–62, 381, 383 management: Patrol (BMC) DB05, 330–31, 333, 358 ST03G, 335, 337, 338 Body of knowledge, 23, 188 DB13, 239, 358 ST03N, 182–83, 219, 310, Bottleneck historical ST07, 337 335–38 defined, 17, 19 monitoring, 38–39, 159–60, ST03x, 335, 337 forever–shifting, 26 300–3, 381 ST04, 150, 181–82, 200, Breakout Software MonitorIT, monitoring infrastructure, 215, 239, 302, 303, 310, 163 195, 290–92 326, 328, 335, 356–57, Bstat, 171 OS01, 239 361, 381 Budgets, 16, 92, 241 OS07, 181 ST05, 312, 361 Anderson_Index 6/17/04 10:35 AM Page 389

Index 389

ST06, 150, 181, 215, 239, Collaboration, 30, 41, 58 Core script development, 303, 305, 310, 333, 381 Collaboration Engine (SRM), 54 243–44 ST07, 150, 181, 215, 239, Collecting statistics, 321–25, Costs 305–6, 310, 337, 358 328, 333–37 acquisition, 377 ST09, 311 Commands (OS) delta analysis, 377–378 ST10, 330–31, 358 bstat, 171 downtime, 35 ST11, 312 chkdsk, 170 lifecycle, 377 ST12, 311 estat, 171 staffing (people costs), 35, ST22, 312 glance, 168 377–378 STAD, 186, 310–11, gpm, 168 standardization, 30–31 320–21, 324, 330, 333, iostat, 168, 171 CPUs 335, 338–39 lsdev, 168 delta testing, 72, 121, 279, STAT, 310 ping, 138, 163, 372 363 STATRACE, 186, 323 ps, 168 Crash and burn resources Central Instance (CI), 170, 195, sar, 168 (C&B), 196 214, 255, 358, 360, 370 swapinfo, 168, 283 CRM (Customer Relationship Change Control. See Change top, 168, 282 Management). See SAP: Management tracert, 138 Customer Relationship Change Management, 10, 34, vmstat, 168, 282 Management (CRM) 53, 91–92, 101–2, 180, 319 w, 168 Cross-application business Change Waves, 7, 23, 30, 49, Comparative analysis, 130 processes, 25, 56, 225, 236, 89 Competency Centers, 99, 112, 282, 352 Character sets. See Unicode 187, 352, 376 CSV (comma-separated value), CheckIt Diagnostics (or benefits of using, 191–92 175 CheckIt Utilities), 115–16, Component testing, 110, 123, Current–state baseline, 160, 162–63, 212, 213 128, 136, 159, 231–32 193, 376 Checklists Components (mySAP). See Current–state documentation, execution, 173, 192–93, SAP 160–65 205–6, 295, 301, 304, Compression, 12, 171 Customer–specific 323 Computer-Aided Test Tool. See benchmarking, 20, 109, paper–based, 180 CATT; eCATT 232 chkdsk, 170 Computing Center Management Cutover, 15 Christian Metal, 31 System. See CCMS (SAP Citrix MetaFrame. See Computing Center D MetaFrame (Citrix) Management System and Daily operations, 381 Client copies, 239, 273 T–codes) Data Client drivers Concurrent users, 44, 104, 127, clean, 200 installing, 268–69 276 inline data input, 246 sizing, 253, 267, 269 Consolidation (IT), 15, 29–31, list of good data tuning, 282, 285, 287 45–46, 58, 363–64, 382–84 combinations, 249 Clients Constraints, 31–34 Data collection client strategy, 267 Continuous improvement, 107, cutoff, 277 front–end, 6, 38, 96, 125, 287 manual, 163, 280 220, 270, 321 control variables, 25–27 observation (by way of), Client/server, 38, 146 cooling (data center facilities), 181–82 CI. See Central Instance (CI) 85, 104 using SAP CCMS, 44, 180, Clones, 262, 273 Comma-separated value. See 198, 210, 280 Clusters, 25, 68, 132, 166–68, CSV (comma-separated Data General, 4 369–71 value) Data locking, 71 Anderson_Index 6/17/04 10:35 AM Page 390

390 Index

Data types success criteria, 75–78 testing, 5, 46, 103, 203, batch input, 270 systems management 355–57 input, 18, 70, 124, 193, approach, 175–76 tools, 129–36 204–5, 207–9, 270 test infrastructure, 75, 195, tuning, 58, 68–72, 80, input files, 249–51 244 83–85, 129, 132, 144, mapping, 349 Desktop computers 193–94, 204, 214, 240, output, 146, 206, 214, 254, Citrix and desktop TCO, 322, 356–58 231, 254, 260–61 221 upgrades, 48, 69, 72, valid, 230–32, 247, 267 client drivers, 268 364–65 Database Administrator (DBA), inventorying, 163–67 Disaster Recovery. See DR 3, 98, 152 standard configuration, 56 DLLs (Dynamic Link Database connectivity, 56, 146 testing with physical Libraries), 137 Databases desktops, 140–41, 230, DMI (Desktop Management data archiving, 79, 179, 199 234, 241 Interface), 167 Informix, 7, 177, 198, 215 versus virtual clients, Documentation load tools, 121, 122, 124, 242–44, 270 checklists, 13, 75, 173, 180, 129–36, 230–31, 365 Development (Business) 190, 191, 203, 205–6, management tools, 38–39, Sandbox, 61, 62 232, 288, 291, 292, 170–71 Development System, 3, 25, 60, 295–96, 301, 323, 366 Oracle, 4, 56, 73, 103, 146, 72–74 current state, 159–66, 170, 166, 198, 215, 227, 358, Dialog steps, 45, 50, 76, 79, 171, 184, 196–200 377, 383 183, 224, 238–39, 261, 285, Downtime windows, 2, 23, 128, populating via tools, 262 330, 356 366, 380 SQL Server, 4, 73, 102, 127, Disaster Recovery. See DR DR (Disaster Recovery), 373, 129–36, 146, 198, 203, Disk partitions, 27, 83, 133, 378–80 208, 215, 358, 377 208, 224 causes of downtime, 34–35 tuning, 84, 214–16, 356–58 Disk subsystem clusters, 25, 68, 132, DB Request time, 182–83, 308, clones, 262, 273 166–68, 369–71 330, 335, 345, 383 disk controllers, 25, 27, 84, compared to High DB02. See CCMS 86, 133, 167, 196, 213, Availability, 379 DB13. See CCMS 356, 363, 373 downtime clock, 55 DBA Planning Calendar, 358 disk partitions, 133, 224 stress testing (using DR for), Dell OpenManage, 172 LUNs, 83, 298, 322, 355 379–80 Delta analysis, 378 NAS. See NAS (Network Drivers (testing), 27, 116, 120, Delta testing, 71–72, 109, 115, Attached Storage) 166 116, 130, 152, 162, 193, RAID, 5, 68, 194, 203, 214, Dumb luck, 367 279, 363, 383 298, 355–56, 363, 365, Dynamic Link Libraries. See Demand Planning (relative to 369–70 DLLs APO), 53, 91 SAN fabric, 85, 355–56, Dynamo, 133 Design 364–66 goals for your SAP System SAN (Storage Area E Landscape, 66 Network), 5, 31, 46–48, EBP (Enterprise Buyer high-availability strategy, 63, 85, 86, 101, 105, Professional). See SAP: 373–74 167–68, 203, 220, 238, Enterprise Buyer network, 18 302, 355–56, 364–66, Professional (EBP) SAN, 83, 355–56 383 eCATT (extended CATT), 91, SAP System Landscape for SPOFs (single points of 96, 143–44, 149, 158, 221 SEM, 51 failure), 370 Ecora, 162–64 Anderson_Index 6/17/04 10:35 AM Page 391

Index 391

EDI (Electronic Data 147, 152, 167, 205, 216, HP (Hewlett Packard) Interchange), 230 220–21, 231, 302, 322 CCMon (Cluster Consis- Electronic Data Interchange. Front-end tuning, 361–62 tency Monitor), 168 See EDI Functional testing, 3, 15, 91, GetConfig, 162 End users, 43, 109 119, 160, 247 Insight Manager, 162, 172 Endpoints, 127 Functional upgrades, 365–66 Openview, 176–78 EnjoySAP initiative, 123, 126 SAN Management Enterprise Buyer Pro. See SAP G Appliance, 168 EP (Enterprise Portal). See GUI (Graphical user interface) Survey, 162, 164 SAP: Enterprise Portal (EP) HTML SAPGUI, 52, 96, Toptools, 172 Error handling, 232 140, 143, 220 HP-UX, 135, 148, 168, 178, estat, 171 JavaGUI (SAPGUI for 198, 313, 377 eTestingLabs, 120 Java), 52, 96, 140 HTTP, 40, 125, 128, 146, 163, eTimer. See Lab utilities SAPGUI (Win32 GUI), 140, 230 Event trigger. See CCMS (SAP 220–21, 338 Computing Center WebGUI, 52, 96, 140, 143, I Management System and 220 I/O, 18–19, 59, 196, 208, 214 T–codes): SM64 average size of I/Os, 84 Exchange Infrastructure (XI). H client copies, 240 See SAP Hardware defined, 18 Execution checklist. See oversizing, 354 output used in monitoring, Checklists sizing, 83, 215 205–6 Execution windows, 45, 53, 67, sizing questionnaire, 153 requests per second, 83 70, 217, 218, 384–85 sizing relative to BW, 50 tools, 120, 129–36, 167–70, extended CATT. See eCATT sizing relative to MCOD, 58 302, 313 External consultants, 24 sizing relative to pagefiles, IBM AIX. See AIX (IBM) 214 IBM Insight for Oracle F sizing relative to test Database, 171 Failover, 59, 62, 68, 168–69, consoles, 269, 271 IBM Performance Diagnostic 370 sizing relative to upgrades, Tool, 168 Failover testing, 370–71 31 IBM Performance Toolbox, 168 Fat tree, 355 sizing relative to validation, IDE (Integrated Drive FD32, 214, 259 21 Electronics), 363 Feedback, 33, 132, 217, 253, Hardware partitioning, 24, 46 IDES (Internet Demonstration 306 HBAs (host bus adapters), 85, and Evaluation System), 4, File systems, 132–35, 258, 308, 352, 355 234–35 342 High Availability InfoCubes (BW), 18, 225 File System Requests button, ATR, 369 Information Technology (IT), 3 357 compared to DR, 379–80 Informix. See Databases Format, 133, 213 defined, 368–70 Inline data input, 246 Free monitoring tools, 161–65 “five nines of availability,” Input files, 118, 205, 245, 248, Free testing tools. See Test 7 249, 252, 338 tools: Iometer; Jmeter; maximizing, 368 Intel, 7, 98, 103, 145, 227, 363, NTIOGEN; OpenLoad; Horizontal scalability, 214, 377 PenguinoMeter; StressTool 374–75 Internet Information Services FTP, 139, 146, 163, 173 Host bus adapters (HBAs). See (IIS) Front-end clients, 23, 28, 38, HBAs (host bus adapters) capturing current–state data, 72, 81, 86, 104, 124, 140, Hot pluggable, 372 163 Anderson_Index 6/17/04 10:35 AM Page 392

392 Index

Internet Information Services L M (IIS) (cont.) Lab utilities $MACHINE variables. See managing with OpenView, AutoShutdown Pro Variables 177 (Barefoot, Inc), 172 Manual data collection, 163 testing, 116 eTimer (Barefoot, Inc) 78, Manual testing, 240 Internet Transaction Server 173, 300, 303, 314 Management tools. See Systems (ITS) EventComb (Microsoft), management AGate, 204, 302 174–75 MARA, 325 configuring, 86 Ghost (Symantec), 172 MB03, 239 managing with Patrol, PrintKey (freeware by MB1C, 153, 251, 263 177 Alfred Bollinger), 172 MCOD (Multiple Components testing, 86, 103, 116, 227 PsTools. See Test tools on One Database), 31, 46, WGate, 116, 164, 204 Recovery Manager 55, 58–59, 105, 383 Iometer(open source), 133–34 (Winternals), 172 ME23, 239 iostat, 168, 171 Snagit, 139, 173 ME53, 239 iPaq, 12 TxShuttle (WinShuttle) See MeatGrinder. see Test tools, IT Consolidation, 15, 29–31, Test tools MeatGrinder (Compaq/ 45–46, 58, 363–64, 382–84 Landscape. See SAP System HP) IT goals, 33, 65–68, 253, 258, Landscape Memory leaks, 179 259, 265 LANs (local area networks), Memory management. See ITS. See Internet Transaction 85–86, 232, 240, 242, 247 RAM Server (ITS) Latency, 148 MetaFrame (Citrix), 148, 167, J Layers (SAP Technology 204, 221, 279 Stack), 24, 28 Metered Services, 24 Java, 7, 139, 143, 144, 157, illustrated, 29 Microsoft 184–85 Leafs, 355 Biztalk, 230 Java Applets, 171 Level One testing, 72, 231–32 Cluster Server, 166, 372 Java Beans, 148 Level Two testing, 232 MMC (Microsoft Java connectivity and Level Three testing, 232–33 Management Console), interoperability, 230 Linux (SuSe), 85, 179, 320 169 Java developers and coding, Load test tools. See Test Tools MSCS (Microsoft Cluster 212, 360 Local Area Networks. See Services/Server), 166, Java-based test tools, 119 LANs 372 JavaGUI (SAPGUI for Java). Locking down data, 277–78 PerfMon (Microsoft See GUI: JavaGUI Locking down hardware Performance Monitor), (SAPGUI for Java) infrastructure, 278–80 169 JavaScript, 119 Locking down script Scriptomatic, 166 J2EE, 21 development and testing, SQL Profiler, 135 K 278 SQL Server. See SQL Server Locking down test platform, SQLIO, 129–31 Kernel 277 SQLIOStress, 131–32 kernel for (SAP), 169 Logged-in users, 325, 341, 350 Windows 2000, 85, 117, kernel patches, 85, 204 Logon load balancing, 81, 85, 121, 127, 135, 163, 165, kernel updates, 352, 361 254, 281, 284, 305, 311, 166, 271, 282, 363, 383 OS kernels, 21, 313, 373 325, 353 Datacenter Edition, 383 Keyboard input, 137, 175, 246, lsdev, 168 Windows NT, 117, 127, 163, 251, 262 LT06, 263 173–74, 203, 383 Anderson_Index 6/17/04 10:35 AM Page 393

Index 393

Windows Server 2003, 121, GetConfig (HP), 162 nmon. See Commands (OS) 127, 165, 195, 270, 300, glance. See Commands (OS) OpenManage (Dell), 172 383 good monitoring tool, Openview (HP), 176–78 Windows XP, 165, 166, 174, defined, 161 Oracle–aware, 166 270 gpm. See Commands (OS) Oracle Enterprise Manager, MM03, 153, 214, 239 HP CCMon (Cluster 170–71 Monitoring the execution of a Consistency Monitor), Oracle Statspack. See load test, 160, 291–304 168 Statspack (Oracle) Monitoring tools HP DSview, 167 OS commands. See Administrators’ Pak HP Insight Manager, 162, Commands (OS) (Winternals), 175 172 OS utilities. See Commands agent-free, 163 HP MeasureWare, 168 (OS) AssetDB (Compulsion HP Openview, 177 PatchMeister (Ecora), Software), 162, 166, 198 HP PerfView, 169 163–64 Breakout Software, 163 HP Survey, 162, 164 PerfMon (Microsoft CCMon (HP Cluster HP Toptools, 172 Performance Monitor), Consistency Monitor, HP VTDPY, 167 169 168 IBM Insight for Oracle Performance Diagnostic CCMS. See CCMS (SAP Database, 171 Tool (IBM), 168 Computing Center IBM Insight for SAP R/3, Performance Toolbox Management System) 171 (IBM), 168 CCMS Monitoring IBM Performance PerfView (HP), 168 Infrastructure, 184–86 Diagnostic Tool, 168 PrimalScript (Sapien), 139, CEN (SAP Central Moni- IBM Performance Toolbox, 183 toring System), 183–84 168 SAN Management Cluster Administrator Insight for Oracle Database Appliance, 168 (Microsoft), 170 (IBM), 171 Sapien PrimalScript. See CMS (SAP), 183–84 Insight for SAP R/3 (IBM), PrimalScript (Sapien) Compaq Insight Manager, 171 SAP–aware, 159–60 162, 164 Insight Manager SAP CCMS. See CCMS Compaq Survey, 162, 164 (HP/Compaq), 162, 172 (SAP Computing Center Compulsion Software, 162, Lab tools and utilities. See Management System) 166, 198 Lab utilities SAP CCMS Monitors for Configuration Auditor MeasureWare (HP), 168 Optional Components, (Ecora), 163 Microsoft Cluster 183 current–state configuration Administrator, 170 SAP CEN. See Monitoring documentation, 160–66 Microsoft EventComb, tools, CEN (SAP) current–state data collection 164–75 SAP CMS. See Monitoring utilities, 160–66 Microsoft Management tools, CEN (SAP) Dell OpenManage, 172 Console (MMC), 170 scripting, use of, 183 discrete utilities, 160 Microsoft System Scriptomatic (Microsoft), DSview (HP), 167 Information, 162 166 Ecora. See Monitoring tools: MMC (Microsoft SmithMicro. See CheckIt Configuration Auditor Management Console), Diagnostics (Ecora); PatchMeister 170 snap–in modules, 170, 179 EventComb (Microsoft), MonitorIT (Breakout snapshots, used in taking, 164–75 Software), 163 161, 164, 165, 167, 169 Anderson_Index 6/17/04 10:35 AM Page 394

394 Index

Monitoring tools (cont.) CRM (Customer typical noise transactions, SofoTex, 162 Relationship 239 Solution Manager (SAP), Management), 74 use of, 238–39 184–86 EBP. See mySAP SRM using custom Z reports, Solution Manager EP (Enterprise Portal), 4, 18 239 Optimization Services, ERP (Enterprise Resource using SE38 to generate 287 Planning), 5, 73 noise, 239 SQL Enterprise Manager, Financials, 74 170–71 HR (Human Resources), 74 O Statspack (Oracle), 171 MDM (Master Data ODS (Operational Data Store in SSM for Operations (SAP Management), 4 SAP BW), 200, 225 Solution Manager), PLM (Product Lifecycle OpenManage (Dell), 260 184–86 Management), 4 OpenView VantagePoint for Sun Net Manager (Sun), 172 SCM (Supply Chain Operations, 177 Survey (Compaq/HP), 162, Management), 74 Operating Systems (OS) 164 SEM (Strategic Enterprise delta testing, 383 systemwide, 172 Management), 4 pagefile/swap file testing system uptime, capturing, SRM (Supplier Relationship and sizing, 214 164 Management), 4 stress testing, 26, 131–32 TeamQuest, 162 WebAS (Web Application tuning, 23, 84 Toptools (HP), 172 Server), 4, 86, 269 Operational Data Store (ODS), transactional monitors WP (Workplace), 4 200, 225 (SAP), 183 XI (Exchange Operational viability, 68 Troux Technologies, 162 Infrastructure), 4 Oracle. See Databases versus testing tools, 110 tuning table buffers, 358 Virtual Terminal Display N OS01, 239 (HP VTDPY), 167 .NET (dot net), 7, 31, 230 OS07, 181 WinMSD (Microsoft), 162 NAS (Network Attached OS Collector, 180–81 Winternals Administrators’ Storage), 103 OS commands. See Commands Pak, 175 NASA, 300 (OS) Winternals Recovery NetIQ AppManager, 170 OS Monitor. See CCMS (SAP Manager, 172 NetWeaver. See SAP Computing Center WMI, use in monitoring, Network Attached Storage Management System and 166 (NAS), 103 T–codes): ST06 Unicenter (CA) central Networks OS Utilities. See Commands monitoring, 177 latency, 148 (OS) Mouse, 104, 137, 142, 231, network infrastructure, 26, Output 246, 251, 255, 262 28–29, 63, 84, 104, 114, cleaning, 338–40 MRP, 240, 371, 384 124, 125–27, 207–8, charts, tables, and graphs, MSCS, 166, 372 240, 321, 351, 383 344–45 MSEG, 325 storage area networks, 5 chopping off the head and Multiple Components on One stress testing, 84–85 tail, 340–41 Database. See MCOD Noise scripts delta analysis, 343–44 mySAP baselining, 224 dumping into Excel, 341–43 Business Suite, 15–16, 68, creating, 223–24 72, 73, 91, 93, 96, 142, defined, 223 P 144, 149, 321 mixed bag testing, 220 PA03, 239 BI (Business Intelligence), running T–codes twice, 224 Pagefile, 214 74 tips and tricks, 223–24 Paper-based checklists, 180 Anderson_Index 6/17/04 10:35 AM Page 395

Index 395

Patrol (BMC), 177, 182, 196, network protocols, 120, 204, Remote access products 303, 381 208, 270, 272, 383 Citrix MetaFrame, 148, 167, Patrol Script Language, 177 RFC (Remote Function 204, 221, 279 Pay as you go, 2, 24, 194 Call), 221, 237, 321, PC-Duo, 279 PerfMon, 169 324, 361 Windows Terminal Services, Performance, good security protocols (SSL), 279 defined, 9–10 119, 123, 124, 146, 157 Reporting (batch), 210, 211, Performance Monitor, 169 ps, 168 219 Performance Stress Test Utility, PSL (BMC Patrol Script Resiliency, 68 116 Language), 177 Response times, 183 Performance tuning, 8–9 Publishing, 224 application server response Performance tuning team. See time, 67, 80, 246 T3 Q DB Request time, 183, 261 Persistent Staging Area (SAP QA (Quality Assurance) enqueue time, 261 BW PSA), 200 System, 102, 194, 364 front-end average network Physical user, 95, 218 Quarterly Change Waves. See time, 361 Pilot Change Waves GUI Build time, 67, 311, defined, 11 Queries, 18, 21, 67, 151–52, 322, 361 evaluating pilot testing 214, 215, 225 load time, 261 results, 113–14 Questionnaires, 153 network time, 67, 322, 361 fitness criteria, 114 roll time, 261 obtaining software to pilot, R wait time, 67 111–13 R/3 (Enterprise), 1, 126, 178, wall clock time, 67, 78–80, test plan (use during 190, 347 253, 261 piloting), 113 RAID (redundant array of Return on Information (ROI), ping, 138, 163, 372 independent/inexpensive 21–22 PLM (Product Lifecycle disks). See Disk subsystem Return on Investment (ROI), Management), 4 RAID 0+1, See Disk 21–22, 94, 110 POC (Proof-of-Concept), subsystem: RAID Risk 73–74, 215, 232, 371 RAID 5, See Disk subsystem: managing, 3, 107 Post–Go-Live testing, 90 RAID mitigating, 34, 107 Prelaunch systems check, RAM, 24, 84–85 ROI. See Return on Investment 296–97 Ramping up users, 275, 292 (ROI) or Return on Pretuning, 15, 72, 212, 231, Random number generators, Information (ROI) 352 132–33, 252–54 ROI exercise, 217 Pretuning SAP Technology Real Application Clusters RZ03, 312 Stack, 203 (9iRAC), 132, 156 RZ04, 312 Print jobs, 383 Real-world smoke testing. See RZ08, 311 Program buffer (SAP), 283 Carrying capacity RZ10, 239, 360 testing, 329 Recurring costs, 378 RZ20, 184, 239, 302, 308–9, tuning, 329 Registry, 138, 161, 164, 165, 323, 361, 386 Project plan (approach to stress 166, 197 RZ21, 312 testing), 187–88 Regression testing, 30, 145, Promote to Production, 101–2 157, 230 S Proof-of-Concept (POC), Regression test tools, 145, 157 SA38, 312 73–74, 215, 232, 371 Relational Database SAINT, 185 Protocols Management Systems SAN (Storage Area Network). communication protocols, (RDBMSs), 103, 131, 193, See also Disk subsystem 120, 123, 146, 151 258, 313 consolidation, 48, 364–65 Anderson_Index 6/17/04 10:35 AM Page 396

396 Index

SAN (Storage Area Network) Exchange Infrastructure compare throughput among (cont.) (XI), 4 different stacks, 261–62 defined, 5 Internet Demonstration and current-state tools, 161 designing, 365 Evaluation System custom POC testing, 74 HBAs (host bus adapters), (IDES), 4, 234–35 effect of caching, 299 85, 352, 355 Internet Transaction Server execution checklist, 288 monitoring tools, 167–171 (ITS), 4 illustrated, 46 SAN infrastructure testing, Master Data Management monitoring, 159–60, 206, 5, 46, 103, 203, 355–57 (MDM), 4 280, 288, 309 SAN Management MaxDB, 358 pretuning, 15, 187, 203 Appliance, 168 Multiple Components on relative to SAP Basis, 38 SAN switch design, 356–57 One Database (MCOD), relative to Total Cost of virtual, 103, 167, 220 31 Ownership (TCO), 368, Sandbox Systems NetWeaver, 1, 30, 96, 100, 377–78 Business (development), 61, 230 relative to training SAP IT 62 Notes, 23, 352 staff, 61 Development (business), 61, Product Lifecycle replicating Production with 62 Management (PLM), 4 another system, 60 Technical, 51, 61, 193, 194, R/3 (Enterprise), 1, 126, stress test success criteria, 196, 202 178, 190, 347 84–86 SAP SAPDB. See SAP: MaxDB testing, 204, 352–53, 382, Advanced Planner and short dumps, 200 384 Optimizer (APO), 4, 18, Solution Manager. See tuning, 75, 81, 84, 172, 354, 25, 74, 88, 225–26, 235 Monitoring tools 356, 382 AG, 1, 26, 235, 337 Supplier Relationship upgrades, 63, 72 APO. See SAP: Advanced Management (SRM), 4 SAP-aware testing tools, Planner and Optimizer Supply Chain Management 141–49, 268 (APO) (SCM), 74 AutoTester products, 12, 93, Basis, 2, 10, 90, 101, 310 Strategic Enterprise 141–43, 145–46, 152, Basis installation, 102 Management (SEM), 158 Basis noise, 223 4 Compuware products, 12, benchmark kits, 72–74, 86, transactional monitors, 93, 143–44, 146–47, 225 184–86 158, 182, 221 Business Information Web Application Server Mercury Interactive Warehouse (BW), 4, 152 (Web AS), 4, 142, 143, products, 12, 93, BW, 4, 152 149, 225, 243 144–45, 147–49, 152, CEN (Central Monitoring XI, 4 158 System [also CMS]), SAP AG, defined, 1 SAPGUI. See also GUI 183–84 SAP performance validation application server response CMS, 183–84 market, 142 time, 67, 80, 246 Customer Relationship SAP System Landscape, 31–32, DB Request time, 183, 261 Management (CRM), 4, 58–63, 66, 71, 84, 181, 185, enqueue time, 261 18 186, 187, 194 front-end average network DB, 358 SAP Technology Stack, 24, 28, time, 361 defined, 1 29 German field names, 141, Enterprise Buyer aborting a test run, 315 242, 255 Professional (EBP), 4, 18 benchmarking through its GUI Build time, 67, 311, Enterprise Portal (EP), 18, lifecycle, 73, 78, 347, 322, 361 25, 46–47 356 load time, 261 Anderson_Index 6/17/04 10:35 AM Page 397

Index 397

network time, 67, 322, 361 standard subroutines. See SMEs (Subject Matter Experts), OCX controls, 123, 140, Scripts, 90, 92, 97, 180 158, 221 common/standard SMGW, 312 roll time, 261 subroutines Smoke Test staggered SAPGUI login, tips and tricks in coding, carrying capacity, 375–76 256–57 261–63 compared to other forms of wait time, 67 utility scripts, 254–57 stress testing, 216–17 wall clock time, 67, 78–80, variable files, 256–57 defined, 19 253, 261 version control, 301 development of, 19–21 sapevt, 238 virtual, turning physical executing, 110, 131, 216 sapxpg, 238 scripts into, 246, 249–51 real–world smoke testing, sar, 168 SE38, 150–51 375 Scalability Secure Sockets Layer (SSL), SMLG, 312, 318, 325 horizontal, 214, 374–75 119, 123, 124, 146, 157 SMQS, 312 in-the-box, 373 Server IT consolidation, 363 SOAP (Simple Object Access verifying, 373–77 Service Level Agreements Protocol), 230 SCC4, 240 (SLAs), 8, 25, 34, 82, 107, Solaris (Sun), 135, 178, 313, SCC8, 239 125, 367, 368, 371 377 SCCL, 239 Shared resources, 24, 104 Solution characteristics (SAP Scripts Short dumps, 200 design), 31–32 administrative, 252–54 Single Points of Failure, 369 key characteristics, 33 automating a system load, Single-threaded client-driver ranking, 33–34 229–30 process, 275 Solution Manager, 184–86 common/standard Single-unit testing. See Testing Solution viability, 68 subroutines, 248–57 Sizing Solution vision (SAP design), CTRL+S, 263 client drivers, 253, 267, 269 16, 31, 32 data collection, 247, 260, hardware sizing, 83, 215 crafting a solution vision, 32 265 pagefile/swap, 214 defined, 32 data considerations when sizing questionnaire, 153 “eyes wide open,” 34 scripting, 257–59 relative to MCOD, 58 holes, 33 development approach, relative to test consoles, sample goal statements, 32 230–31, 240–43, 262, 269, 271 sp_configure, 198 264, 265 reverse-engineering, 376 Spindles, 194, 203, 214 do–while, 252 Skinny tree, 355 SPOFs. See Single Points of error routines, 252 SM04, 150, 181, 200, 239, 310, Failure input file seeds, 252 325 Spreadsheets, 35, 130, 141, monitoring, 239, 243, 252, SM12, 312, 326, 327 182, 245, 261, 338–39, 259 SM13, 312, 326, 327 344–45 noise, 238–39 SM21, 312 SQL Profiler (Microsoft), 135 pseudorandom number SM36, 238 SQL Server (Microsoft). See generators, 246, 262 SM37, 238, 311 also Databases: SQL Server random-number generators, SM50, 239, 310–11 stored procedures, 135 254, 262 SM51, 239, 261, 300, 312 tuning disk layout, 355–56 read-only test case, 239, 262 SM59, 300, 312 using stress testing to recording, 231 SM64, 238 compare with other SAP-aware commands, SM66, 239, 305–6, 310, 311, databases, 73 246–48 323, 325, 353 SQLIO (Microsoft), 129–31 screen scraping, 248, SMART Plug–Ins (HP SQLIOStress (Microsoft), 254–55 OpenView), 177, 198 131–32 Anderson_Index 6/17/04 10:35 AM Page 398

398 Index

SSAA. See CCMS Strategic Enterprise database management tools, SSL (Secure Sockets Layers). Management, 4 170–71 See Secure Sockets Layer Strawman project plan, Disk subsystem (SSL) 187–190 management tools, 161, SSM for Operations (SAP compared to a 167–68, 171 Solution Manager). See comprehensive plan, Insight Manager Monitoring tools: Solution 189 (HP/Compaq), 162, 172 Manager (SAP) developing the plan, 189 IBM Tivoli, 176, 178–79 ST01, 312 things to avoid, 190 MMC (Microsoft ST02, 215, 239, 310, 329–30, Stress test tools. See Test tools Management Console), 358, 361, 381 Success criteria 170 ST03, 49, 150, 181–83, 215, developing or defining real monitoring tools provided 219, 227, 236–37, 263, 303, world criteria, 75–78 by SAP AG, 180–86 310, 320, 330, 333, 335–39, disk subsystem criteria, 68, NetIQ Application Manager, 356, 358, 361–62, 381, 383 80, 83–84 179 ST03G, 335, 337, 338 identifying real–world OpenManage (Dell), 260 ST03N, 182–83, 219, 310, business processes, Openview (HP), 177 335–38 68–69 Operating System ST03x, 335, 337 network infrastructure management tools, ST04, 150, 181–82, 200, 215, criteria, 72, 84 168–70 239, 302, 303, 310, 326, operating systems criteria, out–of–the–box, 150, 179 328, 335, 356–57, 361, 381 70, 80–83, 84–85 Patrol (BMC), 177, 182, ST05, 312, 361 SAP application server 196, 303, 381 ST06, 150, 181, 215, 239, 303, criteria, 67, 77, 80–81, proxy solution 305, 310, 333, 381 85–87 (AppManager), 179 ST07, 150, 181, 215, 239, Sun Net Manager, 4, 172 rules of thumb, 179–80 305–6, 310, 337, 358 Sun Solaris. See Solaris (Sun) RZ20, 184, 239, 302, 308–9, ST09, 311 Supplier Relationship 323, 361, 386 ST10, 330–31, 358 Management (SRM), 4 SAP CMS, 183–84 ST11, 312 Supply Chain Management, 74 SAP Solution Manager, ST12, 311 SuSe Linux. See Linux (Suse) 184–86 ST22, 312 Swapinfo, 168, 283 SSAA, 312, 381 Stack. See SAP Technology System “descriptors,” 33 test–bed, 179, 268, 364 Stack System–level (stress) testing. Tivoli (IBM), 176, 178–79 STAD, 186, 310–11, 320–21, See Testing: Component Unicenter (CA), 177 324, 330, 333, 335, 338–39. testing Systems testing. See Testing: Staffing. See T3: staffing Systems management Component testing Staggered SAPGUI login, AppManager (NetIQ), 179 256–57 automated scripting, 166, T Staging System, 194 172, 177, 182–83 T–codes (transaction codes). Stakeholders, 32, 66, 162, 268, BMC Patrol, 177, 182, 196, See CCMS (SAP Computing 319, 344 303, 381 Center Management System STAT, 310 CA Unicenter, 177 and T–codes) Statistics collecting, 328–30 CEN, 183–84 automating via scripting, STATRACE, 186, 323 CCMS. See CCMS (SAP 260–61, 283–86, 323–24 STATUS.txt, 314 Computing Center for monitoring and data Steering Committee, 229 Management System) collection, 93, 160, 165, Storage Area Network. See checklists. See Checklists 180, 182, 260–61, Disk subsystem: SAN CMS, 183–84 323–24 Anderson_Index 6/17/04 10:35 AM Page 399

Index 399

T3 (Testing and Tuning Team) preliminary infrastructure, Chariot (NetIQ), 126–27 addressing projects, 92 243–45 CheckIt Diagnostics utility crash(ing) the project Tier one, 195, 215–16 (Smith Micro), 115–16, schedule, 265 Tier two, 195–96 162–63, 212, 213 filling in the gaps, 100–1 Test mixes and workloads, Compuware QALoad, getting “up to speed,” 202 204–5 146–47 leadership, 188–89 Test packages, 211, 217 Compuware TestPartner, mission of, 100, 107 best practices for 143–44 organization, 92–94 assembling, 222 DD (HP Disk to Disk), 135 real-world infrastructure creating, 274–75 eCATT (SAP extended projects, 103–4 end–to–end business Computer Aided Test staffing for functional process–oriented Tool), 149–50 upgrades, 106–7 packages, 223 e–Load (Empirix, formerly staffing for operational functionally focused RSW), 119 change management, packages, 222 HD Tach, 134 101–2 input, 212–13 HiddenSoft AutoIT, 136–38 staffing for tactical needs user–based packages, 222 HP DD,135 and projects, 102–3 validate prior to test run HP HPReadData, 135 staffing for post–go-live, execution, 300 HP LMDD, 135 101 Test plan HP PerfStress, 116 staffing in the real world, piloting (with regard to), HP System Stress Test, 116 89, 92, 101, 107 113–14 HP Thrasher, 116 strategic (long term) Test runs HPReadData (HP), 135 staffing, 91–92, 94–95 analyze test runs, 319–20 Interscan (Trend Micro), training methods (OJT data sources, 322 129, 156 versus formal training), Test System. See QA (Quality IOgen, 132 96–99 Assurance) System Iometer (open source), Tables (database), 325 Test tool piloting, 109–10, 140, 133–34 table buffering, 330–33 154 IOzone, 135 using DB05, 330–33 obtaining support, 114 IP Network Emulator using ST10, 330–31 obtaining pilot software, 111 (PacketStorm TCO (Total Cost of pilot execution, 113 hardware–based tool), Ownership), 30, 159, 189, selecting the right tools, 110 126, 155 374 Test tools Jmeter (Apache), 120 TCO analysis, 374–75 Apache Jmeter, 120 LMDD (HP Linux version TCP/IP, 120, 145, 208, 270 AutoController of HP DD), 135 connections, 145 (AutoTester), 145–46 LoadRunner (Mercury defined, 120 AutoIT (HiddenSoft), Interactive), 147–48 failed communications after 136–38 MeatGrinder (Compaq/HP), a failover, 168 AutoTester ONE 116 Technical foundation, 90 (AutoTester, AT1), Media Load Simulator Technical Sandbox System, 51, 142–43 (Microsoft), 124–25 61, 193, 194, 196, 202 Bench32, 134 Monitoring. See Monitoring replicating the Production Benchmark Factory (Quest), tools System, 194 121–23 Nbench (open source), 134 Test Execution Infrastructure, CATT (SAP Computer NetBench (Ziff Davis 75 Aided Test Tool), 149–50 Media), 120–21 crash and burn resources CCMS (to create a load), Norton NAV LoadSim (C&B), 196 150 (Symantec), 128 Anderson_Index 6/17/04 10:35 AM Page 400

400 Index

Test tools (cont.) ThreadMark (Adaptec), 132 volume, 109 NTIOGEN (Symbios), TxShuttle (WinShuttle), what–if, 376, 381–85 132–33 139–40 XI (Exchange OpenLoad, 120 Visual Test, 140 Infrastructure), 224–27 OpenSTA (open source), WAST (Microsoft), 116–18 Testing and Tuning Team (T3). 123–24 WebBench (Ziff Davis See T3 PAT (HP Performance Media), 121 Test/QA System. See QA Assessment Tool), 135 WebLOAD (RadView), (Quality Assurance) System PenguinoMeter (open 119–20 Three little rules, 385–86 source), 133 Web Application Stress Tool Timers. See Lab utilities: PerfStress (Compaq/HP), (Microsoft WAST), eTimer 116 116–18 Tivoli Storage Manager for Perl, 140 WebBench (Ziff Davis ERP, 178–79 PrimalScript (Sapien), 139 Media), 121 top, 168, 282 PsTools (Sysinternals), WinBench (Ziff Davis Top 10, 237 173–74 Media), 135 Top 40, 210 QALoad (Compuware), WinRunner for R/3 (Mer- Toptools (HP). See Monitoring 146–47 cury Interactive), 144–45 tools QBench, 135 WinShuttle TxShuttle, Top transactions, 237 QCheck (NetIQ), 126–27 139–40 Total Cost of Ownership Quest, 121–23 Test week, 264, 267–89 (TCO). See TCO (Total Cost QuickTest Professional Testable units, 187, 189 of Ownership) (Mercury Interactive), Testing Tracert, 138 144–45, 153 apples–to–apples, 375 Training System, 202 RAIDMark, 135 apples–to–oranges, 353 TU. See Testable units real-time feedback, 306–7 capacity characterization, 72 Tune Summary, 381 regression test tool, 120, 152 component testing, 73, 236 Tuning SAPGUI Scripting, 154 customer–specific business database, 354–55 Sapien, 139 process load, 20 iterative stress testing, 348, SAP-aware tools and test mixed bag, 220 366 suites, 140–49 monkey method, 233 lessons learned in the real SE38 (using SAP “not once, but twice,” world, 362–63 transaction SE38 to drive 293–94 line–in–the–sand–approach, a load), 150 ramping up users, 275–77, 347 SQL Profiler (Microsoft 291–92 proactive, 2, 110, 169, 353 SQL Server 7.0 and 2000 single-unit, 20–21, 71–72, SAP application layer, utility), 135 78, 80, 204, 229–32, 354–61 SQL Trace (SQL 6.5 version 244, 249, 253, 268, SAP Profiles, 360 of SQL Profiler), 135 274–76 SAP Technology Stack, 75, SQLIO (Microsoft), 129–31 using IDES for R/3 testing, 81, 84, 172, 354, 356, SQLIOStress (Microsoft), 234–35 382 131–32 using RSRCATTTRACE for SAPGUI or SAP front–end, StressTool, 120 BW or SEM, 152 361–62 System Stress Test using RSRT for BW or (Compaq/HP), 116 SEM, 152 U TestPartner (Compuware), using RSRTRACE for BW Unicode, 39–40, 57 143–44 or SEM, 151 Unix, 168–69, 171, 178, 179, Thrasher (Compaq/HP), 116 using trained monkeys, 233 282–83, 302, 313 Anderson_Index 6/17/04 10:35 AM Page 401

Index 401

Upgrades, 365–66 vatwrun process, 275–76 Web Services, 39, 42, 163, Uptime, 30, 165, 178, 292, 369 Version control, 194, 301 268 User interface. See GUI Virtual client (AutoController), XML and SOAP, 39 Users. See also End users 145–46, 244–45, 250, WGate (Web Gate, component active, 44, 285, 305, 324, 252–53 of SAP ITS), 116, 164, 204 351 Virtual users, 20–21, 119, 123, Wide Area Networks (WANs), concurrent, 3, 44–47, 77, 141–43, 146–49, 195, 211, 148, 153 229 242, 301–307 Windows 9x, 163 logged–in, 47, 77, 215, 284, benefits of, 140–41, 147, Windows 2000, 85, 117, 121, 294, 325 242–43 127, 135, 163, 165, 166, Utility computing, 24 ramping up, 269, 275–77 271, 282, 363, 383 Utility scripts, 254–57 tools for shrinking staff, 95 Datacenter Edition, 383 Vision. See Solution Vision Windows NT, 117, 127, 163, V Vmstat, 168, 282 173–74, 203, 383 VA01, 21, 70, 81, 141, 154, VMware, 5, 24, 46, 245, 271 Windows Server 2003, 121, 239, 247 Volume testing, 109–10 127, 165, 166, 195, 270, VA03, 154, 214, 239, 263, 305 300, 383 Variables W Windows XP, 165, 166, 174, $MACHINE, 256, 260 w, 168 270 $SAP_SESSION, 256 WANs (wide area networks), Work processes, 101, 183, 204, FI.OUTPUT, 260 148, 158 281, 306, 307, 310, 323, files, 141–44 War room, 242 336, 360, 364 LOGIN.COUNTER, 256 WAST (Web Application Stress Workload baselining, 212 LOGIN.COUNTERTXT, Test), 116–18 256 WBEM (Web-Based Enterprise X RESULTS.OUTPUT, Management), 167 XD03, 239 260–61 Web AS (SAP Web Application XI (Exchange Infrastructure), 4 RESULTS.SCREEN, Server), 4, 142, 143, 149, XML, 39–41, 139, 148, 185, 260–61 225, 243 230