QA Wizard Pro User Guide Version 2017.1 Copyrights © 1996-2017 Perforce Software, Inc. and its subsidiaries. All rights reserved. Defect Scribe, Helix ALM, Helix ALM Suite, Helix Issue Management, Helix Requirements Management, Helix Test Case Management, QA Wizard Pro, Resource Thief, SoloBug, SoloSubmit, Surround SCM, and TestTrack are trademarks or registered trademarks of Perforce Software, Inc. and its subsidiaries in the United States and other countries. Acrobat Reader is a registered trademark of Adobe, Inc. in the United States and other countries. UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company Limited. Apple, Mac, Mac OS, macOS, Macintosh, Objective-C, and Safari are registered trademarks of Apple Computer, Inc. Chrome is a registered trademark of Google Inc. Debian is a registered trademark of Software in the Public Interest, Inc. Firefox is a registered trademark of the Mozilla Foundation. Linux is a trademark of Linus Torvalds. Microsoft, Windows, Windows Server, Windows Vista, MS Windows, Active Directory, Internet Explorer, Outlook, SQL Server, Visual SourceSafe, and Visual Studio are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries. openSUSE and SUSE are registered trademarks of Novell Inc. in the United States and other countries. Oracle and Java are registered trademarks of Oracle and/or its affiliates. Red Hat, Red Hat Enterprise Linux, and Fedora are registered trademarks of Red Hat, Inc. in the United States and other countries. Ubuntu is a registered trademark of Canonical Ltd. All other product names mentioned herein are the trademarks of their respective owners. All other trademarks are the property of their respective owners. No part of this publication may be reproduced, transmitted, transcribed, stored in a retrieval system, or translated into any language in any form by any means without the written permission of Perforce Software, Inc. and its subsidiaries. Your license agreement with Perforce Software, Inc. or any of its subsidiaries, which is included with the product, specifies the permitted and prohibited uses of the product. Any unauthorized duplication or use of this software, in whole or in part, in print, or in any other storage and retrieval system is forbidden. Information in this document is subject to change without notice and does not represent a commitment on the part of Perforce Software, Inc. or any of its subsidiaries. Unless otherwise noted, all companies, products, street addresses, and persons contained herein are purely fictitious. Mention of third-party companies and products is for informational purposes only and does not constitute an endorsement. Perforce Software, Inc. and its subsidiaries 400 N 1st Avenue Suite 200 Minneapolis, Minnesota 55401 USA +1 510.864.7400 [email protected] Contents What's New 1 Installing QA Wizard Pro 3 Before you install 3 Running the installer 4 After installation 6 Getting Started with QA Wizard Pro 7 Key QA Wizard Pro concepts 8 Understanding the testing process 9 Starting QA Wizard Pro 11 Managing licenses 11 QA Wizard Pro interface 11 Application Repository pane 13 Call Stack pane 14 Errors pane 15 Find Results pane 15 Output pane 15 Pending Changes pane 16 Preview pane 16 References pane 17 Reports pane 17 Script pane 18 Statements pane 19 Helix ALM panes 20 Variables pane 20 Workspace pane 21 Sample scripts and applications 22 Creating workspaces 23 Adding existing files to workspaces 23 Using folders 24 Modifying workspace properties 25 Opening workspaces 26 Using Keyword View 27 Using Text View 28 Declaring variables in Text View 29 Declaring arrays in Text View 31 i Creating functions and subroutines in Text View 32 Setting Text View font and color options 34 Customizing QA Wizard Pro 35 Customizing the interface 35 Customizing toolbars 36 Creating toolbars 37 Adding toolbar and menu commands 37 Modifying toolbar and menu commands 38 Setting toolbar and menu options 38 Customizing keyboard shortcuts 39 Setting general options 40 Setting server connection options 43 Setting email notification options 44 Managing Applications 47 Adding applications 47 Copying applications 49 Exporting applications 49 Importing applications 50 Promoting applications 50 Modifying application properties 51 Adding versions 51 Modifying version properties 53 Deleting versions 54 Deleting applications 54 Managing Application Repositories 57 About application repositories 57 Setting up repositories 59 Maintaining repositories 60 Populating repositories 60 Overriding global application startup information 62 Connecting to the global repository 63 Recording Scripts 65 Recording new scripts 65 Selecting the default web browser 68 Recording additional script steps 69 ii Recording low-level actions 70 Adding new scripts 71 Understanding recorded scripts 71 Running Scripts to Perform Tests 73 Running scripts 73 Setting and running a main script 74 Entering login information when running scripts 74 Viewing results reports 75 Exporting results reports 76 Setting playback options 76 Setting reporting options 78 Running multiple scripts 79 Running scripts against a global repository 79 Running scripts from a command prompt 80 Creating batch files 83 Modifying batch files 86 Running batch files 87 Monitoring Script Playback 89 Viewing playback information in the dashboard 90 Dashboard widget types 92 Changing information displayed in dashboard widgets 95 Installing and configuring the dashboard 97 Viewing playback information in the status tool 99 Load Testing 103 Recording load test scripts 103 Running load tests 104 Running load tests from a command prompt 106 Viewing load test results reports 109 Stress Testing 111 Creating and running stress tests 111 Applying stresses 112 Managing Windows and Controls 115 Capturing window and control data 115 Reviewing and saving repository changes 116 Repository change reasons 118 iii About smart matching 118 Overriding naming conventions for new controls 119 Default control naming convention 121 Modifying window and control properties 122 About search methods 124 Changing standard search criteria 124 Editing window and control properties 126 Using regular expressions 127 Changing the search method for multiple controls 128 Using the Function search method 129 Setting advanced control properties 131 Changing control types 132 Renaming windows and controls 133 Finding and replacing property values 134 Merging controls 136 Configuring user-added windows and controls 136 Manually adding windows and controls to application repositories 138 Adding properties to user-added windows and controls 140 Deleting properties from user-added windows and controls 142 Duplicating windows and controls 142 Editing and deleting user-added windows and controls 143 Synchronizing with the application repository 143 Synchronizing multiple scripts with the application repository 144 Testing context menus 144 Modifying Scripts 145 Adding statements 146 Statement value types 147 Using function results as statement arguments 148 Adding browser actions 149 Cleaning up scripts 150 Editing statements 151 Deleting statements 151 Calling scripts from other scripts 151 Finding variable, function, and subroutine references in scripts 153 Finding variable, function, and subroutine definitions in scripts 153 iv Commenting blocks of steps 154 Handling known exceptions 155 Handling script errors 155 Identifying files and directories in statements 156 Finding and replacing text in scripts 157 Finding and replacing text in individual scripts 158 Finding text in multiple scripts 159 Replacing text in multiple scripts 160 Encrypting text 162 Working with text in HTML elements 162 Modifying script properties 163 About drag-and-drop scripting 164 Using Checkpoints 165 Checkpoint types 165 Creating record-time checkpoints 166 Creating record-time check exists checkpoints 168 Creating checkpoints 169 Editing checkpoints 171 Creating exists checkpoints 171 Creating image checkpoints 173 Editing image checkpoints 175 Creating expression checkpoints 176 Creating string exists checkpoints 177 Deleting checkpoints 177 Checkpoint examples 178 Capturing and checking property values during playback 179 Using OCR to Work with Graphical Text 181 Creating OCR checkpoints 183 Troubleshooting OCR issues 186 Creating Data-Driven Scripts 187 About datasheets 187 Creating local datasheets 187 Adding existing local datasheets 188 Importing external test data 189 Linking to external test data 189 v Configuring external datasheets 190 Creating Microsoft Access datasheets 190 Creating Microsoft Excel datasheets 192 Creating Microsoft SQL Server datasheets 193 Creating Oracle datasheets 195 Creating PostgreSQL datasheets 197 Creating SQLite datasheets 199 Creating text file datasheets 200 Associating datasheets with scripts 203 Using datasheet values in scripts 203 Navigating datasheets 205 Retrieving external data with database queries 206 Retrieving external data with script-generated queries 207 Editing local datasheets 208 Modifying local datasheet properties 208 Deleting local datasheets 209 Modifying external datasheet properties 209 Deleting external datasheets 210 Debugging Scripts 211 Running scripts in debug mode 211 Using breakpoints 212 Using the INDEBUGMODE variable 213 Troubleshooting variables 213 Using Repository Variables 215 Creating repository variables 215 Editing repository variables 217 Deleting repository variables 217 Managing repository