Arnold ffirs.tex V4 - 08/02/2007 10:24am Page v Professional Software Testing with Visual Studio® 2005 Team System ToolsforSoftwareDevelopers andTestEngineers Tom Arnold Dominic Hopton Andy Leonard Mike Frost Wiley Publishing, Inc. Arnold frontcover1.tex V4 - 08/02/2007 10:23am Page ii Arnold frontcover1.tex V4 - 08/02/2007 10:23am Page i Professional Software Testing with Visual Studio® 2005 Team System Introduction . .xxiii Chapter 1: Introduction to VSTEST and VSTESD . 1 Chapter 2: A Quick Tour of VSTEST and VSTESD . 15 Chapter 3: Unit Testing with VSTEST and VSTESD . 41 Chapter 4: Testing the Database . 73 Chapter 5: Web Testing . 125 Chapter 6: Using Manual, Ordered, and Generic Test Types . 165 Chapter 7: Load Testing . 191 Chapter 8: Using Code Analysis and Dynamic Analysis. 243 Chapter 9: VSTEST and VSTESD within the Software Development LifeCycle.....................................................273 Appendix A: Installing Team Explorer . 305 Appendix B: Creating and Running a Web Test: A High-Level Walk-Through ...............................................313 Appendix C: Creating and Running a Unit Test: A High-Level Walk-Through ...............................................319 Appendix D: Creating and Running a Load Test: A High-Level Walk-Through ...............................................327 Appendix E: Creating and Running a Manual Test: A High-Level Walk-Through ...............................................339 Appendix F: Other Sources of Information . 347 Index....................................................................351 Arnold frontcover1.tex V4 - 08/02/2007 10:23am Page ii Arnold ffirs.tex V4 - 08/02/2007 10:24am Page iii Professional Software Testing with Visual Studio® 2005 Team System Arnold ffirs.tex V4 - 08/02/2007 10:24am Page iv Arnold ffirs.tex V4 - 08/02/2007 10:24am Page v Professional Software Testing with Visual Studio® 2005 Team System ToolsforSoftwareDevelopers andTestEngineers Tom Arnold Dominic Hopton Andy Leonard Mike Frost Wiley Publishing, Inc. Arnold ffirs.tex V4 - 08/02/2007 10:24am Page vi Professional Software Testing with Visual Studio® 2005 Team System: Tools for Software Developers and Test Engineers Published by Wiley Publishing, Inc. 10475 Crosspoint Boulevard Indianapolis, IN 46256 www.wiley.com Copyright © 2007 by Wiley Publishing, Inc., Indianapolis, Indiana Published simultaneously in Canada ISBN: 978-0-470-14978-2 Manufactured in the United States of America 10987654321 Library of Congress Cataloging-in-Publication Data Professional software testing with Visual Studio 2005 team system : tools for software developers and test engineers / Tom Arnold ... [et al.]. p. cm. Includes index. ISBN 978-0-470-14978-2 (paper/website) 1. Computer software–Testing. 2. Microsoft Visual studio. I. Arnold, Tom, 1967- QA76.76.T48P76 2007 005.1’4–dc22 2007026308 No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 646-8600. Requests to the Publisher for permission should be addressed to the Legal Department, Wiley Publishing, Inc., 10475 Crosspoint Blvd., Indianapolis, IN 46256, (317) 572-3447, fax (317) 572-4355, or online at http://www.wiley.com/go/permissions. Limit of Liability/Disclaimer of Warranty: The publisher and the author make no representations or warranties with respect to the accuracy or completeness of the contents of this work and specifically disclaim all warranties, including without limitation warranties of fitness for a particular purpose. No warranty may be created or extended by sales or promotional materials. The advice and strategies contained herein may not be suitable for every situation. This work is sold with the understanding that the publisher is not engaged in rendering legal, accounting, or other professional services. If professional assistance is required, the services of a competent professional person should be sought. Neither the publisher nor the author shall be liable for damages arising herefrom. The fact that an organization or Website is referred to in this work as a citation and/or a potential source of further information does not mean that the author or the publisher endorses the information the organization or Website may provide or recommendations it may make. Further, readers should be aware that Internet Websites listed in this work may have changed or disappeared between when this work was written and when it is read. For general information on our other products and services please contact our Customer Care Department within the United States at (800) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002. Trademarks: Wiley, the Wiley logo, Wrox, the Wrox logo, Wrox Programmer to Programmer, and related trade dress are trademarks or registered trademarks of John Wiley & Sons, Inc. and/or its affiliates, in the United States and other countries, and may not be used without written permission. Visual Studio is a registered trademark of Microsoft Corporation in the United States and/or other countries. All other trademarks are the property of their respective owners. Wiley Publishing, Inc., is not associated with any product or vendor mentioned in this book. Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic books. Arnold ffirs.tex V4 - 08/02/2007 10:24am Page vii For Siobhan. I love you. —TomArnold To all the underappreciated testers in the world. — Dominic Hopton To Christy, Stevie Ray, and Emma Grace. — Andy Leonard To my family for their love and support all these years, especially Dad for encouraging my interest in computers. And to Sarah, who makes my life complete. — Mike Frost Arnold ffirs.tex V4 - 08/02/2007 10:24am Page viii Arnold fauth.tex V4 - 08/02/2007 10:28am Page ix About the Authors Tom Arnold was a program manager for Microsoft Visual Studio 2005 Team System, specifically for the testing tools. He has also managed other commercial testing tools projects by Microsoft and Rational Software and has spoken at such industry conferences as STAR, Microsoft Tech Ed, Internet World, and many others. In addition to two other books on software testing, he has produced three video series on the topic and co-founded a 250-employee software testing company (later sold to Lionbridge/Veritest). Tom is currently a program manager at Microsoft on the OfficeLive.com team. Tom can be reached at http://www.msvstest.com. Dominic Hopton is a software development engineer on the Visual Studio Enterprise Test team at Microsoft. One of the original team members, Dominic helped fashion the new development and testing tools in Visual Studio 2005. He is currently working on the next version of testing tools for Visual Studio. Andy Leonard is a SQL Server database developer, MVP, and engineer. He is a co-author of Professional SQL Server 2005 Integration Services. He founded and manages VSTeamSystemCentral.com. Andy’s experience includes web application architecture and development, VB.NET, ASP, and ASP.NET; SQL Server Integration Services (SSIS); data warehouse development using SQL Server 2000 and 2005; and test-driven database development. Mike Frost is a senior ‘‘software design engineer in test’’ (i.e., a software tester who mostly writes code) at Microsoft. Over the last 10 years he has worked on several releases of Visual Studio with a focus on the infrastructure and architecture used for testing software. Currently he is working on the new OfficeLive.com service product. Arnold fauth.tex V4 - 08/02/2007 10:28am Page x Arnold fcredit.tex V4 - 08/02/2007 10:29am Page xi Credits Executive Editor Production Manager Robert Elliott Tim Tate Development Editor Vice President and Executive Group Publisher Kelly Talbot Richard Swadley Technical Editors Vice President and Executive Publisher Paul Schafer Joseph B. Wikert Chris Massie Bill Barnett Proofreader Michael Fanning Nancy Carrasco Production Editor Indexer Debra Banninger Melanie Belkin Copy Editor Project Coordinator, Cover Cate Caffrey Adrienne Martinez Editorial Manager Anniversary Logo Design Mary Beth Wakefield Richard Pacifico Arnold fcredit.tex V4 - 08/02/2007 10:29am Page xii Arnold fack.tex V4 - 08/02/2007 10:30am Page xiii Acknowledgments Tom Arnold: Thank you to Wiley Press and Wrox for inviting me to participate: Bob Elliott, Kelly Tal- bot, Debra Banninger, and everyone else. Siobhan Quinn, thank you for joining me at countless coffee shops while I typed and you laughed at my cheesy jokes. To the Visual Studio team — specifically Sam Guckenheimer, Jim Sather, Chris Lucas, Gabriel Marius, and my fellow Program Managers — thank you for the chance to be a part of something that reaches literally millions of developers worldwide. Rob Arnold, my brother and mentor, thank you for your constant encouragement. My co-authors — Dominic, Andy, and Mike — thank you guys for signing up! Thank you to our technical editors — Paul, Chris, Bill, and Michael — for keeping us honest. Mikky Anderson, Bruce Johnson, and Sridhar Chandrashekar, thank you for supporting my efforts. Thank you, Mom and Dad, for everything. Dominic Hopton: Thanks have