Testing Strategies for Complex Environments: Agile, SOA

Total Page:16

File Type:pdf, Size:1020Kb

Testing Strategies for Complex Environments: Agile, SOA May/June 2009 Volume 2 SOFTWARE TESTING Testing strategies for complex environments: Agile, SOA • CHAPTER 1 A SOA VIEW OF TESTING • CHAPTER 2 AGILE TESTING STRATEGIES: EVOLVING WITH THE PRODUCT EDITOR’S LETTER 1 Testing in the new worlds of SOA and agile p UNLESS YOU LIVE in a sci-fi novel, Karen N. Johnson in “Agile testing a there’s one rule of thumb for any new strategies: Evolving with the product.” EDITOR’S LETTER place you go: some things are differ- Agile is a more collaborative process ent; some are the same. Usually, suc- and calls for seizing “iterations as a cess, fun or survival in that new place chance to evolve test ideas,” Johnson a depends upon how well you handle writes. Fundamental testing tasks, like CHAPTER 1 A SOA VIEW the differences. In this issue of exploratory and investigative testing, OF TESTING SearchSoftwareQuality.com’s Soft- stay the same, but the productivity of ware Testing E-Zine, the new “places” completing those jobs can increase. are a service-oriented architecture Johnson and Kelly discuss the finer a (SOA) and an agile software develop- points of testing in agile and SOA, CHAPTER 2 AGILE TESTING ment environment. respectively, in this issue’s articles. STRATEGIES: EVOLVING Examining the ins and outs of soft- They also describe revelations they’ve WITH THE ware testing in SOA environments in had while working in those environ- PRODUCT “An SOA view of testing,” consultant ments and best practices they’ve Mike Kelly focuses on the “subtle dif- learned and continue to use. ferences.” What’s the same is that The theme of connectivity runs testers here must start with the through these discussions of SOA and basics. In SOA, the basics are connec- agile testing, as the former focuses on tivity, basic capacity, and authoriza- system connectivity and the latter on tion and authentication—not that dif- human collaboration. Both approach- ferent from other environments. The es, when done well, can help develop- level of complexity of data models, ment and IT organizations achieve however, is very different from that of lower costs and better software. I other architectures and requires some new methods of testing. JAN STAFFORD While agile development requires Executive Editor different testing methods than the [email protected] waterfall model, those differences lie as much in human behavior as in technology, according to consultant 2 SOFTWARE TESTING MAY/JUNE 2009 CHAPTER 1 1 A SOA view of testing The complexity of a service-oriented architecture can complicate testing and make choosing and implementing the right testing tools more difficult. BY MICHAEL KELLY a EDITOR’S LETTER p SERVICE-ORIENTED architectures test. This means people testing SOA (SOAs) are stealthily becoming ubiq- need to be comfortable with varied uitous. Large and small enterprises and changing technology, need to a leverage them to integrate wide understand the various models for CHAPTER 1 A SOA VIEW arrays of disparate systems into a SOA, and should be familiar with OF TESTING cohesive whole. Most companies and the risks common to SOA. project teams that implement SOA do a so to reduce the cost, risk and difficul- CHAPTER 2 ty of replacing legacy systems, acquir- WHY SERVICE-ORIENTED AGILE TESTING ing new businesses or extending the ARCHITECTURES? STRATEGIES: EVOLVING life of existing systems. Large companies typically turn to WITH THE PRODUCT Testing a SOA requires a solid SOA because their existing systems understanding of the SOA design and can’t change fast enough to keep up underlying technology. Yet, SOA’s with the business. Because business complexity makes figuring out the operations don’t exist in discrete or functional purpose of the SOA diffi- finite units, there are a lot of depend- cult and choosing and implementing encies built into existing systems. the right testing tools and techniques SOA is an attempt to separate the to use with it more difficult. system from the business operations SOA is not simply Web services. it supports. This allows companies to According to iTKO (the makers of the incrementally build or decommission TechTarget award-winning SOA test- systems and minimizes the impact of ing tool LISA), nine out of 10 Web changes in one system to changes in services also involve some other type another. of technology. In addition, they state Implementing a SOA removes that most testing for SOA isn’t done the requirement of direct integration, at the user interface level. It’s done which results in business operations using either specialized tools or as that are easier to understand. That part of an integration or end-to-end translates into a more testable system 3 SOFTWARE TESTING MAY/JUNE 2009 overall. Over time, this makes it dards such as application-oriented easier to support a broader technolo- networking (AON), WS-Security, gy base, which in turn makes it easier SAML, WS-Trust, WS-SecurityPolicy, to acquire and integrate new systems, or other custom security schemes for extend the life of existing systems data security as well as authorization and replace legacy systems. and authentication. There are a number of different model architectures for implementing I Load balancing: SOAs are often SOA, including publish and subscript designed to spread work between (often called “pub/sub”), request resources to optimize resource and reply, and synchronous versus utilization, availability, reliability asynchronous. In addition, they can and performance. a be implemented in a broad range EDITOR’S LETTER of technologies, including message- I Translation: As data moves oriented middleware (MOM), through a SOA, it’s often converted simple HTTP posts with DNS routing, or changed based on business rules a Web services, MQ series, JMS (or or reference data. CHAPTER 1 A SOA VIEW some other type of queuing system) OF TESTING and even files passed in batch I Logging: For monitoring and processes. auditing, SOAs often implement If you’re testing a SOA you need multiple forms of logging. a to understand the implementation CHAPTER 2 AGILE TESTING model and technologies involved, I Notification: Based on the model STRATEGIES: EVOLVING because these typically combine to of SOA implemented, different notifi- WITH THE give you some common features of cations may happen at different PRODUCT a SOA. These features often become times. a focal point for your testing. They commonly include: I Adapters: Adapters (both custom and commercial) provide APIs to I Transformation and mapping: access data and common functions As data moves through a SOA, it’s within a SOA. often transformed between data formats and mapped to various standard or custom data schemes. FIGURING OUT WHAT TO TEST The first thing you need to do when I Routing: The path information you start figuring what to test for your takes as it moves through a SOA SOA is to develop (or start develop- is often based on business rules ing) your test strategy. When I’m embedded at different levels of faced with a new project and I’m not the architecture. sure where to start, I normally pull out the Satisfice Heuristic Test Strate- I Security: SOAs often use stan- gy Model and start there. Each sec- 4 SOFTWARE TESTING MAY/JUNE 2009 Feeling the Agile Rush? Test Faster With TestComplete7 The Easiest 7 TestComplete Ever! Agile development moves fast, too fast for manual testing alone. In an agile environment you need automated testing tools to succeed. Check out TestComplete from AutomatedQA. TestComplete lets anyone automate tests for the widest range of technologies like Web, Ajax, Windows, .NET, Java, Flash, Flex and Silverlight. TestComplete has won four Jolt awards, been voted Best Testing Tool Script-Free Test Creation and yet it's still aordable. Simple to learn and easy to extend TestComplete's extensive feature set and Download and Customize Extensions Pre-built and custom add-ons make great price has long made it the choice of complex tests point and click easy expert testers. Now version 7 adds script-free test creation and a simplied Unmatched Technology Support user interface so new testers can get New technology? No problem! Rapid productive fast. TestComplete 7's easy support for the latest software automated testing lets your entire QA team Price and Performance Leader test more, test faster and ship on time with Unsurpassed features and a low price condence. to make you smile. Start Testing In Minutes! Download TestComplete now and start Download testing today. TestComplete FREE www.testcomplete.com AutomatedQA(978) 236-7900 tion of the Satisfice Heuristic Test I Project environment: What fac- Strategy Model contains things you’ll tors will be critical to your success need to consider as you think about and the success of the in-house team your testing: as you take over this work? How will you take in new work, structure your I Test techniques: What types of release schedules, or move code testing techniques will you be doing? between teams, phases or environ- What would you need to support ments? What are the business drivers those types of testing in terms of to moving to a SOA and how will people, processes, tools, environ- those come into play while you’re ments or data? Are there specific testing? things you need to test (like security, a transformation and mapping, or load Recognize that as you think of EDITOR’S LETTER balancing) that may require special- these questions, it’s a matrix of con- ized techniques? cerns. A decision (or lack of decision) in each of these categories affects the a I Product elements: What product scope of the decisions in the other CHAPTER 1 A SOA VIEW elements will you be covering in your three.
Recommended publications
  • IBM Research Report Proceedings of the IBM Phd Student Symposium at ICSOC 2006
    RC24118 (W0611-165) November 28, 2006 Computer Science IBM Research Report Proceedings of the IBM PhD Student Symposium at ICSOC 2006 Ed. by: Andreas Hanemann (Leibniz Supercomputing Center, Germany) Benedikt Kratz (Tilburg University, The Netherlands) Nirmal Mukhi (IBM Research, USA) Tudor Dumitras (Carnegie Mellon University, USA) Research Division Almaden - Austin - Beijing - Haifa - India - T. J. Watson - Tokyo - Zurich Preface Service-Oriented Computing (SoC) is a dynamic new field of research, creating a paradigm shift in the way software applications are designed and delivered. SoC technologies, through the use of open middleware standards, enable collab- oration across organizational boundaries and are transforming the information- technology landscape. SoC builds on ideas and experiences from many different fields to produce the novel research needed to drive this paradigm shift. The IBM PhD Student Symposium at ICSOC provides a forum where doc- toral students conducting research in SoC can present their on-going dissertation work and receive feedback from a group of well-known experts. Each presentation is organized as a mock thesis-defense, with a committee of 4 mentors providing extensive feedback and advice for completing a successful PhD thesis. This for- mat is similar to the one adopted by the doctoral symposia associated with ICSE, OOPSLA, ECOOP, Middleware and ISWC. The closing session of the symposium is a panel discussion where the roles are reversed, and the mentors answer the students’ questions about research careers in industry and academia. The symposium agenda also contains a keynote address on writing a good PhD dissertation, delivered by Dr. Priya Narasimhan, Assistant Professor at Carnegie Mellon University and member of the ACM Doctoral Dissertation Committee.
    [Show full text]
  • Design and Architectures for Signal and Image Processing
    EURASIP Journal on Embedded Systems Design and Architectures for Signal and Image Processing Guest Editors: Markus Rupp, Dragomir Milojevic, and Guy Gogniat Design and Architectures for Signal and Image Processing EURASIP Journal on Embedded Systems Design and Architectures for Signal and Image Processing Guest Editors: Markus Rupp, Dragomir Milojevic, and Guy Gogniat Copyright © 2008 Hindawi Publishing Corporation. All rights reserved. This is a special issue published in volume 2008 of “EURASIP Journal on Embedded Systems.” All articles are open access articles distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Editor-in-Chief Zoran Salcic, University of Auckland, New Zealand Associate Editors Sandro Bartolini, Italy Thomas Kaiser, Germany S. Ramesh, India Neil Bergmann, Australia Bart Kienhuis, The Netherlands Partha S. Roop, New Zealand Shuvra Bhattacharyya, USA Chong-Min Kyung, Korea Markus Rupp, Austria Ed Brinksma, The Netherlands Miriam Leeser, USA Asim Smailagic, USA Paul Caspi, France John McAllister, UK Leonel Sousa, Portugal Liang-Gee Chen, Taiwan Koji Nakano, Japan Jarmo Henrik Takala, Finland Dietmar Dietrich, Austria Antonio Nunez, Spain Jean-Pierre Talpin, France Stephen A. Edwards, USA Sri Parameswaran, Australia Jurgen¨ Teich, Germany Alain Girault, France Zebo Peng, Sweden Dongsheng Wang, China Rajesh K. Gupta, USA Marco Platzner, Germany Susumu Horiguchi, Japan Marc Pouzet, France Contents
    [Show full text]
  • Middleware-Based Database Replication: the Gaps Between Theory and Practice
    Appears in Proceedings of the ACM SIGMOD Conference, Vancouver, Canada (June 2008) Middleware-based Database Replication: The Gaps Between Theory and Practice Emmanuel Cecchet George Candea Anastasia Ailamaki EPFL EPFL & Aster Data Systems EPFL & Carnegie Mellon University Lausanne, Switzerland Lausanne, Switzerland Lausanne, Switzerland [email protected] [email protected] [email protected] ABSTRACT There exist replication “solutions” for every major DBMS, from Oracle RAC™, Streams™ and DataGuard™ to Slony-I for The need for high availability and performance in data Postgres, MySQL replication and cluster, and everything in- management systems has been fueling a long running interest in between. The naïve observer may conclude that such variety of database replication from both academia and industry. However, replication systems indicates a solved problem; the reality, academic groups often attack replication problems in isolation, however, is the exact opposite. Replication still falls short of overlooking the need for completeness in their solutions, while customer expectations, which explains the continued interest in developing new approaches, resulting in a dazzling variety of commercial teams take a holistic approach that often misses offerings. opportunities for fundamental innovation. This has created over time a gap between academic research and industrial practice. Even the “simple” cases are challenging at large scale. We deployed a replication system for a large travel ticket brokering This paper aims to characterize the gap along three axes: system at a Fortune-500 company faced with a workload where performance, availability, and administration. We build on our 95% of transactions were read-only. Still, the 5% write workload own experience developing and deploying replication systems in resulted in thousands of update requests per second, which commercial and academic settings, as well as on a large body of implied that a system using 2-phase-commit, or any other form of prior related work.
    [Show full text]
  • Getting Started with Testcomplete 7
    * Windows and the Windows logo are trademarks of the Microsoft group of companies. 2 Table of Contents Table of Contents INTRODUCING AUTOMATED TESTING AND TESTCOMPLETE .....................................................3 Automated Testing......................................................................................................................................3 Test Types ...................................................................................................................................................3 TestComplete Projects and Project Items...................................................................................................4 TestComplete User Interface......................................................................................................................5 TestComplete Test Object Model................................................................................................................6 Checkpoints and Stores ..............................................................................................................................8 CREATING YOUR FIRST TEST..................................................................................................................9 1. Creating a Test Project.........................................................................................................................10 2. Defining Applications to Test ...............................................................................................................11 3. Planning
    [Show full text]
  • Scheduling Many-Task Workloads on Supercomputers: Dealing with Trailing Tasks
    Scheduling Many-Task Workloads on Supercomputers: Dealing with Trailing Tasks Timothy G. Armstrong, Zhao Zhang Daniel S. Katz, Michael Wilde, Ian T. Foster Department of Computer Science Computation Institute University of Chicago University of Chicago & Argonne National Laboratory [email protected], [email protected] [email protected], [email protected], [email protected] Abstract—In order for many-task applications to be attrac- as a worker and allocate one task per node. If tasks are tive candidates for running on high-end supercomputers, they single-threaded, each core or virtual thread can be treated must be able to benefit from the additional compute, I/O, as a worker. and communication performance provided by high-end HPC hardware relative to clusters, grids, or clouds. Typically this The second feature of many-task applications is an empha- means that the application should use the HPC resource in sis on high performance. The many tasks that make up the such a way that it can reduce time to solution beyond what application effectively collaborate to produce some result, is possible otherwise. Furthermore, it is necessary to make and in many cases it is important to get the results quickly. efficient use of the computational resources, achieving high This feature motivates the development of techniques to levels of utilization. Satisfying these twin goals is not trivial, because while the efficiently run many-task applications on HPC hardware. It parallelism in many task computations can vary over time, allows people to design and develop performance-critical on many large machines the allocation policy requires that applications in a many-task style and enables the scaling worker CPUs be provisioned and also relinquished in large up of existing many-task applications to run on much larger blocks rather than individually.
    [Show full text]
  • Runtime Monitoring of Web Service Choreographies Using Streaming XML
    Runtime Monitoring of Web Service Choreographies Using Streaming XML ∗ Sylvain Hall´e Roger Villemaire University of California, Santa Barbara Universit´edu Qu´ebec `aMontr´eal Department of Computer Science C.P. 8888, Succ. Centre-ville Santa Barbara, CA 9310-65110 Montreal, Canada H3C 3P8 [email protected] [email protected] ABSTRACT web services. Since most web services exchange XML mes- A wide range of web service choreography constraints on sages, one can refer to a recorded trace as an XML “docu- the content and sequentiality of messages can be translated ment” that can be analyzed using standard XML tools, us- into Linear Temporal Logic (LTL). Although they can be ing for example the XML Query Language (XQuery) [19,28]. checked statically on abstractions of actual services, it is However, most works attempting to tap on the resources desirable that violations of these specifications be also de- available in XQuery engines operate in a post mortem fash- tected at runtime. In this paper, we show that, given a ion: an instance of a choreography must be finished be- suitable translation of LTL formulæ into XQuery expres- fore analysis can take place on a complete XML document. sions, such runtime monitoring of choreography constraints While in some cases, a post mortem analysis on recorded is possible by feeding the trace of messages to a streaming traces is appropriate, there exist situations where violations XQuery processor. The forward-only fragment of LTL is in- of a specification must be addressed as soon as they are troduced; it represents the fragment of LTL supported by discovered.
    [Show full text]
  • Advanced Digital Broadcast Holdings S.A. Annual Report
    ADVANCED DIGITAL BROADCAST HOLDINGS S.A. ANNUAL REPORT 2006 Art Director: Ireneusz Golka Contents To Our Shareholders ……………… 6 Business, Operations and Strategy … 9 Corporate Governance …………… 29 Consolidated Financial Statements … 57 Statutory Financial Statements … 101 2006 : a technology year Business Highlights Revenue growing 5% to US$ 262 million Record half-year revenue at US$ 164.3 million 6 new Set-Top Box customers Hansenet (Germany, IPTV), Island Media (US, Satellite), ITI Neovision (Poland, Satellite), Telefonica O2 Czech Republic (Czech Republic, IPTV), Telecom Project 5 (Russia, Terrestrial), Jazztel (Spain, IPTV) Shift to high-end: HD-MPEG4 products at 20% of 2006 Revenue First significant sales in Americas 6% of the Group’s full-year revenue Long-term strategic partnership with ITI Neovision of Poland encompassing full-fledge collaboration, exclusivity and financial arrangements IPTV up 41%, Satellite up 140%, SW & Services up 220% compensated weak Italian DTT market and technical delays Awarded in Europe’s 500 - Entrepreneurs for Growth ranked 173 of 500 companies selected amongst 28 countries, for having achieved 58% annual compound average growth rate and the creation of more than 190 jobs, primarily in Europe, over 2002-2005 4 o ADB HOLDINGS o ANNUAL REPORT 2006 Strengthening ADB Group : High-End Focus a technology leader IN % OF 2006 DIGITAL TV EQUIPMENT SEGMENT REVENUE HD products in Italian RAI and UK BBC HD trials n MPEG2 SD, Others 62% n MPEG4 SD 16% World’s first hybrid, single-chip, n MPEG4 HD 22% advanced video coding,
    [Show full text]
  • Buyers Guide Product Listings
    BUYERS GUIDE PRODUCT LISTINGS Visual Studio Magazine Buyers’ Guide Product Listings The 2009 Visual Studio Magazine Buyers’ Guide listings comprise more than 700 individual products and services, ranging from developer tooling and UI components to Web hosting and instructor-led training. Included for each product is contact and pricing information. Keep in mind that many products come in multiple SKUs and with varied license options, so it’s always a good idea to contact vendors directly for specific pricing. The developer tools arena is a vast and growing space. As such, we’re always on the prowl for new tools and vendors. Know of a product our readers might want to learn more about? E-mail us at [email protected]. BUG & FEATURE TRACKING Gemini—CounterSoft Starts at $1189 • countersoft.com • +44 (0)1753 824000 Rational ClearQuest—IBM Rational Software $1,810 • ibm.com/rational • 888-426-3774 IssueNet Intercept—Elsinore Technologies Call for price • elsitech.com • 866-866-0034 FogBugz 7.0—Fog Creek Software $199 • fogcreek.com • 888-364-2849; 212-279-2076 SilkPerformer—Borland Call for price • borland.com • 800-632-2864; 512-340-2200 OnTime 2009 Professional—Axosoft Starts at $795 for five users • axosoft.com • 800-653-0024; SourceOffSite 4.2—SourceGear 480-362-1900 $239 • sourcegear.com • 217-356-0105 Alexsys Team 2.10—Alexsys Surround SCM 2009—Seapine Software Starts at $145 • alexcorp.com • 888-880-2539; 781-279-0170 Call for price • seapine.com • 888-683-6456; 513-754-1655 AppLife DNA—Kinetic Jump Software TeamInspector—Borland
    [Show full text]
  • Web Services, CORBA and Other Middleware
    Web Services, CORBA and other Middleware © Copyright IONA Technologies 2002 Dr. Seán Baker IONA Technologies Web Services For The Integrated Enterprise, OMG Workshop, Munich Feb 2003 Overview • There a number of different types of middleware – So what does Web Services offer? © Copyright IONA Technologies 2002 IONA © Copyright 2 2 Middleware • Middleware enables integration, but there are multiple – competing – choices: –CORBA –J2EE –.NET © Copyright IONA Technologies 2002 IONA © Copyright – Various MoM & EAI proprietary middleware – Web Sevices – the new kid on the block. 3 3 There’s lots of choice • Some based on technical grounds, including: – RPC versus message passing – Java specific versus multi-language – Direct versus indirect communication – Permanent versus occasional connection © Copyright IONA Technologies 2002 IONA © Copyright – Platform versus integration middleware • Some based on personal choice 4 4 Intra-enterprise versus inter-enterprise • Most middleware has been designed for intra- enterprise • Inter-enterprise adds at least two challenges – Firewalls ( & inter-enterprise security in general) © Copyright IONA Technologies 2002 IONA © Copyright – Different middleware may be used at the two ends • As well as different operating system, languages, etc 5 5 Web Services • Aims to address both of these issues – Its protocol is layered on HTTP • So it can flow through a firewall • This “cheat” raises security and other concerns, but ones that need to be addressed in any case – It uses XML to format messages © Copyright IONA
    [Show full text]
  • Operating System Vs. Middleware
    What is Middleware? Application Application Middleware Middleware Operating System Operating System Software that functions as a conversion or translation layer. • It is also a consolidator and integrator. – Custom-programmed middleware solutions have been developed for decades to enable one application to communicate with another that either runs on a different platform or comes from a different vendor or both. • Today, there is a diverse group of products that offer packaged middleware solutions. AP 04/07 Operating System vs. Middleware Application Middleware Operating System AP 04/07 1 The Middleware Layer Distributed Application Distributed Application Middleware API Middleware API Middleware Middleware Operating System API Operating System API Operating System Operating System (Processes, Communication, (Processes, Communication, Memory Management) Memory Management) Network AP 04/07 Purpose and Origin • Middleware is connectivity software that consists of a set of enabling services that allow multiple processes running on one or more machines to interact across a network. • Middleware is essential to migrating mainframe applications to client/server applications and to providing for communication across heterogeneous platforms. – This technology has evolved during the 1990s to provide for interoperability in support of the move to client/server architectures (see Client/Server Software Architectures). • The most widely-publicized middleware initiatives are the – Open Software Foundation's Distributed Computing Environment (DCE), – Object Management Group's Common Object Request Broker Architecture (CORBA), and – Microsoft's COM/DCOM (Component Object Model) AP 04/07 2 Technical Detail • Middleware servi ces are set s of di st rib ut ed soft ware that exist between the application and the operating system and network services on a system node in the network.
    [Show full text]
  • Computer Science (CS) 1
    Computer Science (CS) 1 CS 2133 Computer Science II COMPUTER SCIENCE (CS) Prerequisites: CS 1113 with a grade of "C" or better. Description: Recursive algorithms. Intermediate methods of searching CS 1003 Computer Proficiency and sorting. Mathematical analysis of space and time complexity, worst Description: For students with minimal personal computer skills. case, and average case performance. Course previously offered as CS Use of Internet and productivity software such as word processing, 3333. spreadsheets, databases, and presentation software. The ability to log on Credit hours: 3 to a personal computer, access the OSU network, and access OSU Web Contact hours: Lecture: 3 Contact: 3 sites is assumed. Previously offered as CS 1002. Levels: Undergraduate Credit hours: 3 Schedule types: Lecture Contact hours: Lecture: 3 Contact: 3 Department/School: Computer Science Levels: Undergraduate CS 2351 Unix Programming Schedule types: Lecture Prerequisites: CS 1113 or EET 2303 with a grade of "C" or better. Department/School: Computer Science Description: The UNIX programming system. The programming CS 1013 Computer Science Principles environment. The UNIX file system and the shell. Use of pipes and filters. Description: Computing as a creative human activity, abstraction to Course previously offered as CS 3451. reduce detail and focus on concepts relevant to understanding and Credit hours: 1 solving problems, describing data and information to facilitate the Contact hours: Lab: 2 Contact: 2 creation of knowledge, discuss algorithms as tools for developing and Levels: Undergraduate expressing solutions to computational problems, use programming is Schedule types: Lab a creative process that produces computational artifacts; and discuss Department/School: Computer Science digital devices, systems, and the networks that interconnect them.
    [Show full text]
  • Anatomy of an Automated Testing Framework
    MONTHLY NEWSLETTER July 2009 - Pragmatic Software Newsletters Anatomy of an Automated Testing Framework Last month we discussed why companies embark on automated testing, why some companies fail in this effort, and how using a keyword driven automated testing framework can increase your chance of success. To view that newsletter, visit http://www.pragmaticsw.com/newsletters/Newsletter_2009_06_SP.htm. This month we discuss the key ingredients of an automated testing framework that can lead to automation success. Why Automate Your Test Cases? Many companies run their regression test cases manually, so when does it make sense to begin automating your regression test cases? It makes sense to automate your test cases when you can no longer run the regression test cases on each build created. For example, if you are doing daily or weekly builds of your code to quality assurance and you cannot quickly run your regression test cases with each build, it is time to consider automating them. Automating your test cases provide these benefits: Quicker Releases – By having your regression test cases run automatically, your software quality team can concentrate on testing new features of your software and less time regressing existing features. Higher quality releases – Your software releases will have fewer bugs and require less customer support because they will be of higher quality. Happier Customers – Your customers will be happier and more willing to serve as testimonials for future prospects. What is an Automated Testing Framework? Most automated tools require the test engineer to understand a scripting language (VB Script, Java Script, etc.) to write their automated test cases.
    [Show full text]