Performance Analysis of Automation Testing Tools for WPF Application
Total Page:16
File Type:pdf, Size:1020Kb
International Journal of Research (IJR) e-ISSN: 2348-6848, p- ISSN: 2348-795X Volume 2, Issue 06, June 2015 Available at http://internationaljournalofresearch.org Performance Analysis of Automation Testing Tools for WPF Application Nishi Tiku1; Ameya Parkar2; Idris Rampurawala3& Aswathi Menon4 1 Head of Department, Department of Master in Computer Application, Vivekanand Education Society’s Institute of Technology - Mumbai, Maharashtra, India 2 Assistant Professor, Department of Master in Computer Application, Vivekanand Education Society’s Institute of Technology - Mumbai, Maharashtra, India 3 Student, Department of Master in Computer Application, Vivekanand Education Society’s Institute of Technology - Mumbai, Maharashtra, India 4 Student, Department of Master in Computer Application, Vivekanand Education Society’s Institute of Technology - Mumbai, Maharashtra, India Abstract Software testing provides a means to reduce defects as early as possible in SDLC. errors, cut maintenance and overall software costs. Testing has become most important Automation testing addresses these challenges parameter in the case of software development presented by manual testing. Automating test lifecycle (SDLC). Testing automation tools enables cases leaves manual testers to focus more on developers and testers to easily automate the writing test cases and analysis of defects and entire process of testing in software development. quality issues in the project. With so many tools in It is to examine & modify source code. Effective the market, in the past comparison studies have Testing produces high quality software. The been done to evaluate features and usability of objective of the paper is to conduct a comparative different tools. It can be executed multiple times study of automated tools such as available in across iterations much faster than manual test market in HP Quick test professional (QTP) and cases, saving time as well as cost. With so many TestComplete (TC). The aim of this research paper tools in the market, in the past comparison studies is to evaluate and compare two automated have been done to evaluate features and usability software testing tools to determine their usability of different tools. There was lack of automated and effectiveness for Windows Presentation test tools so Researches and professionals in test Foundation (WPF) application. Results of this automation industry have produced many tools to study will be helpful to software development automate testing of web. Lengthy test which are professionals to select better test automation tool often skipped during manual test execution can be for their application. executed unattended on multiple machines with different configurations, thus increasing the test Key Words: coverage. SDLC; OS; Unified Functional Testing; Test Complete; Automation; WPF Automation testing helps find the detects or issues which are often overload during manual testing for example spelling mistakes or hard coding in 1. INTRODUCTION application code. All iteration in the software need Organizations have become aware of the crucial to be tested on all applications and all supported role of testing in the SDLC and in delivering high OS. The time and effort spent on scientifically quality software products. Every time the source choosing a test automation product can go a long code is modified, test cases must be executed. way in ensuring successful test execution. Automation also boosts confidence of the testing team by automating repetitive task and enabling Software testing is an integral part of Quality the team to focus on challenging and high risk Assurance in Software development. Software projects Manual execution of test cases is not only testing is aimed at determine how well a software a costly and time consuming exercise, but also system meets the required results. As the prone to error. Test Automation is an emerging competition in IT sector grows stiffer, the pressure field to meet these challenges and increase to deliver large number of high quality products efficiency, report and catch bugs and software with fewer resources in limited time is increasing in intensity. Test automation overcomes few of the Available online:http://internationaljournalofresearch.org/ P a g e | 540 International Journal of Research (IJR) e-ISSN: 2348-6848, p- ISSN: 2348-795X Volume 2, Issue 06, June 2015 Available at http://internationaljournalofresearch.org manual testing limitations of being slow and costly development efforts to verify critical parts of their for the repetitive functional and regression testing. projects such as libraries, models and methods. Manual testing is also not consistent or Historically, testing user interfaces of desktop- deterministically repeatable. These tools vary in based applications via automated tests have been terms of their capabilities and commercially fall in more challenging, and currently available tools for two either paid or open source tools. UFT and Test this are usually commercial and quite expensive. Complete have come up top in the list of paid test automation tools available. Building robust automated GUI tests for desktop applications (e.g. on Windows or Mac systems) is 2. WPF APPLICATION quite difficult, as small changes to the user Windows Presentation Foundation (or WPF) is a interface can often result in broken tests. graphical subsystem for rendering user interfaces in Windows-based applications by Microsoft. Because of the more advantages of the automation WPF, previously known as "Avalon", was initially testing over manual testing, various companies are released as part of.NET Framework 3.0. Rather engaged in developing various automated test than relying on the older GDI subsystem, WPF tools for various applications. There are two types uses DirectX. WPF attempts to provide a of test tools. consistent programming model for building applications and separates the user interface from Open source test tools business logic. It resembles similar XML-oriented Commercial test tools object models, such as those implemented in XUL and SVG. Open Source Test tools: - These test tools are free for the users to use. It can be downloaded WPF employs XAML, an XML-based language, from the internet or can be obtained by the vendor to define and link various interface elements With without any charges e.g. WPF, you can create a wide range of both standalone and browser-hosted applications. WPF Watir aims to unify a number of common user interface Selenium elements, such as 2D/3D rendering, fixed and FunFx adaptive documents, typography, vector graphics, runtime animation, and pre-rendered media Commercial Test Tools: - These test tools are not free and user has to pay for it e.g. WPF applications can also be deployed as standalone desktop programs, or hosted as an TestComplete embedded object in a website. Windows Unified Functional Testing Presentation Foundation (WPF) is a next- Rational robot generation presentation system for building TestArchitect Windows client applications with visually stunning user experiences. These elements can then be linked and manipulated based on various 3.1 Unified Functional Testing (UFT) The UFT is a mixture of HP QTP (GUI testing events, user interactions, and data bindings tool) and HP Service Test (API testing tool). UFT given by Hewlett Packard (HP) is a software 3. AUTOMATION TEST TOOL application used for Automation Testing process Automated software testing is becoming more and to test the software applications, more useful for more important for many software projects in “Functional” and “Regression” testing. UFT’s user order to automatically verify key functionality, test interface is called as an Integrated Development for regressions and help teams run a large number environment (IDE) for the test itself, IDE comes of tests in a short period of time. Many teams with various features which motivate testers to (especially larger projects) still require a develop a complete script which will effectively significant amount of manual functional testing in validate the determination of the test. UFT runs addition to automated testing, either because of the only in a windows environment and uses “VB lack of sufficient resources or skills to automate all Script” scripting language is one that gets tests. interpreted at run time. It supported technologies totally depends on the version of UFT is accessible There are various tools that help software teams for Web, Java (Core and Advanced), .Net, WPF, build and execute automated tests. Many teams are SAP, Oracle, Siebel, PeopleSoft, Delphi, Power actively using unit tests as part of their Builder, Stingray 1, Terminal Emulator, Flex, Web Available online:http://internationaljournalofresearch.org/ P a g e | 541 International Journal of Research (IJR) e-ISSN: 2348-6848, p- ISSN: 2348-795X Volume 2, Issue 06, June 2015 Available at http://internationaljournalofresearch.org Services, Windows Mobile, VisualAge Smalltalk, Based on our findings, we have rated both the Silverlight and mainframe terminal emulators[3]. tools on different qualitative parameters on the scale of 1 to 5; 1 being the lowest. Although HP Unified Functional Testing is usually used for "UI based" Test Case automation, it also Table -1: Qualitative analysis of automation test tools can automate some "non-UI" based test cases, Unified such as file system operations, database testing or Sr. Test Parameters Functional Web services testing [4]. No. Complete Testing 3.2 TestComplete (TC) 1. Tool Features