DOCSLIB.ORG

Fast and Scalable Automation Framework : “Booster”

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Fast and Scalable Automation Framework : “Booster” WHITEPAPER Fast and Scalable Automation Framework : “Booster” Testing is a form of software business insurance. More automation coverage means less risk. and that is good news for everyone. Sonal Pallewar Email : [email protected] “Automation Framework” and “Why do we need a framework for test automation?” A framework is a software solution that can be used in place of ordinary code that offers generic functions. Some of the challenges of automation are: ● Writing and maintaining test automation frameworks Booster– Linux based ● Scaling to high number of simultaneous tests in multithreaded various environments automation framework ● Reporting and analytics of large number of test results to assess test coverage and build quality ● Ease of use to extend and maintain the framework ● Rich libraries that can be leveraged for quick delivery of automation ”Booster” addresses the above challenges and is used to automate and test several web and mobile frontend applications as well as backend components by executing hundreds of simultaneous tests. Booster is a best-fit Linux based multithreaded automation framework that is fast, scalable and easily extensible. Booster also has readily available rich web, mobile, Linux libraries that can be leveraged to quickly build product specific tests without investing much time in interaction with web and mobile UI interfaces. 1 Need of Booster framework Linux Based Booster is a Linux based framework Supports remote execution of web tests Supports remote execution of tests in target environments with the help of paramiko python library. Supports frontend and backend automation Consists of a rich set of Selenium, mobile and Linux libraries Selenium Grid Supports serial and parallel execution of tests, Multi-platform support i.e. Windows, Linux and Multi-browser support i.e. Chrome, Firefox, Edge, Safari and also supports headless browser Integration with CI tools Booster supports integration with Jenkins and Bamboo 2 Web Interface to manage automation suites and report test results Rich web Interface to centrally define and manage test automation. The user interface helps end users to quickly define test environments, test suites and execute tests quickly. Containerized Deployment Easy to deploy Booster Support for Python 3.x Booster upgraded from Python 2.7 to 3.5 addressing issues like Print statement, HTMLTestRunner had to be made compatible with respect to screenshot attachment in execution reports in case of failure, Unicode/Decode conversions, syntaxes and deprecated support for some dictionary functionalities, handled iterable objects instead of lists, handled NameError for xrange Future Enhancements WEB PERFORMANCE TESTING API TEST AUTOMATION 3 Tools & Technology Platform – Ubuntu Programming Language – Python_3.5 Multi-threading using Python thread library UI – HTML, CSS, JavaScript, Test Data – json Django Template Backend – Apache Tomcat, Database – MySQL Selenium Grid 4 Booster Architecture Configurations Testdata Config Testdata Loader Database TESTDATA Logs Test Scripts EXECUTE TEST SUITES Selenium Grid Appium Reports Test Runner TEST EXECUTOR 5 By Design 6 7 About AFour Technologies Established in 2007, AFour Technologies (a.k.a. AFour) focuses on Software Product Engineering Services comprising UI/UX Design, Architecture Design and Consulting, Software Development, DevOps (CloudOps, SysOps and DBOps), QA (Test Strategy and Implementation, Test Automation, Performance, Security) and Monitoring. With an excellent track record of over 10 years and a focus on software product engineering, AFour is a true example of self-belief, consistency, and transparency. AFour is an ideation The company is a hub of Till date, AFour and technology house. every cutting-edge Technologies has Product companies technology in software been able to bring associate with AFour engineering Hyper- together some of for its product convergence, SDN, the best and conceptualization and Virtualization, Next brightest minds in technology skills in a wide Generation Data Center software range of technologies like Technologies, Networking, engineering. Java, Python, .NET, Enterprise Mobility. JavaScript (MEAN), LAMP (Perl and PHP), Angular, React, C++. 8.
Load more

Recommended publications
  • A Study on Functioning of Selenium Automation Testing Structure
    Volume 7, Issue 5, May 2017 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Study on Functioning of Selenium Automation Testing Structure 1Jyoti Devi, 2Kirti Bhatia, 3Rohini Sharma* 1, 2 Sat Kabir Institute of Technology and College Management Bahadurgarh, Haryana, India 3 Jesus and Mary Delhi University Delhi, India DOI: 10.23956/ijarcsse/V7I5/0204 Abstract— In recent years, there is advancement in the field of software engineering, applications are getting automated. As the software is error prone, there should some easy and automated way to test the software application. It is very challenging to test such complicated web applications. Human intervention can be reduced by using automation tools. Selenium is an online web based software testing tool. In this article, we have study the design and functioning of the selenium tool and used it to test various online applications. In order to test an application, testers do need not to learn the selenium web driver tool completely. This tool is helpful for a developer and tester, they can analyse their code owing to screen shot characteristics of framework. It generates the adapted test report to the tester. It is very simple to sustain and restore the test suite for new version of the application by this tool. Keywords—Selenium; Automated Testing; Test Cases; Report Generation I. INTRODUCTION The objective of software testing is to discover faults and errors in a software application. Software testing utilizes more than 50 % time of software development lifecycle. Testing time depends upon the algorithm used, programming language, line of codes, function points, external and internal interfaces [1].
    [Show full text]
  • Selenium Python Bindings Release 2
    Selenium Python Bindings Release 2 Baiju Muthukadan Sep 03, 2021 Contents 1 Installation 3 1.1 Introduction...............................................3 1.2 Installing Python bindings for Selenium.................................3 1.3 Instructions for Windows users.....................................3 1.4 Installing from Git sources........................................4 1.5 Drivers..................................................4 1.6 Downloading Selenium server......................................4 2 Getting Started 7 2.1 Simple Usage...............................................7 2.2 Example Explained............................................7 2.3 Using Selenium to write tests......................................8 2.4 Walkthrough of the example.......................................9 2.5 Using Selenium with remote WebDriver................................. 10 3 Navigating 13 3.1 Interacting with the page......................................... 13 3.2 Filling in forms.............................................. 14 3.3 Drag and drop.............................................. 15 3.4 Moving between windows and frames.................................. 15 3.5 Popup dialogs.............................................. 16 3.6 Navigation: history and location..................................... 16 3.7 Cookies.................................................. 16 4 Locating Elements 17 4.1 Locating by Id.............................................. 18 4.2 Locating by Name............................................ 18 4.3
    [Show full text]
  • Scraping Sites That Use Search Forms
    Chapter 9 Scraping Sites that Don’t Want to be Scraped/ Scraping Sites that Use Search Forms Skills you will learn: Basic setup of the Selenium library, which allows you to control a web browser from a Python script. Filling out a form on a website and scraping the returned records. Introduction: Sometimes, websites throw up hurdles, deliberately or incidentally, that can make scraping more difficult. For example, they may place cookies on your computer containing values that must be resubmitted with the next request to the server, failing which the request will be ignored or redirected to the landing page. These cookies may expire after a set period of time and have to be regenerated by the server. Ordinary scraping scripts using libraries such as urllib2 may fail when you attempt to scrape these kinds of sites because the script doesn’t send the expected values. Similarly, pages may contain hidden import fields (basically form fields that are not visible to the user) that automatically submit long strings of alphanumeric characters to validate the request. Again, the script fails to submit the required string, and the request fails or is redirected. On other occasions, you may need to fill out a form before the server will send data, or you may wish to use the form to selectively choose which data to scrape. Selenium allows us to deal with these challenges because it controls an actual browser, such as Firefox, and when the script “clicks” a submit button, as an example, any cookies, hidden form fields, or JavaScript routines are handled by the browser just as they would be if a human user had clicked the button.
    [Show full text]
  • Getting Started with Appium
    GETTING STARTED WITH APPIUM By Jonathan Lipps Ruby Edition 2018.1 TABLE OF CONTENTS 3 The Preface 17 Using the Appium Desktop Inspector 4 Ch. 1: Introduction 20 Ch. 4: Writing Your First Test 4 The Appium Vision 25 Ch. 5: Introduction to Page Objects 5 The Appium Drivers 30 Ch. 6: Android Joins the Party 5 The Appium Clients 35 Ch. 7: Running Local Tests with Rake 7 Ch. 2: Getting Set Up 36 Ch. 8: Running Tests in the Sauce Labs Cloud 7 Assumed Knowledge 40 Annotating Tests on Sauce 7 iOS-specific System Setup 41 Ch. 9: Automating Test Runs with a CI Server 7 Android-specific System Setup 41 Setting up Jenkins 8 Appium Setup 42 Creating an Android Build 8 Appium From the Command Line 44 Creating an iOS Build 8 Appium From Appium Desktop 44 Running on Sauce 10 Ruby Client Setup 44 Jenkins for Production 10 Project Setup 46 Heading Out on Your Own 11 Known Working Versions 46 Resources 12 Ch. 3: Exploring Your App 47 Support 12 Using the Appium Ruby Console PREFACE This little e-book will help you get started with Appium using the Ruby programming language. It is a complete revision from the ground up of an earlier guide written by Dave Haeffner, who along with Matthew Edwards deserves a lot of thanks for all the work put into the first edition. Appium is an open source project that is always changing, and guides like this one will never be accurate forever. When possible I will indicate which versions of various software are being used, which might help in ensuring reproducibility of the code samples used here.
    [Show full text]
  • Selenium Framework Amework Tutorial
    APPENDIX B: SELENIUM FRAMEWORK TUTORIAL This appendix is a tutorial about implementing the Selenium framework for black -box testing at user level. It also contains code examples on how to use Selenium. The goal with this tutorial is to show how to implement and use the Selenium testing framework. Selenium is a black-box testing framework that focuses on testing the web -based user interface of a system without the need of learning a scripting language. It accomplishes this in different ways and some of these are brought up in this tutorial. Before using this tutorial, i t is assumed that NetBeans 7.0.1 or above has been installed together with Mozilla Firefox web browser 26.0 or above. The user should have access to the Java EE Web project, The Recruitment System. This tutorial has only been tested on a PC running Windows 7. It has not been verified to work on other o perating systems but there should not be any major differences since this tutorial focuses on NetBeans a nd Mozilla Firefox. 1.1 Downloading the necessary files. Visit the Selenium official website at: http://docs.seleniumhq.org/download/ Download and install the latest Selenium IDE release, called selenium-ide -x.y.z.xpi. A link to a direc t download and install is available in the main page. Firefox will prompt to restart. Do so. When downloading the plug -in, Firefox may ask to allow installing of third party software as shown in Figure 1. Click accept . Figure 1 – The pop up that needs to be confirmed for the Selenium plug -in to be installed.
    [Show full text]
  • Unit Testing of Java EE Web Applications
    Unit Testing of Java EE Web Applications CHRISTIAN CASTILLO and MUSTAFA HAMRA KTH Information and Communication Technology Bachelor of Science Thesis Stockholm, Sweden 2014 TRITA-ICT-EX-2014:55 Unit Testing of Java EE Web Applications Christian Castillo Mustafa Hamra Bachelor of Science Thesis ICT 2013:3 TIDAB 009 KTH Information and Communication Technology Computer Engineering SE-164 40 KISTA Examensarbete ICT 2013:3 TIDAB 009 Analys av testramverk för Java EE Applikationer Christian Castillo Mustafa Hamra Godkänt Examinator Handledare 2014-maj-09 Leif Lindbäck Leif Lindbäck Uppdragsgivare Kontaktperson KTH/ICT/SCS Leif Lindbäck Sammanfattning Målet med denna rapport att är utvärdera testramverken Mockito och Selenium för att se om de är väl anpassade för nybörjare som ska enhetstesta och integritetstesta existerande Java EE Webbapplikationer. Rapporten ska också hjälpa till med inlärningsprocessen genom att förse studenterna, i kursen IV1201 – Arkitektur och design av globala applikationer, med användarvänliga guider. ii Bachelor thesis ICT 2014:6 TIDAB 009 Unit Testing of Java EE web applications Christian Castillo Mustafa Hamra Approved Examiner Supervisor 2014-maj-09 Leif Lindbäck Leif Lindbäck Commissioner Contact person KTH/ICT/SCS Leif Lindbäck Abstract This report determines if the Mockito and Selenium testing frameworks are well suited for novice users when unit- and integration testing existing Java EE Web applications in the course IV1201 – Design of Global Applications. The report also provides user-friendly tutorials to help with the learning process. iii PREFACE The report is a Bachelor Thesis that has been written in collaboration with the Department of Software and Computer Systems (SCS), School of Information and Communication Technology (ICT), Royal Institute of Technology (KTH).
    [Show full text]
  • Distributed Testing with Selenium Grid
    Distributed Testing with Selenium Grid In this chapter we will cover: f Setting up Selenium Grid Server for parallel execution f Adding Windows/IE node to Selenium Hub f Adding Mac/Firefox node to Selenium Hub f Adding iPhone/iWebDriver node to Selenium Hub f Adding Android node to Selenium Hub f Creating and executing Selenium script in parallel with TestNG f Creating and executing Selenium script in parallel with Python f Setting up Selenium with Jenkins CI for parallel execution Introduction Organizations are adopting virtualization and cloud-based technologies to reduce costs and increase efficiency. Virtualization and cloud-based infrastructure can also be used to scale the test automation by reducing investment in physical hardware needed to set up the test environment. Using these technologies, web applications can be tested on a variety of browser and operating system combinations. Selenium WebDriver has unmatched support for testing applications in virtual environment, executing tests in parallel, reducing costs, and increasing speed and coverage. This chapter will cover recipes to configure and execute Selenium WebDriver tests for parallel or distributed execution. Distributed Testing with Selenium Grid Running tests in parallel requires two things: an infrastructure to distribute the tests and a framework that will run these tests in parallel in the given infrastructure. In this chapter, we will first create a distributed infrastructure and then create some tests, which will be executed in this distributed test environment. Selenium Grid Selenium Grid transparently distributes our tests across multiple physical or virtual machines so that we can run them in parallel, cutting down the time required for running tests.
    [Show full text]
  • Study of Browser Based Automated Test Tools WATIR and Selenium
    International Journal of Information and Education Technology, Vol. 4, No. 4, August 2014 Study of Browser Based Automated Test Tools WATIR and Selenium Nisha Gogna Abstract—Web testing is the name given to software testing II. WATIR (4.0) that focuses on web applications. Complete testing of a web Watir (Web Application Testing in Ruby, pronounced based system before going live can help address several issues. Manually testing is a time consuming practice and is difficult to water), is an open-source (BSD) family of Ruby libraries for repeat but can’t be overlooked. Each time a software does not automating web browsers as specified in Table I. perform to specifications; the program will record and report It drives Internet Explorer, Firefox, Chrome, Opera and the exact command that caused the problem. Once the problem Safari, and is available as a RubyGems gem. Watir was is identified and the bug is fixed, one can execute the very same primarily developed by Bret Pettichord and Paul Rogers. set of commands to verify the success. There are a number of Watir is an open-source (BSD) library for automating web commercial and open source tools available for assisting with the development of test automation. In this paper, automated browsers. It allows writing tests that are easy to read and test tools named WATIR (Web Application Testing in Ruby) maintain in a simple and flexible manner. and Selenium are proposed to support the automated test Like other programming languages, Ruby gives the power scenario for web based applications. to connect to databases, read data files and spreadsheets, export XML, and structure the code as reusable libraries.
    [Show full text]
  • Benchmarking Web-Testing - Selenium Versus Watir and the Choice of Programming Language and Browser
    Benchmarking Web-testing - Selenium versus Watir and the Choice of Programming Language and Browser Miikka Kuutila, M3S, ITEE, University of Oulu, Finland Mika Mäntylä, M3S, ITEE, University of Oulu, Finland Päivi Raulamo-Jurvanen, M3S, ITEE, University of Oulu, Finland Email: [email protected], Postal address: P.O.Box 8000 FI-90014 University of Oulu Abstract Context: Selenium is claimed to be the most popular software test automation tool. Past academic works have mainly neglected testing tools in favour of more methodological topics. Objective: We investigated the performance of web-testing tools, to provide empirical evidence supporting choices in software test tool selection and configuration. Method: We used 4*5 factorial design to study 20 different configurations for testing a web-store. We studied 5 programming language bindings (C#, Java, Python, and Ruby for Selenium, while Watir supports Ruby only) and 4 Google Chrome, Internet Explorer, Mozilla Firefox and Opera. Performance was measured with execution time, memory usage, length of the test scripts and stability of the tests. Results: Considering all measures the best configuration was Selenium with Python language binding for Google Chrome. Selenium with Python bindings was the best option for all browsers. The effect size of the difference between the slowest and fastest configuration was very high (Cohen’s d=41.5, 91% increase in execution time). Overall Internet Explorer was the fastest browser while having the worst results in the stability. Conclusions: We recommend benchmarking tools before adopting them. Weighting of factors, e.g. how much test stability is one willing to sacrifice for faster performance, affects the decision.
    [Show full text]
  • Parallelizing Tests with Docker Compose and Selenium Grid I Knew Parallelism Could Be Achieved from Selenium Grid, but I Had Little Experience Working with It
    How to Remove Dependencies to Speed Up Release Time Noah Kruswicki Software Development Engineer in Test (SDET) III Accusoft www.accusoft.com Shifting Sands One of the challenges facing modern software development is what I have often heard called “shifting sands.” It means the differing pace of revision in the software you rely on. Sometimes revisions can impact your sprints. For our specific case in SaaS QA, the fast pace of Chrome and Firefox development means putting in a request with IT to update a Teamcity agent, who would then prioritize it for a future sprint. This could mean waiting weeks for changes, and in one case, we had fallen behind 2 versions of Chrome and our browser was no longer compatible with the Chrome driver. Now expand this problem to all the other dependencies we had such as NodeJS, Java, OS version, etc. and you quickly have a maintenance nightmare. To solve this issue, I started exploring the use of running our test suite in a Docker container so that we only needed an updated Teamcity agent when Docker updated. www.accusoft.com Docker Container Testing After implementing the solution, I had a dockerfile that looked something like this: # Set the base image FROM ubuntu # wget RUN apt-get update RUN apt-get install wget -y # Chrome RUN apt-get install gnupg -y RUN wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add - RUN sh -c ‘echo “deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main” >> /etc/apt/sources. list.d/google-chrome.list’ RUN apt-get update RUN apt-get install google-chrome-stable -y # Add non-root user RUN useradd --create-home -s /bin/bash tester WORKDIR /home/tester USER tester # NVM RUN wget -qO- https://raw.githubusercontent.com/creationix/nvm/v0.33.11/install.sh | bash www.accusoft.com To run my tests on Docker in Teamcity, I used the Docker plugin/runner.
    [Show full text]
  • USING the GROOVY ECOSYSTEM for RAPID JVM DEVELOPMENT Schalk W
    USING THE GROOVY ECOSYSTEM FOR RAPID JVM DEVELOPMENT Schalk W. Cronjé #ACCU2016 ACCU Bristol 2016 ABOUT ME Email: [email protected] Twitter / Ello : @ysb33r 1 2 SDKMAN Manages parallel version of multiple SDKs Mostly for (but not limited to) JVM-related systems Windows users can use Posh-GVM (Powershell) Windows 10 Bash ?? curl -s http://get.sdkman.io | bash 3 . 1 SDKMAN DEMO 3 . 2 SdkMan: http://sdkman.io Posh-GVM: https://github.com/ofreud/posh-gvm @sdkmanager 3 . 3 APACHE GROOVY A dynamic & static typed language for the JVM with REPL capability. 3 . 4 GROOVY VS JAVA In Groovy: All class members are public by default No need to create getters/setters for public elds Both static & dynamic typing supported def means Object 4 . 1 CALLING METHODS class Foo { void bar( def a,def b ) {} } def foo = new Foo() foo.bar( '123',456 ) foo.bar '123', 456 foo.with { bar '123', 456 } 4 . 2 CALLING METHODS WITH CLOSURES class Foo { void bar( def a,Closure b ) {} } def foo = new Foo() foo.bar( '123',{ println it } ) foo.bar ('123') { println it } foo.bar '123', { println it } 4 . 3 MAPS IN GROOVY Hashmaps in Groovy are simple to use def myMap = [ plugin : 'java' ] Maps are easy to pass inline to functions project.apply( plugin : 'java' ) Which can also be written as project.with { apply plugin : 'java' } 4 . 4 LISTS IN GROOVY Lists in Groovy are simple too def myList = [ 'clone', 'http://github.com/ysb33r/GradleLectures' ] This makes it possible write a method call as args 'clone', 'http://github.com/ysb33r/GradleLectures' 4 .
    [Show full text]
  • Getting Started with Selenium
    BROUGHT TO YOU IN PARTNERSHIP WITH CONTENTS ∙ What Is Selenium? ∙ Getting Started Getting Started ∙ Launching a Browser ∙ Commands and Operations ∙ Locators With Selenium ∙ An Example Test ∙ Page Objects ∙ Waiting ∙ Screenshots on Failure ∙ Running Tests in Parallel WRITTEN BY DAVE HAEFFNER AUTHOR OF ELEMENTAL SELENIUM ∙ Mobile Support UPDATED BY MARCUS MERRELL DIRECTOR OF TECHNICAL SERVICES, SAUCE LABS WHAT IS SELENIUM? JAVA (WITH MAVEN) Selenium is a free and open-source browser automation library used In your test project, add the following to your pom.xml. Once done, by millions of people for testing purposes and to automate repetitive you can either let your IDE (Integrated Development Environment) web-based administrative tasks. use Maven to import the dependencies or open a command-prompt, cd, into the project directory, and run mvn clean test-compile. It has the support of the largest browser vendors, who have integrated Selenium into the browsers themselves. It is also the <dependency> <groupId>org.seleniumhq.selenium</groupId> core technology in countless other automation tools, APIs, and <artifactId>selenium-java</artifactId> frameworks used to automate application testing. <version>LATEST</version> <scope>test</scope> Selenium/WebDriver is now a W3C (World Wide Web Consortium) </dependency> Recommendation, which means that Selenium is the official standard for automating web browsers. GETTING STARTED Selenium language bindings allow you to write tests and communicate with browsers in multiple languages: • Java • JavaScript • Python • Ruby • C# In order to start writing tests, you first need to install the bindings for your preferred programming language. 1 A brief history of web and mobile app testing. BEFORE SAUCE LABS Devices.
    [Show full text]