Integrating Performance Testing in Your CI/CD Process
Total Page：16
File Type：pdf, Size：1020Kb
Product Flyer Application Delivery Management Integrating Performance Testing in your CI/CD Process Micro Focus® LoadRunner Cloud Makes It Insanely Simple to Integrate Testing into the Development Process—So You Can Test Early and Often. Everything You Need to Make Solution Overview start the testing process earlier, it’s still difficult Automated Testing Easy There’s no question: Continuous performance to actually build performance testing into the testing is critical to the success of your mobile deployment pipeline. ■ Simple, smart, scalable: and web apps. If you don’t test until the end of SaaS-based, pay-per-virtual-user model allows you the cycle—or if you don’t test at all—you risk Performance testing also needs to add value to get started with just a browser and a credit card. production issues, user complaints, poor re- to the business, not just development teams. The software provides graphical, realistic scripting views, and damage to your brand. It needs to improve the quality of the app, cus- and intuitive dashboards. It easily scales up to one tomer satisfaction levels, and the brand image. million virtual users without requiring hardware. The question is how to make continuous per- For application teams, that means the mental- ■ Enterprise-ready: formance and load testing practical in an age ity must change from simple “record/playback” With cross-team project management capabilities, of ever-accelerating development cycles and testing that occurs late in the product cycle to a it supports open APIs for easier enterprise-wide ever-increasing user expectations. Even if more robust engineering approach that starts integration. you’re already using the cloud to cut the cost early in the cycle and occurs continuously. of large-scale testing, and even if you’re al- Simply put: Test early and well, not just quickly. ready using Agile methods to “shift left” and Figure 1. Load Test distribution Product Flyer Integrating Performance Testing in your CI/CD Process Micro Focus has an answer for you. Load Run- or CSV files: LoadRunner Cloud provides Lite records users’ actions as they click ner Cloud, a Cloud Performance testing solu- three easy ways to create a test: 1) Provide through the interface and creates a script. tion, makes it easy to code load testing into your a REST call to be tested, specify the DevOps teams can easily enhance the mobile and web apps, so testing can occur ear- number of virtual users (VUsers), and run script with timing steps, parameterizing step lier, more often, and with much less effort over the test. The VUsers execute the calls arguments, and more. the entire development lifecycle. This solution simultaneously and create a load on your ■ Reusing Selenium scripts for brings together the tools and technologies app. 2) Provide a CSV file containing a performance testing: LoadRunner Cloud DevOps and Agile teams need to test their way, list of REST APIs, simplifying test scripts supports the widely adopted open source using their familiar tools, on their schedule. on required parameters, and import into tool–Selenium. Selenium functional scripts LoadRunner Cloud. 3) Export a HAR (HTTP are very similar to load test scripts. Both The Tools and Technologies, archive) file from any browser, then upload simulating user steps, keyboard inputs, All Together to LoadRunner Cloud, add the number of behavior in different browsers, and so on. VUsers, and run the test. LoadRunner Cloud gives DevOps team’s ac- By reusing the code written for the cess to a full spectrum of standard tools, tech- ■ Git integration: LoadRunner Cloud functional test and modifying it in the nologies, utilities, and other resources so they integrates with the open source Git version context of performance testing, DevOps can quickly and easily code cloud performance control system, enabling you to upload teams obviously save time, have better testing into mobile and web apps. scripts from your Git repository. Now any test coverage, and can rest assured time you update a script, you can push the that the user experience have not In short, you can combine coding and Cloud changes to Git and simply click on “Sync”. been compromised. Per formance testing into a single process using No more version issues; no more sluggish ■ JMeter and Gatling scripting tool support: familiar tools, so you can overcome the obstacles manual uploading. LoadRunner Cloud supports popular open of traditional performance testing. Now it’s easy ■ TruClient Lite support: Micro Focus source testing tools such as JMeter and to create a test, integrate it into CI/CD (continuous TruClient Lite is an extension to the Chrome Gatling, so DevOps teams can easily upload integration/continuous deployment), automate browser that makes it simple to create existing scripts created with these tools into the entire process, understand test results, and load test scripts for web apps. TruClient LoadRunner Cloud and run them. identify the right fix for each issue. No more testing after code-complete. No more painfully slow UI-driven tests. No more summon- ing a performance engineer for assistance. No more manual integration. No more specialists to interpret results. Just script the test, run it, read the results, refine the software. Continuously. The tools and technologies supported by Load- Runner Cloud fall into three broad categories: #1: Script Authoring ■ Open architecture with public, HTTP- based, RESTful API: With LoadRunner Cloud, external systems can call different methods using the API, so developers can implement actions like logging in to LoadRunner Cloud, upload a test, run a test and then analyze the results of a test. ■ Quick and scriptless test creation Figure 2. TruAPI example VU scripts written in JavaScript using a popular IDE—code your performance methods, using REST calls, HAR data test with familiar tools. 2 ■ TruAPI support: The TruAPI scripting tool, trigger tests and collect results from CI/ #3: Real-Time Analysis based on Node.js, provides another way to CD tools, and the command line interface ■ Anomaly detection: LoadRunner Cloud create JavaScript-based VU scripts using (CLI) tool provides a less technical way to enables teams to use powerful analytics your favorite IDE. It provides an API for interact with LoadRunner Cloud. If you’re to visualize and spot anomalies and handling transactions, think time, logging, running Linux, for example, you can simply performance problems and find root and more. TruAPI scripts can be packaged use the CLI tool to run a specific test causes using real-time metrics. Engineers and uploaded to LoadRunner Cloud and without the need to open a browser and can use these insights to speed their added to a test definition. perform multiple steps. diagnosis and investigation into system performance, even see the precise ■ Slack chat bot support: ChatOps is triggers that caused the anomalies. #2: Test Execution becoming immensely popular with ■ Affordable SaaS delivery: LoadRunner DevOps teams because it replaces ■ Real-time breakdown: With its multi- Cloud is a cloud performance testing difficult command line operations with layered approach, LoadRunner Cloud solution hosted and supported in easy informal conversations using the is able to provide the insight needed to Micro Focus data center facilities. You can team’s chat collaboration platform. determine the root cause of detected purchase a subscription with just a credit Micro Focus takes the simplicity a step deviations in real time. card—one month, three months, a year further by giving teams the ability to ■ Multi-monitor support: If you already have and even a few hours—whatever makes communicate with LoadRunner Cloud monitors configured, such as Dynatrace or sense for you. All you need is a browser through Slack chat bots, which harness New Relic monitors, you can just integrate to get started. You can create and run a artificial intelligence and natural them into LoadRunner Cloud and get test in just minutes. You can scale up to language to perform tasks on voice or access to your application data. And if you a million virtual users (VUs). There’s no text commands. It’s an awesome new don’t already have a monitoring tool, Micro need for expensive, dedicated hardware. capability that is still in its early stages, Focus can deploy SiteScope for you out And you pay only for the resources you but you can explore the possibilities of the box to monitor your servers while actually use. using LoadRunner Cloud. you’re running your tests. Network virtualization (NV) network ■ Docker-based load generator support: ■ AWS CodePipeline: This powerful utility ■ With LoadRunner Cloud, engineers helps you automatically build, test, and emulation capabilities: With the integration of Micro Focus Network can now deploy a Docker-based load deploy your applications in the Amazon Virtualization, LoadRunner Cloud can generator (LG), making it fast and easy Web Services (AWS) cloud. Specifically, emulate real-world network conditions. to deploy the LG, load-test internal you can automate your release process During load testing, the solution can applications, and scale on different from end to end, starting from your emulate multiple users and user types as servers. In addition to this private cloud source repository through build, test, well as multiple network conditions such execution capability, LoadRunner Cloud and deployment. You can define a consistent set of steps for every code as Wi-Fi, 3G, 4G, WAN good, WAN typical, users can test Docker container-based mobile typical, mobile good, and so on. data and monitor it via Micro Focus change. You can automate your release WebPagetest: LoadRunner Cloud SiteScope. process to allow your developers to test ■ and release code incrementally and speed leverages this third-party tool, which lets CI/CD frameworks: Jenkins and Bamboo ■ up the release of new features to your you specify the URL of your mobile or support: LoadRunner Cloud integrates with customers.