Corp Leader in Continuous Quality for over 30yrs

Helping organizations achieve their business deliver goals without sacrificing security or quality 2000+ 250+ CUSTOMERS EMPLOYEES WORLDWIDE

RENEWAL FORTUNE RATE 94+% 85% GLOBAL 500 PATENTS YEARS 9+ 36 32+ COUNTRIES Choosing the Right Solution TASSQ Conference

Chris Colosimo [email protected] Building a scalable strategy

Minimize complex and time consuming, late-cycle, end- to-end testing

Establish broad coverage of easier to diagnose, and focused, API and Unit Tests How are organizations testing?

Quick to define, Time consuming to execute, complex test environment, hard to maintain automation

\

Quick to execute, Simple test environment, easy to automate but more technical expertise required Building a solid testing automation strategy

Selenic Virtualize Reduce the complexity + ‘Shift-left’ test execution with maintainability of Service Virtualization and Selenium testing increase feedback earlier in the development process

SOAtest Automate testing Load Test of “API design” and “API use” + Re-use API tests and reduce integrate into your the business risk with early pipeline stage Load/Performance Testing

Establish a solid foundation of early stage JUnit tests

Code Analysis: Reliability + Security How do you test a faucet Testing a faucet as a part of building a house

Test

Service Virtualization Increasing complexity of testing requirements

Application Under Test

Web End-to-End Automated Testing Performance Security Testing Testing Functional Test Automation Application Under Test

Web End-to-End Automated Testing Performance Security Testing Testing Unavailable or fee-based 3rd Functional Test party systems Automation Application Under Test Uncontrollable behavior

Web “Agile Roadblock”

Unable to ‘shift- left’ performance testing Total control of the Test Environment Performance Security Testing Testing Functional Test Service Virtualization Automation Application 500 Internal Under Test Server Error

Malformed Response Web Expose a security Exception

Test the boundaries of performance Safe Test Data SLAs Environment based approach to testing Dynamic Test Environments

Code Deploy to Functional Performance Penetration Deploy to CheckCheck-in +-in Build Unit Test Analysis Stage Test Test Test Production Two Types of Service Virtualization Solutions

Lightweight Tools • e.g. Traffic Parrot • Easy access You NeedEnterprise Tools • Simple Test Cases • e.g. CA LISA • Internally CustomizableThe Best• Power/Daily Usage • “Free”… Short Term • Comprehensive technology of Both• Team workflows • Vendor Supported Required Features and Capabilities

WhatFinancial doYou Organizationsneed? might need…

Ease of Usage and Optimized Workflows Supported Technologies Automation Management/ Maintenance capability

REST API Virtualization (GET, POST, Visual and Script less Record and playback CI Integration Governance Headers JSON) Rapidly create virtual services before the real service is available (WSDL, Swagger, AI Powered Asset Creation SOAP API Virtualization Build system plugins Environment Management OAS, Schema)

Response Correlation Test Data Management/ Generation Asynchronous API Messaging Command line execution Monitoring

On Premise and Browser based access to Data Driven Responses Data Reuse MQ/JMS Virtualization Open APIs for DevOps integration solution

Service Reusability Service Templates IoT and Microservice Virtualization Cloud support (EC2, Azure) Change Management process

Custom Extensibility Framework Message Routing Database Virtualization

Authentication/ Security (SSL, Oauth, etc) Fail over to live system Webpage Virtualization

Variable Performance delay Stateful Behavior Emulation File Transfer Virtualization

Clustering/ Scaling support Mainframe, Fixedlength,

EDI Virtualization,

FIX, Swift, etc Virtualization Required Features and Capabilities

Telecommunications Organizations might need…

Ease of Usage and Optimized Workflows Supported Technologies Automation Management/ Maintenance capability

REST API Virtualization (GET, POST, Visual and Script less Record and playback CI Integration Governance Headers JSON) Rapidly create virtual services before the real service is available (WSDL, Swagger, AI Powered Asset Creation SOAP API Virtualization Build system plugins Environment Management OAS, Schema)

Response Correlation Test Data Management/ Generation Asynchronous API Messaging Command line execution Monitoring

On Premise and Browser based access to Data Driven Responses Data Reuse MQ/JMS Virtualization Open APIs for DevOps integration solution

Service Reusability Service Templates IoT and Microservice Virtualization Cloud support (EC2, Azure) Change Management process

Custom Extensibility Framework Message Routing Database Virtualization

Authentication/ Security (SSL, Oauth, etc) Fail over to live system Webpage Virtualization

Variable Performance delay Stateful Behavior Emulation File Transfer Virtualization

Clustering/ Scaling support Mainframe, Fixedlength,

EDI Virtualization,

FIX, Swift, etc Virtualization Required Features and Capabilities

Healthcare Organizations might need…

Ease of Usage and Optimized Workflows Supported Technologies Automation Management/ Maintenance capability

REST API Virtualization (GET, POST, Visual and Script less Record and playback CI Integration Governance Headers JSON) Rapidly create virtual services before the real service is available (WSDL, Swagger, AI Powered Asset Creation SOAP API Virtualization Build system plugins Environment Management OAS, Schema)

Response Correlation Test Data Management/ Generation Asynchronous API Messaging Command line execution Monitoring

On Premise and Browser based access to Data Driven Responses Data Reuse MQ/JMS Virtualization Open APIs for DevOps integration solution

Service Reusability Service Templates IoT and Microservice Virtualization Cloud support (EC2, Azure) Change Management process

Custom Extensibility Framework Message Routing Database Virtualization

Authentication/ Security (SSL, Oauth, etc) Fail over to live system Webpage Virtualization

Variable Performance delay Stateful Behavior Emulation File Transfer Virtualization

Clustering/ Scaling support Mainframe, Fixedlength,

EDI Virtualization,

FIX, Swift, etc Virtualization Required Features and Capabilities

Your Service Virtualization solution must have

Ease of Usage and Optimized Workflows Supported Technologies Automation Management/ Maintenance capability

REST API Virtualization (GET, POST, Visual and Script less Record and playback CI Integration Governance Headers JSON) Rapidly create virtual services before the real service is available (WSDL, Swagger, AI Powered Asset Creation SOAP API Virtualization Build system plugins Environment Management OAS, Schema)

Response Correlation Test Data Management/ Generation Asynchronous API Messaging Command line execution Monitoring

On Premise and Browser based access to Data Driven Responses Data Reuse MQ/JMS Virtualization Open APIs for DevOps integration solution

Service Reusability Service Templates IoT and Microservice Virtualization Cloud support (EC2, Azure) Change Management process

Custom Extensibility Framework Message Routing Database Virtualization

Authentication/ Security (SSL, Oauth, etc) Fail over to live system Webpage Virtualization

Variable Performance delay Stateful Behavior Emulation File Transfer Virtualization

Clustering/ Scaling support Mainframe, Fixedlength,

EDI Virtualization,

FIX, Swift, etc Virtualization Choosing the right Service Virtualization solution

To maximize ROI, your Service Virtualization must have

Rapid Service Creation Breadth of technology Broadly accessible Change Management architecture Quickly create stateful Comprehensive protocol and Maintenance of your virtual virtual service from simple to message format support for Team access, collaboration, service library and test data complex without scripting key initiatives and scaling Rapid virtual service creation

• The Challenge: Time lost testing in unstable environments

• Working on a new application with multiple external dependencies • Parallel development was causing instability • Lack of control in test environment • You need virtual services but it take time to create them Application Under Test

Local Environment Rapid virtual service creation

Speed up virtual service creation time

• The Solution: Quickly create stateful services that can intelligently respond to different requests • Automatic creation of services with the service definitions • Instant access to service dependencies through record and playback • Intelligent correlation leads to reusability and test stability • Spend less time configuring services and more time using them Application Under Test

Virtualization Solution

Local Environment Choosing the right Service Virtualization solution

A successful API rollout must have

Rapid Service Creation Breadth of technology Broadly accessible Change Management architecture Quickly create stateful Comprehensive protocol and Maintenance of your virtual virtual service from simple to message format support for Team access, collaboration, service library and test data complex without scripting key initiatives and scaling Common message formats and protocols HTTP/HTTPS HTTP2 JMS MQ TCP/IP Fixed Length

SMTP FIX (Multiple Versions) Protocol Tibco Rendezvous Swift .NET WCF Mainframe RESTful FTP/SFTP •Copybook ISO 8583: 27+ Packagers + JSON RMI custom RAML Apache ActiveMQ • EACORD Swagger/ Open API ApacheQpid • AL3, SOAP Kafka GlassFish MQ • CARGO, XML RabbitMQ IBM WebSphere • EANCOM, Application Server (WAS) • EDIFACT, WSDL MQTT • Edig@s, XML Schema AMQP IBM WebSphere MQ (MQ MessageFormats • HIPAA, Series) SOAP Protocol Buffers JDBC (Other) • HL7 Services Web JBoss JMS PoX (Plain XML) WebSockets ODBC • IATA (various) Open Message Queue • NCPDP (various) XSLT Stored Procedures (OpenMQ) • TRADACOMS MTOM(XOP) / MIME / Oracle Oracle Advanced Queuing • X12 DIME SQLServer (AQ) Equifax GZIP Sybase Oracle BEA WebLogic EJB DB2

Progress Sonic MQ/ESB IoT/Microservice SAP RFC CSV Solace JMS SAP IDoc Excel Sun Java System Message Queue (Sun MQ) SQL TIBCO EMS Mockaroo Sun JMS

File Transfer SQL/NoSQL + Data TCP/IP Breadth of Technology

• The Challenge: Every virtual service is different but you need it at the most critical of times Application • Very high cost of creating services that represent the Under Test proper business logic and interface • Existing tool set doesn't support emerging use of new technology (i.e Microservices and IoT) • High cost of training • Fragmented Virtualization usage across the organization Breadth of Technology Increase QA productivity by being able to test all requirements regardless of technology • The Solution: Comprehensive support for message formats and protocols • One tool to manage all of your virtual services effectively

• A solution that can evolve as technology changes (Extensibility framework) Service Virtualization

Application Under Test Choose a Service Virtualization Solution that enables you to create service across todays, ever changing technologies Choosing the right Service Virtualization solution

A successful API rollout must have

Rapid Service Creation Breadth of technology Broadly accessible Change Management architecture Quickly create stateful Comprehensive protocol and Maintenance of your virtual virtual service from simple to message format support for Team access, collaboration, service library and test data complex without scripting key initiatives and scaling Broadly accessible architecture

• The Challenge: Growing pains of a scaling organization

• Service Virtualization works best when an organization is “All In” • Community of practice requires simple browser based access for ad-hoc usage • Center of excellence requires a powerful desktop for daily usage • Redundancy in virtual service creation and research due to lack of collaboration between teams • Need a centralized authority that manages and deploys virtual services • Prevent lost knowledge due to employee attrition Highly accessible and collaborative architecture

Increase in autonomy and productivity attributed to QA self-sufficiency

• The Solution: A Continuous Testing Platform + Source Control • Virtualization thin client available for all infrequent users of service virtualization • Powerful desktops backed with source control for daily users • Centralized repository of test environments, virtual services, test cases and, test data available to all teams Choosing the right Service Virtualization solution

A successful API rollout must have

Rapid Test Creation Breadth of technology Broadly accessible Change Management architecture Optimal way for test to Comprehensive protocol Maintenance of your keep pace with Agile and message format Team access, virtual service library and development support for key initiatives collaboration, and scaling test data Change Management

• The Challenge: API change disrupts testing deliverables • Business leverages internal and partner APIs heavily in applications • Each time a new version is announced results in 2-6 weeks of test refactoring • Slows down application testing cycles that result in delayed releases

Partner APIs 2-6 weeks Manage Change

Change Management Enables Scalable Maintenance

• The Solution: Automated Change mangement workflows • Run Change Impact Analysis proactively against your APIs monitoring for change • Create change templates that map existing virtual services to new service definitions • Mass updated Services using change templates & search and replace

Change Analysis

3rd Party Application 2-6 weeks

Virtual Service Change management

Maintain Changing Test Data

• The Solution: Using an integrated test data solution to enable true asset ownership and flexibility • Remove the central database and a bottleneck • Simplify data constraints with Virtualize + Test Data (Capture > Model > Extend) • Simulate the dependent service and inject the individuals table in the asset • Create an self-service process to provision “Todays Safe” Test data Database Your Continuous Testing Platform

Use service virtualization to bridge the gap between Dev and Ops

Automated Testing Compliance/Governance Configurability •Executing tests within the context of •Onboarding and enablement can be •Browser based environment the test environment quantified with Asset utilization diagrams enable automated test metrics environment provisioning for DevOps

Continuous Integration Dashboard and reporting Innovation •CI plugins triggering from code •Test results in the context of the •AI powered workflows reduce TCO check-in and gating deployment environment

Measurement and Analytics Monitoring and Alerting Planning and Collaboration •Utilization and hit statistics provide •Health checks and notifications for •workspace for creating, and sharing ROI analytics visibility into test environment ,test artifacts and coordinating the stability execution of testing activities

Reliability Security Tool integrations/ extensions •Leveraging Service Virtualization •Test data masking, automated •Native plugins available for Jenkins, (SV) to build resilience into the test Penetration testing and SV providing Bamboo, Team City and Azure environment secure/safe sandboxes DevOps TL;DR

Every Service Virtualization To maximize efficiency and tool must have ROI you must have • Ease of Usage and capability • Rapid Asset Creation • Optimized Workflows • Breadth of technology • Supported Technologies • Broadly accessible architecture • Automation • Change Management + Test Data • Management/ Maintenance Parasoft Virtualize checks all the boxes

Ease of Usage and Management/ Optimized Workflows Supported Technologies Automation capability Maintenance

REST API Virtualization (GET, POST, Visual and Script less Record and playback CI Integration Governance Headers JSON) Rapidly create virtual services before the real service is available (WSDL, Swagger, AI Powered Asset Creation SOAP API Virtualization Build system plugins Environment Management OAS, Schema)

Response Correlation Test Data Management/ Generation Asynchronous API Messaging Command line execution Monitoring

On Premise and Browser based access to Data Driven Responses Data Reuse MQ/JMS Virtualization Open APIs for DevOps integration solution

Service Reusability Service Templates IoT and Microservice Virtualization Cloud support (EC2, Azure) Change Management process

Custom Extensibility Framework Message Routing Database Virtualization

Authentication/ Security (SSL, Oauth, etc) Fail over to live system Webpage Virtualization

Variable Performance delay Stateful Behavior Emulation File Transfer Virtualization

Clustering/ Scaling support Mainframe, Fixedlength Virtualization

EDI Virtualization

FIX, Swift, etc Virtualization Coming up: Virtualize hands-on training

April 6-7, 2020 Parasoft Virtualize Free Community Edition software.parasoft.com/virtualize/community-edition/ 38