Architecting TIBCO Streambase Applications Unit 4 Functional Testing

Architecting TIBCO StreamBase Applications Unit 4 Functional Testing

• Test Methodology and Tooling • Test Development Tasks • Types of Tests • Tool Overview • Functional Test Areas

Partial list taken from Project Methodology Unit: We Can Help. . . • by validating/ creating recipes for the application of SB specifics to the general rules • by establishing delivery team discipline around particularly important good practices that often fall by the wayside • by promoting systematic use of lifecycle tool support and integrating into customer SDLC practices and infrastructure

• Test Development Tasks – Test Plan – Test Case Specification – Test Development – Test Data Generation • Functional Testing Infrastructure and DevOps Setup and Integration • CI Server Integration and SLAs • Regression Suite Initiation and Frequency, Results Review and Notification

• Functional Requirements Testing • System Integration Testing • Performance Testing and Tuning • Throughput Metrics • Latency Metric • This is a science; see performance unit

– Failover/Failback Testing • Application Server Failure • Inbound Messaging Server(s) Failover/Failure • Outbound Messaging Server(s) Failover/Failure • Persistence (RDBMS) Server Failover/Failure • Network Failure • Storage/Cache Failure – Disaster Recovery Testing – Stress Testing/Burn-in

• QA Environment Tasks – Production, Adapter and Application Deployment – Knowledge Transfer to QA Personnel – Issue Review and Resolution – Release packaging and re-deployments • Customer Acceptance Testing – Deployment – Issue Review and Resolution – Release packaging and re-deployments • User Acceptance Testing (if required)

• StreamBase Unit – JUnit-based; leverages existing tooling – Wizards for automated test generation • Acceptance testing framework example – FitNesse and SbFit (https://github.com/streambase/SbFit) – Why just example? Based on older Fit framework; should be migrated to newr SLiM – Fixtures for StreamBase Enqueue/Dequeue and JDBC tests using StreamBase Datasources • Sbfeedsim to drive simulations and performance tests

• StreamBase Unit Extensions – Encourages creation of schema-change resilient tests – Open source/GitHub (https://github.com/streambase/SBUnit-Extensions) - latest – SBX (Use “Unit Testing Extensions for StreamBase 7.6 v1.0” ) – a little easier to set up – Tutorial, Samples, Exercises – Good “docs” in the unit tests for the extensions themselves – Intention to productize and revise wizards; no action in a long time, though

• Example build.xml: https://answer.streambase.com/display/test/How+do+I+run+StreamBase+JUnit+tests+using+Ant

value="sbd.sbconf"/>

• EventFlow Application Logic • Messaging Connectivity (integration test?) • RDBMS/Active Spaces Access (integration test?) • Client/User Interface • System Integration

• Main Business Logic Flow • State CRUD Logic • Initialization/State Recovery • Shutdown • Failover, Failback, and Connection and Dependent State Recovery • Automated Functional Unit Tests

© Copyright 2000-2014 TIBCO Software Inc. 18 Messaging Connectivity Development Test Tasks • Messaging Queue/Topic Configuration – Message/Field Definition – QoS Configuration • Authentication/Authorization • Connectivity Testing • Recovery Testing • Messaging Connections – Schema definition – Adapter Configuration – Connectivity Testing

• Schemas • Stored procedure interface, if required • Reference data population • Permissions/user accounts • Connectivity/JDBC/Cache Adapter Configuration • Distributed cache integration (ActiveSpaces, etc.)

• UI Test Automation Framework • Manual UI Testing Approach, Frequency, and Cost

• Automating end to end and integration tests