With Apache Jmeter? Frank Pientka Where and Who Is Materna Gmbh?

Performance testing

With Apache JMeter? Frank Pientka Where and who is Materna GmbH?

. Founded: 1980 Hamburg Bremen Employees: 1,700 Lüneburg Berlin Turnover 2015: € 210 million Wolfsburg FI NOR Dortmund SE . ITK-Full-service provider in the Dresden Düsseldorf premium segment DK Köln UK Bad Vilbel NL PL . Family-owned company in the DE Erlangen CZ Heidelberg ITC sector SK Nürnberg Stuttgart . Target groups: IT organisations München and user departments in both private and public sectors

Orlando, Florida, USA

Dipl.-Informatiker (TH Karlsruhe)

Principal Software Architect at Dortmund

iSAQB founding member

heise.de/developer/Federlesen columne

over 20 years IT experience lots of articles and talks

. Why performance testing? . Testing right! . What is Apache JMeter? . What’s new in Jmeter 3.0? . JMeter main elements? . Have a (test-)plan! . Distributed performance testing . Further steps, extensions, challenges . Resume

How secure&safe?

The Heisenbug!

Volkswagen St. (VW) share

JUnitPerf ab Gattling

. Since 1998 for Apache Tomcat loadtest (Stefano Mazzocchi) . Recent version 3.0 (2016-05-17) . Supported protocols . Web - HTTP, HTTPS, FTP . SOAP/XML-RPC . Database via JDBC, MongoDB, HADOOP . LDAP . JMS . Mail - SMTP(S), POP3(S) and IMAP(S) . Native commands or shell scripts

+ Highly extensible and configurable, tutorial, example templates, demos - Limited reporting capacities, Short outdated documentation, i18n

. Test plan creation and debugging improvements . Reporting improvements (dynamic HTML-Dashboard) . Protocols and Load Testing improvements . UX Improvements . Core improvements . Components updates . Incompatible changes, deprecations

http://jmeter-expert.blogspot.de

. Create Testplan . Test Testplan . Run Testplan and evaluate results . Document Testplan and results . Extras/schematic.cmd Testplan.jmx  Testplan.html . TestPlanCheck --jmx [ --stats --tree-dump ] . jmeter -n -t -l -e -o

http://jmeter-expert.blogspot.de

Workbench • Test Recorder

Listener ConfigTestElement • SummaryReport • Request Defaults • Results Tree • Autorisation Manager • Results Table • Cookie Manager

Sampler • HTTP Request Assertion

Timer

16 © Materna GmbH 2016 www.materna.com Login testing scenario

Thread Group Constant HTTP sampler GET Start Thread: 1000 Timer Hostname/url Ramp-up: 500 300ms

RegEx HTTP Status code

HTTP sampler POST Hostname/url J_username=$user J_password=$pwd Assertiom Check combination ist OK

Constant HTTP sampler GET End Timer logout 300ms

Assertiom Check login string

Alternative: BlazeMeter's Google Chrome extension, .har file to a JMeter test plan (.jmx file) converter

. Use user defined variables with same name as in request . Place Login CSV Data Set Config element on login page request . Use Counter element and reference {counter} variable in request i.e. {user} . Use non-GUI mode: jmeter -n -t test.jmx -l test.jtl . Use as few Listeners as possible e.g. disable the “View Result Tree” Use . CSV output rather than XML. . Only save the data that you need. . Use as few Assertions as possible. . Disable all JMeter graphs as they consume a lot of memory . Check, document testplan TestPlanCheck': --jmx [ --stats --tree-dump ]

1. Command line: jmeter -n -t your_script.jmx 2. JMeter Ant Task ant extras/build.xml 3. JMeter Maven Plugin. pom.xml mvn verify jmeter:jmeter 4. from Java code

Remote start Slave1 Slave1

Remote start All Remote stop System Master-GUI under Slave1 jmeter.properties Test remote_hosts= Slave1,Slave2,Slave3

Remote start Slave3 Slave3

In bin/jmeter.properties "remote_hosts=localhost:1099,localhost:2010" add IP addresses of Slave-Clients, server.rmi.port=1099, server.rmi.localport=1099, client.rmi.localport=2010 On Master: jmeter -n -t script.jmx -R slave1,slave2,slave3. „Remote Start All" distribute and execute testplan and receive results, SET SERVER_PORT=1099, set REMOTE_HOSTS=master:1099 "Remote Stop“, control jmeter-server.log, and have check and assert elements, to handle errors

Running Apache JMeter on Amazon EC2 ec2 Script

EC2, VPN SSH-Tunneling

Cold/warm start! Think Time! Bildschirm als Bild speichern cd apache-jmeter-3.0\extras schematic.cmd test-plan.jmx ant -Dtest=test-plan run report TestPlanCheck.bat --jmx testplan.jmx --stats --tree-dump

Save JPG.image

http://jmeter.apache.org/usermanual/generating-dashboard.html

https://www.blazemeter.com/blog/5-key-things-you-need-know-about-jmeter-30 jmeter.bat -n -t WorkBench_JMETER.jmx -l WorkBench_JMETER.log -e -o report http://www.apdex.org

https://wiki.jenkins-ci.org/display/JENKINS/Performance+Plugin © Materna GmbH 2016 www.materna.com 34 Useful extensions http://jmeter-plugins.org

. How to integrate JMeter in the CI-Build? . How to document test plans and results? . What further reporting tools are needed? . Extending the Web Test Plan (ForEach Controller with User Defined Variables (UDV), While Controller with StringFromFile Function, RegEx) . How to use JMeter with Selenium/JS/mobile Apps/Cloud?

. Gatling http://gatling.io . Grinder3: http://grinder.sourceforge.net . JMeter Info's: http://jmeter.apache.org, http://sourceforge.net/projects/jmeterforwindows . JMeter extensions: http://jmeter-plugins.org, http://www.atlantbh.com/jmeter-components . JMeter Tips: http://blazemeter.com/apache-jmeter, http://jmeter-expert.blogspot.de . JMeter Master-Slave-Test: http://jmeter.apache.org/usermanual/remote-test.html . JMeter MAVEN Plugin: https://github.com/jmeter-maven-plugin, . Online-Reports: https://sense.blazemeter.com/ . https://blazemeter.com/blog/open-source-load-testing-tools-which-one-should-you-use . JMeter-ec2 script: https://github.com/oliverlloyd/jmeter-ec2

Materna GmbH Frank Pientka Voßkuhle 37 44141 Dortmund +49 231 5599-8854 [email protected]