Schriften aus der Fakultät Wirtschaftsinformatik und 25 Angewandte Informatik der Otto-Friedrich-Universität Bamberg Effective and Efficient Process Engine Evaluation Simon Harrer 25 Schriften aus der Fakultät Wirtschaftsinformatik und Angewandte Informatik der Otto-Friedrich- Universität Bamberg Contributions of the Faculty Information Systems and Applied Computer Sciences of the Otto-Friedrich-University Bamberg Schriften aus der Fakultät Wirtschaftsinformatik und Angewandte Informatik der Otto-Friedrich- Universität Bamberg Contributions of the Faculty Information Systems and Applied Computer Sciences of the Otto-Friedrich-University Bamberg Band 25 2017 Effective and Efficient Process Engine Evaluation Simon Harrer 2017 Bibliographische Information der Deutschen Nationalbibliothek Die Deutsche Nationalbibliothek verzeichnet diese Publikation in der Deutschen Nationalbibliographie; detaillierte bibliographische Informationen sind im In- ternet über http://dnb.d-nb.de/ abrufbar. Diese Arbeit hat der Fakultät Wirtschaftsinformatik und Angewandte Informatik der Otto-Friedrich-Universität Bamberg als Dissertation vorgelegen. 1. Gutachter: Prof. Dr. Guido Wirtz, Otto-Friedrich-Universität Bamberg 2. Gutachter: Prof. Dr. Dr. h. c. Frank Leymann, Universität Stuttgart Tag der mündlichen Prüfung: 17.07.2017 Dieses Werk ist als freie Onlineversion über den Hochschulschriften-Server (OPUS; http:// www.opus-bayern.de/uni-bamberg/) der Universitätsbibliothek Bamberg erreichbar. Kopi- en und Ausdrucke dürfen nur zum privaten und sonstigen eigenen Gebrauch angefertigt werden. Herstellung und Druck: docupoint, Magdeburg Umschlaggestaltung: University of Bamberg Press, Larissa Günther © University of Bamberg Press Bamberg, 2017 http://www.uni-bamberg.de/ubp/ ISSN: 1867-7401 ISBN: 978-3-86309-503-1 (Druckausgabe) eISBN: 978-3-86309-504-8 (Online-Ausgabe) URN: urn:nbn:de:bvb:473-opus4-496333 DOI: http://dx.doi.org/10.20378/irbo-49633 To Martina Acknowledgments Finally. It is done. After six years. I am happy and relieved. However, this would not have been possible without numerous helpful, kind, intelligent, supportive, and critical friends, reviewers, colleagues, supervisors, family members, students, and all others not listed before. This is a big thank you to all of you. The first step towards this dissertation was laid in 2010 when Prof. Dr. Guido Wirtz offered me a position as a research assistant in his Distributed Systems Group, which I gladly accepted. As my doctoral advisor, he always took the time to discuss my work despite his other obligations due to being dean or vice president, was quick and uncomplicated in approving my numerous application forms for the business trips (i.e., “Dienstreiseanträge”) despite them being expensive and, well, numerous, and gave me the freedom to work on my research. For all of his support, I am deeply grateful. Apart from my advisor, I would like to thank the rest of my thesis committee: Prof. Dr. Sven Overhage and Prof. Dr. Udo Krieger, for their insightful comments and encouragement, but also for the hard questions which gave me the incentive to widen my research perspectives. Furthermore, I am deeply grateful that Prof. Dr. Dr. h. c. Frank Leymann has offered me to be the second assessor of this work. His offer actually marked a turning point of my research, as it motivated me to proceed further despite my doubts. I had the privilege to work in an extremely supportive environment within the Distributed Systems Group. In my mind, I did not only have supportive colleagues but also very good friends. Cornelia Schecher, the good soul and backbone of the group, saved me countless hours by being the proxy to the administration and was always open for both small and deep talk during the coffee break. The joint creation of the tool betsy with Jörg Lenhard marked the start of this work in 2012. Two years later, Matthias Geiger joined our efforts by giving betsy the kick in the direction of BPMN. My dissertation is highly tied to the joint work with both of them. Stefan Kolb, although not collaborating with me on the betsy tool, has always helped out readily when needed. My friend Linus Dietz, who joined this group for the last year of my employment, joined the overall helpfulness of the group quickly. I am deeply in debt for their support during the whole time at the Distributed Systems Group and i beyond. My scientific career started with the diploma thesis I wrote supervised by Andreas Schönberger, for which I am grateful. He pushed me towards high quality research, and helped me to get my first conference publication. Moreover, I want to thank my other colleagues Mostafa Madiesh and Christian Wilms for their support in the early phases of this thesis. During the six years, I have done a lot of teaching as well, including the supervision of projects, seminars, and theses. I had the pleasure to work with a lot of students on topics related to my dissertation, which resulted in either conference/workshop publications, technical reports, or open source tools – and in new friendships as well. I would like to sincerely thank the following persons for working hard on particular items of this thesis together with me: Lara Aubele, David Bimamisa, Christoph Bröker, Mathias Casar, Rolf Fakesch, Mathias Müller, Christian Preißinger, Cedric Röck, Stephan Schuberth, and Andreas Vorndran. I also want to thank all those who criticized this work in some sort along the way to completion, especially the reviewers who gave their time reading and checking my submitted workshop, conference or journal papers. You gave me the opportunity to improve myself and this work. I have gratefully benefited from all the discussions with my good friend Oliver Kopp, but also from his numerous constructive comments and persistent warm encouragements to keep going. You were incredibly helpful to secure the quality of this work! With Tammo van Lessen, I was able to publish a paper, which profited highly from his multiple roles as maintainer of an open source project I benchmark in this work, as a consultant working in industry, and his background in academic research. I am grateful to have worked with both Rix Groenboom and Faris Nizamic, and having found two great friends in the Netherlands (and was obliged to visit them there, of course). To Mazedur Rahman, I am in debt as he has shown my wife and me around the Sony Headquarters, and for the interesting discussions about the application of Docker. I also fondly remember the collaboration with Vincenzo Ferme and his hospitality in Lugano and, especially, Como. To Marigianna Skouradaki, I am also grateful for the collaboration and exchange on workflow benchmarking over the last few years. I am in debt towards Babette Schaible who managed the paper work along the way. Thanks also to Thomas Benker, who started at the same time as myself, for the indirect motivation as he progressed in his dissertation often quicker than I did. A thank you also to the JabRef developers and the community – you always gave me an excuse to work on my programming skills for life after my dissertation. Furthermore, I want to thank all the other students who helped me in my teaching efforts: Christian Preißinger, Michael Träger, and Hendrik Cech. You freed up some time, so I could work on this dissertation. A big thank you also goes to the proof readers: Matthias Geiger, Martina Harrer, Oliver Kopp, Philipp Neugebauer, and Michael Oberparleiter. ii Last but not least, I owe my deepest gratitude to my wife Martina, as without her support, love, and sometimes a little bit of pressure, I would have quit at some point in time, I am sure. Another anchor of support has been my whole family, including my grandparents Oma and Opa, my parents Ingrid and Erhard, my in-laws Maria and Peter, and my two sisters Anne and Franziska – they were and are always there for me (even Opa from far above). Thank you, Anne for providing me a writing hide out in Passau, where a lot of these pages were crafted. Especially, when I had motivational issues, the discussions with my father have kept me on track – I do remember them fondly. And I am glad I did have a phone flatrate. iii Kurzfassung Geschäftsprozesse sind in der Industrie allgegenwärtig und Geschäftsprozessma- Problem nagement daher ein wichtiger Baustein in Unternehmensabläufen. Prozessaus- führungsumgebungen erlauben die automatische Ausführung von Geschäftspro- zessen. Die zwei bekanntesten standardisierten Sprachen, um Geschäftsprozesse zu modellieren, sind die Web Services Business Process Execution Language 2.0 (BPEL) und Business Process Model and Notation 2.0 (BPMN). Zur Auswahl stehen für beide eine Vielzahl von Ausführungsumgebungen und somit besteht die Qual der Wahl: Welche Ausführungsumgebung erfüllt die Anforderungen am besten? Eine rationale Auswahl wird durch das Fehlen von objektiven, reproduzierbaren und gesicherten Informationen über die Qualität solcher Ausführungsumgebungen verhindert. Dies kann zu unfundierten und unausge- reiften Entscheidungen und diese wiederum zu hohen Kosten führen. Diese Arbeit stellt eine effiziente und effektive Benchmarkinglösung vor, um Lösung die notwendigen Informationen für rationale Entscheidungen aufdecken zu können. Das Fundament besteht aus einer Abstraktionsschicht und einer Bench- markingsprache für Prozessausführungsumgebungen. Die Abstraktionsschicht stellt eine uniforme API bereit um mit jedem möglichen System in gleicher Wei- se zu interagieren und die Benchmarkingsprache ermöglicht es Benchmarks in einer kompakten, abgeschlossenen