2010 Third International Conference on Testing, Verification and Validation

(ICST 2010)

Paris, France

6 – 10 April 2010

IEEE Catalog Number: CFP10TVV-PRT ISBN: 978-1-4244-6435-7 2010 Third International Conference on , Verification and Validation ICST 2010 Table of Contents

Message from General Chair...... xi Message from Program Chairs...... xii Organizing Committee...... xiii Program Committee...... xiv Reviewers...... xvi Keynote Abstract...... xviii

Keynote Speakers Using and Testability Concepts in the Avionics Systems Validation and Verification (V&V) Process ...... 1 Odile Laurent Google's Innovation Factory: Testing, Culture, and Infrastructure ...... 11 Patrick Copeland Session 1: Model Based Testing 1

Towards Automated, Formal Verification of Model Transformations ...... 15 Márk Asztalos, László Lengyel, and Tihamér Levendovszky Debug Support for Model-Based GUI Testing ...... 25 Henri Heiskanen, Antti Jääskeläinen, and Mika Katara Automated Test Data Generation on the Analyses of Feature Models: A Metamorphic Testing Approach ...... 35 Sergio Segura, Robert M. Hierons, David Benavides, and Antonio Ruiz-Cortés

v Session 2: Mutation Testing

(Un-)Covering Equivalent Mutants ...... 45 David Schuler and Andreas Zeller MuTMuT: Efficient Exploration for Mutation Testing of Multithreaded Code ...... 55 Milos Gligoric, Vilas Jagannath, and Darko Marinov Using Mutation to Automatically Suggest Fixes for Faulty Programs ...... 65 Vidroha Debroy and W. Eric Wong Session 3: Regression Testing 1 An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations ...... 75 Emelie Engström, Per Runeson, and Greger Wikstrand The Effectiveness of Regression Testing Techniques in Reducing the Occurrence of Residual Defects ...... 79 Panduka Nagahawatte and Hyunsook Do MbSRT2: Model-Based Selective Regression Testing with Traceability ...... 89 Leila Naslavsky, Hadar Ziv, and Debra J. Richardson Session 4: Model Based Testing 2 Generating Transition Probabilities for Automatic Model-Based Test Generation ...... 99 Abderrahmane Feliachi and Hélène Le Guen Model Based Testing and Abstract Interpretation in the Railway Signaling Context ...... 103 Daniele Grasso, Alessandro Fantechi, Alessio Ferrari, Carlo Becheri, and Stefano Bacherini Session 5: UML Modeling and Testing

From Nondeterministic UML Protocol Statemachines to Class Contracts ...... 107 Ivan Porres and Irum Rauf Simulated Satisfaction of Coverage Criteria on UML State Machines ...... 117 Stephan Weißleder Session 6: Regression Testing 2

Regression Testing Ajax Applications: Coping with Dynamism ...... 127 Danny Roest, Ali Mesbah, and Arie van Deursen Automated Behavioral Regression Testing ...... 137 Wei Jin, Alessandro Orso, and Tao Xie

vi Session 7: Test Assessment 1 A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information ...... 147 Shali Yan, Zhenyu Chen, Zhihong Zhao, Chen Zhang, and Yuming Zhou Text2Test: Automated Inspection of Natural Language Use Cases ...... 155 Avik Sinha, Stanley M. Sutton Jr., and Amit Paradkar Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization ...... 165 Wes Masri and Rawad Abou Assi Session 8: Test Process and Tools 1 Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool ...... 175 Tanja E.J. Vos, Arthur I. Baars, Felix F. Lindlar, Peter M. Kruse, Andreas Windisch, and Joachim Wegener TestFul: An Evolutionary Test Approach for Java ...... 185 Luciano Baresi, Pier Luca Lanzi, and Matteo Miraz GraphSeq: A Graph Matching Tool for the Extraction of Mobility Patterns ...... 195 Minh Duc Nguyen, Hélène Waeselynck, and Nicolas Rivière Session 9: Test and Validation 1 It Does Matter How You Normalise the Branch Distance in Search Based Software Testing ...... 205 Andrea Arcuri Explanation-Based Generalization of Infeasible Path ...... 215 Mickaël Delahaye, Bernard Botella, and Arnaud Gotlieb Challenges with Software Verification and Validation Activities in the Space Industry ...... 225 Robert Feldt, R. Torkar, Ehsan Ahmad, and Bilal Raza Session 10: GUI Testing

GUI Testing Techniques Evaluation by Designed Experiments ...... 235 Cristiano Bertolini, Alexandre Mota, Eduardo Aranha, and Cristiano Ferraz Repairing GUI Test Suites Using a Genetic Algorithm ...... 245 Si Huang, Myra B. Cohen, and Atif M. Memon A Formal Model for Generating Integrated Functional and User Interface Test Cases ...... 255 Daniel Sinnig, Ferhat Khendek, and Patrice Chalin

vii Session 11: Test Assessment 2

Prioritizing State-Based Aspect Tests ...... 265 Dianxiang Xu and Junhua Ding Machine Learning Methods and Asymmetric Cost Function to Estimate Execution Effort of Software Testing ...... 275 Daniel G. e Silva, Mario Jino, and Bruno T. de Abreu Does Hardware Configuration and Processor Load Impact Software Fault Observability? ...... 285 Raza Abbas Syed, Brian Robinson, and Laurie Williams Session 12: Testing and Validation 2 An Application of Six Sigma and Simulation in Software Testing Risk Assessment ...... 295 Vojo Bubevski Satisfying Test Preconditions through Guided Object Selection ...... 303 Yi Wei, Serge Gebhardt, Bertrand Meyer, and Manuel Oriol We’re Finding Most of the Bugs, but What are We Missing? ...... 313 Elaine J. Weyuker, Robert M. Bell, and Thomas J. Ostrand Session 13: Ph.D. Symposium 1

Specification of UML Model Transformations ...... 323 Shekoufeh Kolahdouz Rahimi Holistic Model-Based Testing for Business Information Systems ...... 327 Michael Mlynarski Towards an Automated and Dynamically Adaptable Test System for Testing Healthcare Information Systems ...... 331 Diana Elena Vega Session 14: Testing Safety and Security Characterizing the Chain of Evidence for Software Safety Cases: A Conceptual Model Based on the IEC 61508 Standard ...... 335 Rajwinder Kaur Panesar-Walawege, Mehrdad Sabetzadeh, Lionel Briand, and Thierry Coq Verified Firewall Policy Transformations for Test Case Generation ...... 345 Achim D. Brucker, Lukas Brügger, Paul Kearney, and Burkhart Wolff Session 15: Ph.D. Symposium 2

Elaborating Software Test Processes and Strategies ...... 355 Jussi Kasurinen Model-Driven Engineering of Dependable Systems ...... 359 Vidar Slåtten

viii Session 16: Testing Web Services and Applications

Online Testing Framework for Web Services ...... 363 Tien-Dung Cao, Patrick Felix, Richard Castanet, and Ismail Berrada A Counter-Example Testing Approach for Orchestrated Services ...... 373 Francesco de Angelis, Andrea Polini, and Guglielmo de Angelis Session 17: Test Assessment 3

Automated Bug Neighborhood Analysis for Identifying Incomplete Bug Fixes ...... 383 Mijung Kim, Saurabh Sinha, Carsten Görg, Hina Shah, Mary Jean Harrold, and Mangala Gowri Nanda An Industrial Survey on Contemporary Aspects of Software Testing ...... 393 Adnan Causevic, Daniel Sundmark, and Sasikumar Punnekkat Fault Detection Likelihood of Test Sequence Length ...... 402 Fevzi Belli, Michael Linschulte, Christof J. Budnik, and Harald A. Stieber Session 18: Test Management and Vulnerabilities Detection

Towards Fully Automated Test Management for Large Complex Systems ...... 412 Sigrid Eldh, Joachim Brandt, Mark Street, Hans Hansson, and Sasikumar Punnekkat Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista ...... 421 Thomas Zimmermann, Nachiappan Nagappan, and Laurie Williams Precisely Detecting Runtime Change Interactions for Evolving Software ...... 429 Raul Santelices, Mary Jean Harrold, and Alessandro Orso Session 19: Model Based Testing 3

Model Checking PLC Software Written in Function Block Diagram ...... 439 Olivera Pavlović and Hans-Dieter Ehrich Timed Moore Automata: Test Data Generation and Model Checking ...... 449 Helge Löding and Jan Peleska Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines ...... 459 Gilles Perrouin, Sagar Sen, Jacques Klein, Benoit Baudry, and Yves le Traon Session 20: Test Assessment 4

Longer is Better: On the Role of Test Sequence Length in Software Testing ...... 469 Andrea Arcuri When BDDs Fail: Conformance Testing with Symbolic Execution and SMT Solving...... 479 Elisabeth Jöbstl, Martin Weiglhofer, Bernhard K. Aichernig, and Franz Wotawa

ix Session 21: Testing and Validation 3 Towards a Testing Methodology for Reactive Systems: A Case Study of a Landing Gear Controller ...... 489 Laya Madani, Virginia Papailiopoulou, and Ioannis Parissis Rex: Symbolic Regular Expression Explorer ...... 498 Margus Veanes, Peli de Halleux, and Nikolai Tillmann Session 22: Ph.D. Symposium 3

State Machine Inference in Testing Context with Long Counterexamples ...... 508 Muhammad Naeem Irfan Regression Test Selection and Product Line System Testing ...... 512 Emelie Engström

Author Index ...... 516

x