2010 Third International Conference on Software Testing, Verification and Validation (ICST 2010) Paris, France 6 – 10 April 2010 IEEE Catalog Number: CFP10TVV-PRT ISBN: 978-1-4244-6435-7 2010 Third International Conference on Software Testing, Verification and Validation ICST 2010 Table of Contents Message from General Chair.......................................................................................................................xi Message from Program Chairs.................................................................................................................xii Organizing Committee...................................................................................................................................xiii Program Committee........................................................................................................................................xiv Reviewers..............................................................................................................................................................xvi Keynote Abstract............................................................................................................................................xviii Keynote Speakers Using Formal Methods and Testability Concepts in the Avionics Systems Validation and Verification (V&V) Process ............................................................................................................1 Odile Laurent Google's Innovation Factory: Testing, Culture, and Infrastructure ....................................................................11 Patrick Copeland Session 1: Model Based Testing 1 Towards Automated, Formal Verification of Model Transformations .............................................................15 Márk Asztalos, László Lengyel, and Tihamér Levendovszky Debug Support for Model-Based GUI Testing .....................................................................................................25 Henri Heiskanen, Antti Jääskeläinen, and Mika Katara Automated Test Data Generation on the Analyses of Feature Models: A Metamorphic Testing Approach ..............................................................................................................................35 Sergio Segura, Robert M. Hierons, David Benavides, and Antonio Ruiz-Cortés v Session 2: Mutation Testing (Un-)Covering Equivalent Mutants ........................................................................................................................45 David Schuler and Andreas Zeller MuTMuT: Efficient Exploration for Mutation Testing of Multithreaded Code ..............................................55 Milos Gligoric, Vilas Jagannath, and Darko Marinov Using Mutation to Automatically Suggest Fixes for Faulty Programs ..............................................................65 Vidroha Debroy and W. Eric Wong Session 3: Regression Testing 1 An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations .....................................................................................................................................................75 Emelie Engström, Per Runeson, and Greger Wikstrand The Effectiveness of Regression Testing Techniques in Reducing the Occurrence of Residual Defects ........................................................................................................................79 Panduka Nagahawatte and Hyunsook Do MbSRT2: Model-Based Selective Regression Testing with Traceability ........................................................89 Leila Naslavsky, Hadar Ziv, and Debra J. Richardson Session 4: Model Based Testing 2 Generating Transition Probabilities for Automatic Model-Based Test Generation ...................................................................................................................................................................99 Abderrahmane Feliachi and Hélène Le Guen Model Based Testing and Abstract Interpretation in the Railway Signaling Context ......................................................................................................................................................................103 Daniele Grasso, Alessandro Fantechi, Alessio Ferrari, Carlo Becheri, and Stefano Bacherini Session 5: UML Modeling and Testing From Nondeterministic UML Protocol Statemachines to Class Contracts .....................................................107 Ivan Porres and Irum Rauf Simulated Satisfaction of Coverage Criteria on UML State Machines ...........................................................117 Stephan Weißleder Session 6: Regression Testing 2 Regression Testing Ajax Applications: Coping with Dynamism .....................................................................127 Danny Roest, Ali Mesbah, and Arie van Deursen Automated Behavioral Regression Testing .........................................................................................................137 Wei Jin, Alessandro Orso, and Tao Xie vi Session 7: Test Assessment 1 A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information ...............................................................................................................................................................147 Shali Yan, Zhenyu Chen, Zhihong Zhao, Chen Zhang, and Yuming Zhou Text2Test: Automated Inspection of Natural Language Use Cases ................................................................155 Avik Sinha, Stanley M. Sutton Jr., and Amit Paradkar Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization ....................................................................................................................................................165 Wes Masri and Rawad Abou Assi Session 8: Test Process and Tools 1 Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool ............................................................................................................................................................................175 Tanja E.J. Vos, Arthur I. Baars, Felix F. Lindlar, Peter M. Kruse, Andreas Windisch, and Joachim Wegener TestFul: An Evolutionary Test Approach for Java .............................................................................................185 Luciano Baresi, Pier Luca Lanzi, and Matteo Miraz GraphSeq: A Graph Matching Tool for the Extraction of Mobility Patterns .................................................195 Minh Duc Nguyen, Hélène Waeselynck, and Nicolas Rivière Session 9: Test and Validation 1 It Does Matter How You Normalise the Branch Distance in Search Based Software Testing ......................................................................................................................................................205 Andrea Arcuri Explanation-Based Generalization of Infeasible Path ........................................................................................215 Mickaël Delahaye, Bernard Botella, and Arnaud Gotlieb Challenges with Software Verification and Validation Activities in the Space Industry ......................................................................................................................................................................225 Robert Feldt, R. Torkar, Ehsan Ahmad, and Bilal Raza Session 10: GUI Testing GUI Testing Techniques Evaluation by Designed Experiments ......................................................................235 Cristiano Bertolini, Alexandre Mota, Eduardo Aranha, and Cristiano Ferraz Repairing GUI Test Suites Using a Genetic Algorithm .....................................................................................245 Si Huang, Myra B. Cohen, and Atif M. Memon A Formal Model for Generating Integrated Functional and User Interface Test Cases ..........................................................................................................................................................................255 Daniel Sinnig, Ferhat Khendek, and Patrice Chalin vii Session 11: Test Assessment 2 Prioritizing State-Based Aspect Tests ..................................................................................................................265 Dianxiang Xu and Junhua Ding Machine Learning Methods and Asymmetric Cost Function to Estimate Execution Effort of Software Testing ...................................................................................................................275 Daniel G. e Silva, Mario Jino, and Bruno T. de Abreu Does Hardware Configuration and Processor Load Impact Software Fault Observability? ..........................................................................................................................................................285 Raza Abbas Syed, Brian Robinson, and Laurie Williams Session 12: Testing and Validation 2 An Application of Six Sigma and Simulation in Software Testing Risk Assessment ...............................................................................................................................................................295 Vojo Bubevski Satisfying Test Preconditions through Guided Object Selection .....................................................................303 Yi Wei, Serge Gebhardt, Bertrand Meyer, and Manuel Oriol We’re Finding Most of the Bugs, but What are We Missing? ..........................................................................313 Elaine J. Weyuker, Robert M. Bell, and Thomas J. Ostrand