Delft University of Technology Software Engineering Research Group Technical Report Series Supporting Professional Spreadsheet Users by Generating Leveled Dataflow Diagrams Felienne Hermans, Martin Pinzger and Arie van Deursen Report TUD-SERG-2010-036 SERG TUD-SERG-2010-036 Published, produced and distributed by: Software Engineering Research Group Department of Software Technology Faculty of Electrical Engineering, Mathematics and Computer Science Delft University of Technology Mekelweg 4 2628 CD Delft The Netherlands ISSN 1872-5392 Software Engineering Research Group Technical Reports: http://www.se.ewi.tudelft.nl/techreports/ For more information about the Software Engineering Research Group: http://www.se.ewi.tudelft.nl/ Note: This paper is currently under review. c copyright 2010, by the authors of this report. Software Engineering Research Group, Department of Software Technology, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft Uni- versity of Technology. All rights reserved. No part of this series may be reproduced in any form or by any means without prior written permission of the authors. Supporting Professional Spreadsheet Users by Generating Leveled Dataflow Diagrams Supporting Professional Spreadsheet Users by Generating Leveled Dataflow Diagrams Felienne Hermans Martin Pinzger Arie van Deursen∗ Delft University of Technology Delft University of Technology Delft University of Technology [email protected] [email protected] [email protected] ABSTRACT 1. INTRODUCTION Thanks to their flexibility and intuitive programming model, Spreadsheets are widely used in industry: Winston [23] es- spreadsheets are widely used in industry, often for business- timates that 90% of all analysts in industry perform calcula- critical applications. Similar to software developers, pro- tions in spreadsheets. Their use is diverse, ranging from in- fessional spreadsheet users demand support for maintaining ventory administration to educational applications and from and transferring their spreadsheets. scientific modeling to financial systems. The financial busi- In this paper, we first study the problems and informa- ness is a domain where spreadsheets are especially prevail- tion needs of professional spreadsheet users by means of ing. Panko [18] estimates that 95% of U.S. firms, and 80% a survey conducted at a large financial company. Based in Europe, use spreadsheets in some form for financial re- on these needs, we then present an approach that extracts porting. this information from spreadsheets and presents it in a com- Business analysts using spreadsheets usually have very pact and easy to understand way, using leveled dataflow limited (if any) training as a programmer. In spite of that, diagrams. Our approach comes with three different views they effectively are end-user programmers, and as such face on the dataflow and allows the user to analyze the dataflow many of the challenges of professional developers, such as diagrams in a top-down fashion also using slicing techniques. identifying faults, debugging, or understanding someone else’s To evaluate the usefulness of the proposed approach, we code [13]. conducted a series of interviews as well as nine case studies This paper aims at providing support for spreadsheet users in an industrial setting. The results of the evaluation clearly to take on the end-user programming challenges. To that indicate the demand for and usefulness of our approach in end, we first study the problems and information needs of ease the understanding of spreadsheets. professional spreadsheet users and then present an approach that presents this information in a compact and easy to un- derstand way using leveled dataflow diagrams. Categories and Subject Descriptors The context, in which we conduct our research, is formed H.4.1 [Information Systems]: Office Automation—Spread- by the analysts of Robeco, a Dutch asset management com- sheets; D.2.2 [Software]: Design Tools and Techniques— pany with approximately 1600 employees worldwide, and Flowcharts over e130 billion worth of assets under management. In a survey we conducted among 27 of their analysts, we found that they use Excel for an average of 3 hours a day, under- General Terms lining the large role spreadsheets play in their daily work. Design, Experimentation, Human Factors, Languages Furthermore, spreadsheets have an average lifetime of more than five years, and individual spreadsheets are used by 13 different analysts on average. Keywords In order to support analysts in their work with spread- Data flow Diagrams, Visualization, Spreadsheets, End-User sheets, we start by identifying information needs. In par- programming ticular, we describe how we conducted interviews with the same group of 27 analysts, using a grounded theory [8] ap- ∗Work partially done while at the Computer Human Interac- proach, to obtain a clear picture of their use of spreadsheets. tion and Software Engineering Lab (CHISEL), Department As a result, spreadsheet transfer scenarios (to a new user, to of Computer Science, University of Victoria, Canada. an auditor, and to a professional developer creating custom software) were identified as problematic. In those scenarios, end-users search for a better insight into the dependencies between cells, formulas, groups of cells and worksheets. To meet these demands, we propose an approach for the Permission to make digital or hard copies of all or part of this work for automated extraction of dataflow diagrams from spreadsheets. personal or classroom use is granted without fee provided that copies are Such diagrams can be used to visualize data, processes ma- not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to nipulating data, and dependencies between them. Further- republish, to post on servers or to redistribute to lists, requires prior specific more, leveled diagrams can be used to accommodate hierar- permission and/or a fee. chies, for example for blocks of cells or worksheets. Copyright 200X ACM X-XXXXX-XX-X/XX/XX ...$10.00. SERG TUD-SERG-2010-036 1 Supporting Professional Spreadsheet Users by Generating Leveled Dataflow Diagrams We implemented our approach in a tool called GyroSAT, working with his spreadsheet. which can generate dataflow graphs from Excel spreadsheets. From that point on, we started asking subjects in inter- To evaluate our approach we conducted a series of evalua- views whether they experienced such scenarios. We found tions in the concrete setting of Robeco. First, we interviewed that the vast majority (85%) agreed that they often trans- the same group of 27 spreadsheet users, analyzing how the ferred spreadsheet to a colleague. We coded all described tool would help in transferring their own spreadsheets to col- scenarios into the following three categories: leagues. Furthermore, we conducted nine case studies, three for each type of transfer task identified. The findings of these S1 A spreadsheet has to be transferred to a colleague. This evaluations indicate that (1) spreadsheet professionals from scenario typically occurs when, for example, a new em- Robeco consider the tool as helpful; (2) the visualizations ployee starts working for the company, an employee derived help to create a story line to explain spreadsheets leaves the company or when a new spreadsheet is cre- to colleagues in transfer tasks; (3) the visualizations scale ated that has to be used by an other employee. well to the complex spreadsheets in use at Robeco. This paper is organized as follows. In Section 2, we de- S2 A spreadsheet has to be checked by an auditor. Audit- scribe the interviews leading to the information needs of ing periodically happens at large companies, to deter- spreadsheet users. Then in Section 3, we provide back- mine whether spreadsheets in key processes are well ground information on dataflow diagrams, after which we designed, error free and well documented. describe our algorithm to derive dataflow diagrams in Sec- S3 A spreadsheet is being replaced by custom software. tions 4 and 5. In Section 6, we cover our implementation, When a spreadsheet created by an end-user, becomes which we use in the evaluation described in Section 7. We so complex that it no longer complies to standards in conclude with a discussion of our results, an overview of the company such as safety, access control or readabil- related work, and a summary of our contributions and di- ity, it is transformed into a custom software system. rections for future research. To determine ways to support users in these scenarios, we 2. SPREADSHEET INFORMATION NEEDS dived deeper into the problems occurring during a transfer To gain an insight into the problems around spreadsheet scenario. As it turns out, problems typically occur when usage, we conducted a survey at Robeco. Robeco is a Dutch the receiving employee has too little understanding of the asset management company with approximately 1600 em- spreadsheet. The most of the subjects (70%) expressed that ployees worldwide, of which 1000 work in their headquarters they had difficulties with understanding a spreadsheet they in Rotterdam, where we performed our survey. received from a colleague. Zooming in even further, we iden- The survey was conducted following the grounded the- tified information needs spreadsheet receivers have, from the ory approach. Grounded theory is a qualitative research stories we heard about the problems during a transfer. We method that discovers theory