Lecture Notes in Artificial Intelligence 1889 Subseries of Lecture Notes in Computer Science Edited by J. G. Carbonell and J. Siekmann

Lecture Notes in Computer Science Edited by G. Goos, J. Hartmanis and J. van Leeuwen 3 Berlin Heidelberg New York Barcelona Hong Kong London Milan Paris Singapore Tokyo Michael Anderson Peter Cheng Volker Haarslev (Eds.)

Theory and Application of

First International Conference, Diagrams 2000 Edinburgh, Scotland, UK, September 1-3, 2000 Proceedings

13 Series Editors Jaime G. Carbonell, Carnegie Mellon University, Pittsburgh, PA, USA Jorg¨ Siekmann, University of Saarland, Saarbrucken,¨ Germany

Volume Editors Michael Anderson University of Hartford, Department of Computer Science Dana Hall 230, 200 Bloomfield Avenue West Hartford, Connecticut 06117, USA E-mail: [email protected] Peter Cheng University of Nottingham, School of Psychology ESRC Centre for Research in Development, Instruction and Training University Park, Nottingham, NG7 2RD, UK E-mail: [email protected] Volker Haarslev University of Hamburg, Computer Science Department Vogt-Koelln-Str. 30, 22527 Hamburg, Germany E-mail: [email protected] Cataloging-in-Publication Data applied for

CR Subject Classification (1998): I.2, D.1.7, G.2, H.5, J.4, J.5

ISBN 3-540-67915-4 Springer-Verlag Berlin Heidelberg New York

This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of , recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer-Verlag. Violations are liable for prosecution under the German Copyright Law. Springer-Verlag Berlin Heidelberg New York a member of BertelsmannSpringer Science+Business Media GmbH © Springer-Verlag Berlin Heidelberg 2000 Printed in Germany Typesetting: Camera-ready by author, data conversion by DA-TeX Gerd Blumenstein Printed on acid-free paper SPIN: 10722507 06/3142 543210 Preface

Diagrams 2000 is dedicated to the memory of Jon Barwise.

Diagrams 2000 was the first event in a new interdisciplinary conference series on the Theory and Application of Diagrams. It was held at the University of Edinburgh, Scotland, September 1-3, 2000. Driven by the pervasiveness of diagrams in human communication and by the increasing availability of graphical environments in computerized work, the study of diagrammatic notations is emerging as a research field in its own right. This development has simultaneously taken place in several scientific disciplines, including, amongst others: cognitive science, artificial intelligence, and computer science. Consequently, a number of different workshop series on this topic have been successfully organized during the last few years: Thinking with Diagrams, Theory of Visual Languages, Reasoning with Diagrammatic Representations, and Formalizing Reasoning with Visual and Diagrammatic Representations. Diagrams are simultaneously complex cognitive phenonema and sophisti- cated computational artifacts. So, to be successful and relevant the study of diagrams must as a whole be interdisciplinary in nature. Thus, the workshop series mentioned above decided to merge into Diagrams 2000, as the single in- terdisciplinary conference for this exciting new field. It is intended that Diagrams 2000 should become the premier international conference series in this area and provide a forum with sufficient breadth of scope to encompass researchers from all academic areas who are studying the nature of diagrammatic representations and their use by humans and in machines. The call for papers and posters for Diagrams 2000 attracted submissions from a very wide variety of disciplines and departments, including: architecture, art and design, artificial intelligence, cognitive science, computer science, edu- cation, engineering, human computer interaction, , manage- ment, mathematics, medicine, philosophy, psychology, speech pathology, textile technology. Submissions were received from countries all over the world, includ- ing: Austria, Australia, Denmark, Canada, Finland, France, Germany, Japan, Israel, Italy, New Zealand, The Netherlands, Poland, The USA, Spain, Switzer- land, and The UK. The standard of the accepted papers was high, with an acceptance rate of about 30%. The papers covered a wide variety of topics and for the sake of imposing some organizational structure on the conference, the presented papers were classified into the following themes: logic and diagrams; theoretical concerns about diagrams; cognition and diagrams; human communication and diagrams; and proof systems; diagrams to support the develop- ment of software systems, and systems to support the development of diagrams. Cutting across these themes was a substantial variety of different types of dia- grams. These ranged from classes of diagrams that are ubiquitous in this area of research (such as node-link formats, Euler/Venn diagrams, bar , design VI Preface layouts) through to more specialized forms of diagrams for particular purposes (e.g., representations of time, Celtic Knots). In addition to the 31 technical paper presentations, in eight sessions, Di- agrams 2000 included: an invited talk by Alan MacEachren (Representations to mediate geospatial collaborative reasoning: A cognitive-semiotic ); a talk in memory of Jon Barwise given by Keith Stenning; a tutorial by Kim Marriott on formal approaches to visual languages; a tutorial on cognitive ap- proaches to diagrams co-presented by David Gooding, Hermi Schijf, and Jiajie Zhang; a session at which ten posters were presented. The program co-chairs would like to thank all the members of the program committee for all their efforts towards making Diagrams 2000 a success. We are particularly grateful to Jo Calder, Alan Blackwell, Bernd Meyer, and Nigel Birch.

September 2000 Peter Cheng, Michael Anderson, Volker Haarslev Organization

Diagrams 2000 was: – funded by the Engineering and Physical Sciences Research Council (EPSRC grant no. GR/N08803) – in cooperation with the American Association for Artificial Intelligence (AAAI) – hosted by the Human Communication Research Centre (HCRC).

Program Chairs

Michael Anderson University of Hartford (USA) Peter Cheng University of Nottingham (UK) Volker Haarslev University of Hamburg (Germany)

Program Committee

Tom Addis University of Portmouth (UK) Gerard Allwein Indiana University (USA) Nigel Birch EPSRC (UK) B. Chandrasekaran Ohio State University (USA) Maria Francesca Costabile Universit`a di Bari (Italy) Gennaro Costagliola Universit`a di Salerno (Italy) Ellen Yi-Luen Do University of Washington (USA) Max Egenhofer University of Maine (USA) George Furnas (USA) Janice Glasgow Queens University (Canada) David Gooding University of Bath (UK) Mark D. Gross University of Washington (USA) Pat Hayes University of West Florida (USA) Mary Hegarty UCSB (USA) Kathleen Hornsby University of Maine (USA) Mateja Jamnik University of Birmingham (UK) Stefano Levialdi Universit`adiRoma(Italy) Robert Lindsay University of Michigan (USA) Ric Lowe Curtin University of Technology (Australia) Robert McCartney University of Connecticut (USA) N. Hari Narayanan Auburn University (USA) David Barker-Plummer Stanford University (USA) Clive Richards Coventry University (UK) Eric Saund Xerox PARC (USA) Barbara Tversky Stanford University (USA) VIII Organization

Additional Referees

G. M. Bierman T. Jansen M. Wessel P. Bottoni M. Matera H. Zeevat M. Erwig G. Polese F. Ferrucci A. Shimjima

Administration

Local Organization: Jo Calder (University of Edinburgh) Corin Gurr (University of Edinburgh) Publicity: Bernd Meyer (Monash University) WebSite: Alan Blackwell (University of Cambridge) Series Liaison: Kim Marriott (Monash University) Patrick Olivier (University of York) of Contents

Invited Talks

Invited Talk: Representations to Mediate Geospatial CollaborativeReasoning:A Cognitive-SemioticPerspective ...... 1 Alan M. MacEachren Invited Talk: Jon Barwise: A Heterogeneous Appreciation ...... 2 Keith Stenning

Tutorial 1 – Formal Approaches to Diagrams

Tutorial 1: Formal Approaches to Visual Language Specification andUnderstanding ...... 3 Kim Marriott

Tutorial 2 – Cognitive Approach to Diagrams

Tutorial 2a: Cognitive History of Science: The Roles of Diagrammatic Representations in Discovery and Modeling Discovery ...... 4 David Gooding Tutorial 2b: Cognitive (Production System) Modelling ofHowanExpertUsesa CartesianGraph ...... 5 Hermi Schijf Tutorial 2c: The Coordination of External Representations and Internal Mental Representations in Display-Based Cognitive Tasks ...... 6 Jiajie Zhang

Logic and Diagrams

PositiveSemanticsofProjectionsinVenn-EulerDiagrams ...... 7 Joseph (Yossi) Gil, John Howse and Elena Tulchinsky On the Completeness and Expressiveness of Spider Systems ...... 26 John Howse, Fernando Molina and John Taylor Non-standardLogicsforDiagramInterpretation ...... 42 Kim Marriott and Bernd Meyer RevivingtheIconicityofBetaGraphs ...... 58 Sun-Joo Shin X Table of Contents

Constraint Matching for Diagram Design: Qualitative Visual Languages . . . . 74 Ana von Klopp Lemon and Oliver von Klopp Lemon Picking Knots from Trees – The Syntactic Structure of Celtic Knotwork . . . .89 Frank Drewes and Renate Klempien-Hinrichs

Theoretical Concerns about Diagrams

DifferentiatingDiagrams:A NewApproach ...... 105 Jesse Norman LogicalSystemsandFormality...... 117 Patrick Scotto di Luzio Distinctions with Differences: Comparing Criteria for DistinguishingDiagrammaticfromSententialSystems ...... 132 Keith Stenning

Cognition and Diagrams

How People Extract Information from Graphs: Evidence from a Sentence-GraphVerificationParadigm ...... 149 Aidan Feeney, Ala K. W. Hola, Simon P. Liversedge, John M. Findlay and Robert Metcalf Restricted Focus Viewer: A Tool for Tracking Visual Attention ...... 162 Alan F. Blackwell, Anthony R. Jansen and Kim Marriott Communicating Dynamic Behaviors: Are Interactive Multimedia PresentationsBetterthanStaticMixed-ModePresentations? ...... 178 N. Hari Narayanan and Mary Hegarty CapacityLimitsinDiagrammaticReasoning ...... 194 Mary Hegarty

Human Communication with Diagrams

Recording the Future: Some Diagrammatic Aspects ofTimeManagement ...... 207 Stuart Clink and Julian Newman Lines, Blobs, Crosses and Arrows: Diagrammatic Communication withSchematicFigures ...... 221 Barbara Tversky, Jeff Zacks, Paul Lee and Julie Heiser Animated Diagrams: An Investigation into the Cognitive Effects ofUsingAnimationtoIllustrateDynamicProcesses ...... 231 Sara Jones and Mike Scaife Table of Contents XI

A Comparison of Graphics and Speech in a Task-Oriented Interaction . . . . .245 Patrick G. T. Healey, Rosemarie McCabe and Yasuhiro Katagiri Diagramming Aesthetics: Modernism and Architecture inthe21stCentury ...... 257 Mark J. Clayton

Diagrammatic Reasoning/Proof Systems

JVenn: A Visual Reasoning System with Diagrams and Sentences ...... 271 Hajime Sawamura and Kensuke Kiyozuka A Proposal for Automating Diagrammatic Reasoning inContinuousDomains ...... 286 Daniel Winterstein, Alan Bundy and Mateja Jamnik PlayingwithDiagrams ...... 300 Robert K. Lindsay The Use of Intermediate Graphical Constructions in Problem Solving withDynamic,Pixel-LevelDiagrams ...... 314 George Furnas, Yan Qu, Sanjeev Shrivastava and Gregory Peters

Diagrams for Systems, Systems for Diagrams

TreatmentofDiagramsinDocumentImageAnalysis ...... 330 Dorothea Blostein, Edward Lank and Richard Zanibbi Universal Arrow Foundations for Visual Modeling ...... 345 Zinovy Diskin, Boris Kadish, Frank Piessens and Michael Johnson Diagrammatic Acquisition of Functional Knowledge for Product Configuration Systems with the Unified Modeling Language . . 361 Alexander Felfernig and Markus Zanker Evaluating the Intelligibility of Diagrammatic Languages Used intheSpecificationofSoftware ...... 376 Carol Britton, Sara Jones, Maria Kutar, Martin Loomes and Brian Robinson ExecutingDiagramSequences ...... 392 Joseph Thurbon MetaBuilder:TheDiagrammer’sDiagrammer ...... 407 Robert Ian Ferguson, Andrew Hunter and Colin Hardy Diagrammatic Control of Diagrammatic Structure Generation ...... 422 Stefan Gruner and Murat Kurt Two-DimensionalPositioningasVisualThinking ...... 437 Shingo Takada, Yasuhiro Yamamoto and Kumiyo Nakakoji XII Table of Contents

Reordering the Reorderable Matrix as an Algorithmic Problem ...... 453 Erkki M¨akinen and Harri Siirtola

Posters

Clouds:A ModuleforAutomaticLearningofConceptMaps ...... 468 Francisco Cˆamara Pereira and Am´ılcar Cardoso A DiagrammaticNotationforIntervalAlgebra ...... 471 Zenon Kulpa AnimationofDiagrams:AnAidtoLearning? ...... 475 Richard Lowe Diagrams as Components of Multimedia Discourse: A SemioticApproach ...... 479 John H. Connolly FormalisingtheEssenceofDiagrammaticSyntax ...... 483 Corin Gurr and Konstantinos Tourlas UsingGridsinMaps ...... 486 Alexander Klippel and Lars Kulik CaseAnalysisinEuclideanGeometry:AnOverview ...... 490 Nathaniel Miller Bar Charts Recognition Using Hough Based Syntactic Segmentation ...... 494 Yan Ping Zhou and Chew Lim Tan ExperimentingwithAesthetics-BasedGraphLayout ...... 498 Helen C. Purchase, David Carrington and Jo-Anne Allder

Author Index ...... 503