TWLT 15 Interactions in Virtual Worlds
Total Page:16
File Type:pdf, Size:1020Kb
TWLT 15 Interactions in Virtual Worlds PROCEEDINGS OF THE FIFTEENTH TWENTE WORKSHOP ON LANGUAGE TECHNOLOGY MAY 19-21, 1999 ENSCHEDE,THE NETHERLANDS Anton Nijholt, Olaf Donk and Betsy van Dijk (eds.) i CIP GEGEVENS KONINKLIJKE BIBLIOTHEEK, DEN HAAG Nijholt, A., Donk, O.A., Van Dijk, E.M.A.G. Interactions in Virtual Worlds Proceedings Twente Workshop on Language Technology 15 A. Nijholt, O.A. Donk, E.M.A.G. van Dijk (eds.) Enschede, Universiteit Twente, Faculteit Informatica ISSN 0929–0672 trefwoorden: virtual worlds, virtual reality, agent technology, presence, talking faces, VRML, speech recognition, speech generation, human-computer-interaction, social structures, WWW c Copyright 1999; Universiteit Twente, Enschede Book orders: Ms. A. Hoogvliet University of Twente Dept. of Computer Science P.O. Box 217 NL 7500 AE Enschede tel: +31 53 4893680 fax: +31 53 4893503 Email: [email protected] Druk- en bindwerk: Reprografie U.T. Service Centrum, Enschede ii Preface TWLT is an acronym of Twente Workshop(s) on Language Technology. These workshops on natural language theory and technology are organized by the Parlevink Reasearch Project, a language theory and technology project of the Centre of Telematics and Information Technology (CTIT) of the University of Twente, Enschede, The Netherlands. For each workshop proceedings are published containing the papers that were presented. See next page for an overview of the previous TWLT workshops. TWLT 15 has been organized by a program committee consisting of Anton Nijholt (chair, The Nether- lands), Niels Ole Bernsen (Denmark), Philip Brey (The Netherlands), James Lester (USA), Stephen Mat- suba (Canada), Pierre Nugues (France) and Oliviero Stock (Italy). The workshop is endorsed by SIGDIAL and is organized in the context of the U-Wish project of the Dutch national Telematics Institute. TWLT 15, Interactions in Virtual Worlds, is a 3-day workshop on interactions in virtual reality (VR) en- vironments. Contributions were invited on theoretical, empirical, computational, experimental, anthropo- logical or philosophical approaches to VR environments. In this workshop the emphasis is on VR environ- ments that provide means for interacting with the objects in the environment, with embedded information sources and services (possibly represented as agents) or with other users and visitors of the environment. In recent years the computer science and the cognitive ergonomics communities have discovered and are exploring the possibilities of VR in user interfaces. In order to visualize available information and to provide users access to this information, virtual environments have been built such that users can find and explore information, communicate with other users and communicate with objects and agents in the virtual worlds. In this workshop new forms of interactivity are explored. Topics are, amongst others, the role of agent technology and of speech and language in virtual environments. How can we navigate in VR using speech and language, how can we model multimodal access to such environments, how can we communicate with other humans and with artificial agents in the VR environment, etc. A workshop is the concerted action of many people. We are grateful to the authors and the organisations they represent, for their efforts and contributions. In addition we would like to mention here the people whose efforts have been less visible during the workshop proper, but whose contribution was evidently of crucial importance. Charlotte Bijron and Alice Hoogvliet took care of the administrative tasks (registration, hotel reservations, etc.). Furthermore we are most grateful to the members of the program committee and to Rieks op den Akker, Bert Lenting, Danny Lie, Charles van der Mast, Mannes Poel, Boris van Schooten and Roel Vertegaal for their support in the refereeing process. Anton Nijholt, Olaf Donk and Betsy van Dijk May 1999 iii Previous TWLT workshops Previous TWLT workshops were TWLT1, Tomita’s Algorithm: Extensions and Applications. 22 March, 1991. TWLT2, Linguistic Engineering: Tools and Products. 20 November, 1991. TWLT3, Connectionism and Natural Language Processing. 12 and 13 May 1992. TWLT4, Pragmatics in Language Technology. 23 September, 1992. TWLT5, Natural Language Interfaces. 3 and 4 June, 1993. TWLT6, Natural Language Parsing. 16 and 17 December, 1993. TWLT7, Computer-Assisted Language Learning. 16 and 17 June 1994. TWLT8, Speech and Language Engineering. 1 and 2 December 1994. TWLT9, Corpus-based Approaches to Dialogue Modelling. 9 June, 1995 TWLT10, Algebraic Methods in Language Processing. 6-8 December, 1995 TWLT11, Dialogue Management in Natural Language Systems. 19-21 June, 1996 TWLT12, Automatic Interpretation and Generation of Verbal Humor. 11-14 September 1996 TWLT13, Formal Semantics and Pragmatics of Dialogue, Twendial’98. 13-15 May 1998 TWLT14, Language Technology in Multimedia Information Retrieval. 7-8 December 1998 For the contents of the previous proceedings, please consult the last pages of this volume. iv Contents Let’s-Improvise-Together 1 Riccardo Antonini (University of Rome) Design and the Social Ontology of Virtual Worlds 5 Philip Brey (Twente University) Investigating Navigation and Orientation within Virtual Worlds 13 Dimitrios Charitos (University of Athens), Alan H. Bridges (University of Strathclyde) and Drakoulis Martakos (University of Athens) VR-Spider for (non) Immersive WWW navigation 23 M. Cibelli, G. Costagliola, G. Polese and G. Tortora (University of Salerno) Steps toward Learning in Virtual World Cyberspace: TheU Virtual University and BOWorld 31 Bruce Damer, Stuart Gold (The Contact Consortium), Jan A. W. de Bruin (Tilburg University) and Dirk-Jan G. de Bruin Virtual Worlds Applications 43 Russell Eames (Microsoft Research, Seattle) Creating Virtual Worlds with a Graspable User Interface 45 Hauke Ernst, Kai Schäfer and Willi Bruns (University of Bremen) Virtual Reality Interface for the World Wide Web 59 Denis Gracanin and Kecia E. Wright (University of Southwestern Louisiana) The Usability of Interacting with the Virtual and the Real in COMRIS 69 Geert de Haan (IPO, Eindhoven University of Technology) ECHOES: A Collaborative Virtual Training Environment 81 G. M. P. O’Hare, A. J. Murphy, T. Delahunty and K. Sewell (University College Dublin) Why Bill was killed – understanding social interaction in virtual worlds 95 Mikael Jakobsson (Umeå University) Natural Interaction with Pedagogical Agents in Virtual Worlds 103 W. Lewis Johnson (Marina del Rey) Modelling Interaction to Inform Information Requirements in Virtual Environments 107 Kulwinder Kaur Deol, Alistair Sutcliffe and Neil Maiden (City University London) Virtual Campus Project – A Framework for a 3D Multimedia Educational Environment 115 Rainer Kuhn and Sigrún Guðjónsdóttir (University of Karlsruhe) Natural Language Generation in Multimodal Learning Environments: 125 Lifelike Agents and 3D Animated Explanation Generation James C. Lester (North Carolina State University) Speaking Spaces: Virtual Reality, Artificial Intelligence and the Construction of Meaning 127 Stephen N. Matsuba (The VRML Dream Company, Vancouver) Verbal and Written Interaction in Virtual Worlds – Some application examples 137 Pierre Nugues (ISMRA-Caen) The Twente Virtual Theatre Environment: Agents and Interactions 147 Anton Nijholt (University of Twente) v When Worls Collide – Interactions between the Virtual and the Real 165 Sandy Ressler, Brian Antonishek, Qiming Wang, Afzal Godil and Keith Stouffer (National Institute of Standards and Technology) EISCAT Virtual Reality Training Simulation: A Study on Usability and Effectiveness 171 Lakshmi Sastry and D. R. S. Boyd (Rutherford Appleton Laboratory) "Males say ’blue,’ females say ’aqua,’ ’sapphire,’ and ’dark navy’" 183 The Importance of Gender in Computer-Mediated Communication Frank Schaap (University of Amsterdam) Modelling Interaction in Virtual Environments using Process Algebra 195 Boris van Schooten, Olaf Donk and Job Zwiers (University of Twente) Presence: Interacting in Virtual Reality? 213 Martijn J. Schuemie and Charles A. P. G. van der Mast (Delft University of Technology) Towards an Understanding 3D Virtual Reality Architectural Design System 219 Jarke J. van Wijk, Bauke de Vries and Cornelius W. A. M. van Overveld (Eindhoven University of Technology) Spoken Language Interaction with a Virtual World in the MUeSLI Multimodal 3D Retail System 225 Peter J. Wyard and Gavin E. Churcher (BT Laboratories, Ipswich, Suffolk) Real Time Gesture Based 3D Graphics User Interface for CAD Modelling System 233 J. M. Zheng, K. W. Chan and I. Gibson (University of Hong Kong) vi Sponsors and support We gratefully acknowledge help from: Shell NWO Switch Automatisering Research Project Parlevink Neuro Fuzzy Centrum TNO-MET University of Twente Carp Technologies Technologies Intelligent software solutions Organisation TWLT 15 is organised by: Research Project Parlevink Centre for Telematics and Information Technology University of Twente vii viii Technologies Intelligent software solutions Do you want to add intelligence to your systems? Intelligence can boost functionality and allow less experienced users use your systems. Or maybe you want an intelligent system that is able to make difficult decisions on its own. Whatever your wishes on intelligence are, we have the solution for you! Carp Technologies is a young and flexible company, specialised in Artificial Intelligence and Language Technology. We build intelligence and enhance your systems with decision-making