Understanding Interactivity

Total Page:16

File Type:pdf, Size:1020Kb

Understanding Interactivity Understanding Interactivity Steps to a Phenomenology of Human-Computer Interaction Dag Svanæs Preface and Acknowledgements iii Contents Preface and Acknowledgements..............................................................................................vii PART I: THEORY Chapter 1 Introduction .........................................................................................................1 1.1 Beyond Metaphor...............................................................................................................................3 1.2 Methodology: How to Study Interactivity? ....................................................................................7 1.3 The Larger Cultural Backdrop......................................................................................................10 1.4 Research Questions and Structure of the Study ..........................................................................17 Chapter 2 Interactivity in the HCI Literature.....................................................................20 2.1 Narrowing the Scope: Three Scenarios.........................................................................................21 2.2 Seven Theoretical Frameworks......................................................................................................27 2.3 The Model Human Processor.........................................................................................................30 2.4 Cognitive Science .............................................................................................................................33 2.5 Phenomenology and Speech Act Theory.......................................................................................44 2.6 Ethnomethodology...........................................................................................................................49 2.7 Activity Theory.................................................................................................................................54 2.8 Semiotics............................................................................................................................................60 2.9 Computers as Theatre .....................................................................................................................68 2.10 What do the Theories Shed Light on?.........................................................................................75 2.11 Blind Spots ......................................................................................................................................77 2.12 A Common Theme in the Blind Spots.........................................................................................78 2.13 Related Discourses and Comparisons..........................................................................................80 Chapter 3 Non-Cartesian Alternatives................................................................................86 3.1 The Human Body in Heidegger......................................................................................................87 3.2 Maurice Merleau-Ponty's "Phenomenology of Perception"......................................................88 3.3 An Example: The Mr. Peters Button.............................................................................................93 3.4 Merleau-Ponty on the Three Scenarios.........................................................................................97 3.5 Mark Johnson's "The Body in the Mind"....................................................................................99 3.6 Discussion........................................................................................................................................101 Chapter 4 Computer as Material ......................................................................................102 4.1 The Nature of the Computer ........................................................................................................102 4.2 The Abstract Art of Kandinsky ...................................................................................................103 4.3 Abstraction in the Computer Medium........................................................................................108 4.4 How is Abstract Art Experienced?..............................................................................................110 iv Understanding Interactivity PART II: EXPERIMENTS Chapter 5 Doing Empirical Research on Interactivity......................................................115 5.1 Relevant Research Traditions ......................................................................................................116 5.2 Evaluation Criteria........................................................................................................................121 5.3 Overall Experiment Design...........................................................................................................124 5.4 Measures Taken to Meet the Criteria .........................................................................................126 Chapter 6 Square World ...................................................................................................128 Chapter 7 Exp. A: Metaphors We Interact By ..................................................................133 7.1 Method.............................................................................................................................................134 7.2 Three Cases in Great Detail..........................................................................................................136 7.3 Results .............................................................................................................................................143 Coding scheme and method of analysis...................................................................................143 The use of verbs ...............................................................................................................144 The metaphors .................................................................................................................146 Between-example effects ....................................................................................................154 The diversity of the descriptions ...........................................................................................155 7.4 Discussion........................................................................................................................................157 Chapter 8 Exp. B: Designing Interactive Behavior ..........................................................162 8.1 Method.............................................................................................................................................163 8.2 The State-of-the-Art Editors ........................................................................................................165 An event-action language....................................................................................................165 A rule-sheet editor ............................................................................................................167 Programming-by-demonstration ...........................................................................................168 State-Transition Diagrams...................................................................................................169 The improved version ........................................................................................................170 8.3 The Empirically-Based Editors....................................................................................................171 A natural-language editor....................................................................................................171 The physical metaphors ......................................................................................................172 The house metaphor ..........................................................................................................173 Designing with Interaction Gestalts .......................................................................................174 The improved version ........................................................................................................177 8.4 Discussion........................................................................................................................................178 Chapter 9 Exp. C: Participatory Tool Design ...................................................................182 9.1 Method.............................................................................................................................................183 9.2 The First 10 minutes......................................................................................................................185 9.3 Results .............................................................................................................................................191 9.4 Discussion........................................................................................................................................196 Preface and Acknowledgements v PART III: REFLECTIONS Chapter 10 Making Sense of Square World......................................................................203 10.1 The Interactive Experience.........................................................................................................203
Recommended publications
  • A Review of User Interface Design for Interactive Machine Learning
    1 A Review of User Interface Design for Interactive Machine Learning JOHN J. DUDLEY, University of Cambridge, United Kingdom PER OLA KRISTENSSON, University of Cambridge, United Kingdom Interactive Machine Learning (IML) seeks to complement human perception and intelligence by tightly integrating these strengths with the computational power and speed of computers. The interactive process is designed to involve input from the user but does not require the background knowledge or experience that might be necessary to work with more traditional machine learning techniques. Under the IML process, non-experts can apply their domain knowledge and insight over otherwise unwieldy datasets to find patterns of interest or develop complex data driven applications. This process is co-adaptive in nature and relies on careful management of the interaction between human and machine. User interface design is fundamental to the success of this approach, yet there is a lack of consolidated principles on how such an interface should be implemented. This article presents a detailed review and characterisation of Interactive Machine Learning from an interactive systems perspective. We propose and describe a structural and behavioural model of a generalised IML system and identify solution principles for building effective interfaces for IML. Where possible, these emergent solution principles are contextualised by reference to the broader human-computer interaction literature. Finally, we identify strands of user interface research key to unlocking more efficient and productive non-expert interactive machine learning applications. CCS Concepts: • Human-centered computing → HCI theory, concepts and models; Additional Key Words and Phrases: Interactive machine learning, interface design ACM Reference Format: John J.
    [Show full text]
  • THE COMPUTER SCIENCE with HCI
    IOSR Journal of Computer Engineering (IOSR-JCE) e-ISSN: 2278-0661,p-ISSN: 2278-8727 PP 52-54 www.iosrjournals.org THE COMPUTER SCIENCE with HCI Shubhangi M. Sherekar1 1([email protected], Dept of Computer Science, Shivaji Science College, Nagpur, India) Abstract: The intention of this paper is to provide an overview on the subject of Computer science with Human computer Interaction. Human computer interaction (HCI) is the study of people design, implement, and use interactive computer systems. In this paper we study why do human uses computing system? , what do human uses computing system for? And the computer science of HCI. Keywords: Human Computer Interaction, computing system, computer science of HCI. I. INTRODUCTION Human–computer interaction (HCI) is the study of interaction between people (users) and computers. It is often regarded as the intersection of computer science, behavioral sciences, design and several other fields of study. Interaction between users and computers occurs at the rapid growth of computing has made effective human-computer interaction essential. Increased attention to usability is also driven by competitive pressures for greater productivity, the need to reduce frustration, and to reduce overhead costs such as user training. As computing affects more aspects of our lives the need for usable systems becomes even more important. II. HUMAN-COMPUTER INTERACTION: The Association for Computing Machinery defines human-computer interaction as "a discipline concerned with the design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them. Because human-computer interaction studies a human and a machine in conjunction, it draws from supporting knowledge on both the machine and the human side.
    [Show full text]
  • Interactivity: a Review of the Concept and a Framework for Analysis
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Open Access LMU Interactivity: A review of the concept and a framework for analysis OLIVER QUIRING and WOLFGANG SCHWEIGER Abstract The terms ‘interactivity’ and ‘interactive media’ became significant buzz- words during the late 1980s and early 1990s when the multi-media euphoria fascinated politicians, economists, and researchers alike. However, right from the beginning of the scientific debate, the inconsistent usage of the term ‘interactivity’ massively complicated the comparability of numerous empirical studies. This is where this article joins the discussion. First, the article sheds light on the terminological origins of ‘interactivity’ and distin- guishes the term from cognate expressions. Further, it restructures and ex- tends existing findings on the basis of a new analysis framework which considers three levels of interactive communication (action level, level of subjective situation evaluation, and level of meaning exchange). Finally, it delivers a systematic overview of specific criteria of interactive communica- tion. Keywords: interactivity, framework, computer-mediated-communication, human-machine interaction, Internet, media use Introduction ‘Interactivity’ and ‘interactive media’ became significant buzzwords dur- ing the late 1980s and early 1990s when the multi-media euphoria fasci- nated politicians, economists, and researchers alike. During the last de- cade this multimedia euphoria of the early days slowed down distinctly although new technologies were developed continuously. The term ‘inter- active’ was used less frequently but constantly within communication science publications. The term as well as the idea of ‘interactivity’ has, despite some pioneer articles (e. g., Durlak, 1987; Rafaeli, 1988; Heeter, 1989; Steuer, 1992), not been explained satisfactorily so far.
    [Show full text]
  • Programming Interactivity.Pdf
    Download at Boykma.Com Programming Interactivity A Designer’s Guide to Processing, Arduino, and openFrameworks Joshua Noble Beijing • Cambridge • Farnham • Köln • Sebastopol • Taipei • Tokyo Download at Boykma.Com Programming Interactivity by Joshua Noble Copyright © 2009 Joshua Noble. All rights reserved. Printed in the United States of America. Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472. O’Reilly books may be purchased for educational, business, or sales promotional use. Online editions are also available for most titles (http://my.safaribooksonline.com). For more information, contact our corporate/institutional sales department: (800) 998-9938 or [email protected]. Editor: Steve Weiss Indexer: Ellen Troutman Zaig Production Editor: Sumita Mukherji Cover Designer: Karen Montgomery Copyeditor: Kim Wimpsett Interior Designer: David Futato Proofreader: Sumita Mukherji Illustrator: Robert Romano Production Services: Newgen Printing History: July 2009: First Edition. Nutshell Handbook, the Nutshell Handbook logo, and the O’Reilly logo are registered trademarks of O’Reilly Media, Inc. Programming Interactivity, the image of guinea fowl, and related trade dress are trademarks of O’Reilly Media, Inc. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and O’Reilly Media, Inc., was aware of a trademark claim, the designations have been printed in caps or initial caps. While every precaution has been taken in the preparation of this book, the publisher and author assume no responsibility for errors or omissions, or for damages resulting from the use of the information con- tained herein. TM This book uses RepKover™, a durable and flexible lay-flat binding.
    [Show full text]
  • Sonic Interaction Design Sonic Interaction Design
    Sonic Interaction Design Sonic Interaction Design edited by Karmen Franinovi ć and Stefania Serafin The MIT Press Cambridge, Massachusetts London, England © 2013 Massachusetts Institute of Technology All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher. MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please email [email protected] or write to Special Sales Depart- ment, The MIT Press, 55 Hayward Street, Cambridge, MA 02142. This book was set in Stone Sans and Stone Serif by Toppan Best-set Premedia Limited, Hong Kong. Printed and bound in the United States of America. Library of Congress Cataloging-in-Publication Data Sonic interaction design / edited by Karmen Franinovi ć and Stefania Serafin. pages cm Includes bibliographical references and index. ISBN 978-0-262-01868-5 (hardcover : alk. paper) 1. Sonic interaction design. 2. Product design. 3. Sound in design. 4. Human-computer interaction. I. Franinović , Karmen, 1975 — editor of compilation. II. Serafin, Stefania, 1973 — editor of compilation. TS171.S624 2013 004.01 ' 9 — dc23 2012028482 10 9 8 7 6 5 4 3 2 1 Contents Introduction vii I Emergent Topics 1 1 Listening to the Sounding Objects of the Past: The Case of the Car 3 Karin Bijsterveld and Stefan Krebs 2 The Experience of Sonic Interaction 39 Karmen Franinovi ć and Christopher Salter 3 Continuous Auditory and Tactile Interaction Design 77 Yon Visell, Roderick Murray-Smith, Stephen A.
    [Show full text]
  • CREATING a WEB-BASED TUTORIAL for IBM Visualage for COBOL by Mel WANG Bachelor of Science Hunan Agricultural University Changsha
    CREATING A WEB-BASED TUTORIAL FOR IBM VisualAge FOR COBOL By MEl WANG Bachelor of Science Hunan Agricultural University Changsha, P. R. China 1985 Master of Science Southwest Agricultural University Chongqing, P. R. China 1988 Submitted to the Faculty of the Graduate College of the Oklahoma State University in partial fulfillment of the requirements for the Degree of MASTER OF SCIENCE May, 1998 CREATING A WEB-BASED TUTORIAL FOR IBM VisualAge FOR COBOL Thesis Approved: Thesis Adviser L)zn;.n ! Gr~e-g-e----- 11 ACKNOWLEDGMENTS I wish to express my sincere appreciation to my advisor Dr. Jacques LaFrance for his guidance, encouragement, patience and kindness throughout my graduate study. I am deeply grateful to Dr. John P. Chandler and Dr. K. M. George for their serving on my graduate committee and providing me invaluable advices and assistance. Same gratitude goes to Dr. G. E. Hedrick. During my graduate study at Oklahoma State University, I benefitted much from the faculty and staff of the Computer Science Department. I would like to thank all the professors for their initiative and inruitive teaching. I also appreciate the opportunity that was granted to me as a teaching assistant, which facilitated my study academically as well as financially. I am greatly indebted to my parents for their unending love and care throughout my life. Special thanks go to my husband, Liping Jiang, for his love, understanding, encouragement, and support. Without his love and support, I would not have completed my study today. iii TABLE OF CONTENTS Chapter Page I. INTRODUCTION 1 COBOL and Object-Oriented COBOL 1 IDM VisualAge for COBOL 6 The Objectives ofthe Thesis 11 The Organization ofthe Thesis 13 II.
    [Show full text]
  • The Analysis of Interactive Media and Digital Culture
    INVESTIGACIONES / RESEARCH l Jorge Mora Received: 23-01-2012 / Reviewed: 18-03-2012 Accepted: 03-04-2012 / Published: 01-10-2012 San Diego (USA) / Guadalajara (Mexico) DOI: 10.3916/C39-2012-03-04 The Analysis of Interactive Media and Digital Culture - Hypermedia Literacy in Peru and Bolivia Medios interactivos y cultura digital: Alfa betización hipermedia en Perú y Bolivia ABSTRACT This paper compiles data on how the use of hypermedia, interactive multimedia and interfaces have changed the classical dynamics of human communications and education to create a new paradigm. This paradigm originates in the interface since it allows multidirectional and multimedia communications through interactions with the elements of which it is composed. This research describes the different aesthetic, narrative, emotional and value elements that are integrated within the cultural hypermedia interfaces. These hypermedia elements are fundamental components to be taken into account in the creation of educational interactive media products. The communicative functions are interchangeable between sender-receptor, author-reader-author, creator-user, professor-student... thanks to the introduction of multimedia interactive expressions and technological instruments that allow several types of interac- tions. This flexible functionality generates new communicative as well as dramatic models of interactive narrative, where the interaction of receptors-senders and reader-authors with the narrative actions occur at the character or avatar level. The interfacial aesthetic, narrative, emotional and value elements are studied, analyzed and described in detail thanks to an innovative model of analysis that can be used to for the implementation and design of interactive edutainment media products. The application of this model helped to create cultural content interfaces enabling not only the development of interactive educational workshops in the USA, Peru and Bolivia for more than 200 students, but also multisensory and immersive communications with quality.
    [Show full text]
  • Chapter 1. Interactive Systems
    Chapter 1. Interactive Systems Table of Contents Context ....................................................................................................................... 1 Objectives .................................................................................................................... 2 Interactive Systems ....................................................................................................... 2 The Past .............................................................................................................. 2 The Present .......................................................................................................... 2 The Future ........................................................................................................... 3 Usefulness and Usability ................................................................................................ 4 Usefulness ........................................................................................................... 4 Usability .............................................................................................................. 4 Why is HCI important? .................................................................................................. 5 Productivity ......................................................................................................... 5 Quality of Life ..................................................................................................... 5 Safety-critical systems and disasters
    [Show full text]
  • Information, Interactivity, and Social Media
    Atlantic Journal of Communication, 23:19–30, 2015 Copyright © Taylor & Francis Group, LLC ISSN: 1545-6870 print/1545-6889 online DOI: 10.1080/15456870.2015.972404 Information, Interactivity, and Social Media Yaron Ariel and Ruth Avidar Department of Communication The Max Stern Yezreel Valley College The aim of this paper is to provide a conceptual theoretical framework to the term “social” in a social media context. This is done by exploring the relationship between three central terms in a social media environment: information, interactivity, and sociability. We suggest a model that describes the relations between these terms in a social media context. As the model suggests, information is the basic unit of a communication process, but social media users are the ones that decide whether and how much information to share, and when and whether to comment on a social media platform. Hence, not solely the technological features of a platform determine its level of interactivity and sociability, but the actual performances of its users. Over the last decade, the equilibrium point of the web has shifted from top-down platforms that replicated mass media toward user-driven online platforms. At present, popular mainstream online platforms are uniformly tagged as “social media”—from social network sites like Facebook, Twitter, and Google Plus to Wikipedia and YouTube. Frequently, social media is considered an inherent element of Web 2.0 (Kaplan & Haenlein, 2010), a term coined by O’Reilly (2007) to describe the development of new platforms, features, and uses that build on users’ participation in the form of user-generated content, decentralization, and rich user experience.
    [Show full text]
  • Operations and Configuration Guide Ver 2.3.1
    Oracle Utilities Customer Care And Billing Operations and Configuration Guide Ver 2.3.1 E18371-01 August 2010 Oracle Utilities Customer Care And Billing Operations and Configuration Guide, Ver 2.3.1 E18371-01 Copyright © 2007 - 2010 Oracle. All rights reserved. The Programs (which include both the software and documentation) contain proprietary information; they are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright, patent, and other intellectual and industrial property laws. Reverse engineering, disassembly, or decompilation of the Programs, except to the extent required to obtain interoperability with other independently created software or as specified by law, is prohibited. The information contained in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. This document is not warranted to be error-free. Except as may be expressly permitted in your license agreement for these Programs, no part of these Programs may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose. If the Programs are delivered to the United States Government or anyone licensing or using the Programs on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are “commercial computer software” or “commercial technical data” pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the Programs, including documentation and technical data, shall be subject to the licensing restrictions set forth in the applicable Oracle license agreement, and, to the extent applicable, the additional rights set forth in FAR 52.227-19, Commercial Computer Software--Restricted Rights (June 1987).
    [Show full text]
  • Sonic Interaction Design Stefania Serafin, Karmen Franinovic,´ Thomas Hermann Guillaume Lemaitre, Michal Rinott and Davide Rocchesso
    The Sonification Handbook Edited by Thomas Hermann, Andy Hunt, John G. Neuhoff Logos Publishing House, Berlin, Germany ISBN 978-3-8325-2819-5 2011, 586 pages Online: http://sonification.de/handbook Order: http://www.logos-verlag.com Reference: Hermann, T., Hunt, A., Neuhoff, J. G., editors (2011). The Sonification Handbook. Logos Publishing House, Berlin, Germany. Chapter 5 Sonic Interaction Design Stefania Serafin, Karmen Franinovic,´ Thomas Hermann Guillaume Lemaitre, Michal Rinott and Davide Rocchesso This chapter introduces the emerging discipline of sonic interaction design (SID). SID is the study and exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts. Sonic interaction design lies at the intersection of interaction design and sound and music computing. Reference: Serafin, S., Franinovic,´ K., Hermann, T., Lemaitre, G., Rinott, M., and Rocchesso, D. (2011). Sonic interaction design. In Hermann, T., Hunt, A., Neuhoff, J. G., editors, The Sonification Handbook, chapter 5, pages 87–110. Logos Publishing House, Berlin, Germany. Media examples: http://sonification.de/handbook/chapters/chapter5 10 Chapter 5 Sonic Interaction Design Stefania Serafin, Karmen Franinovic,´ Thomas Hermann, Guillaume Lemaitre, Michal Rinott, Davide Rocchesso 5.1 Introduction Sonic Interaction Design (SID) is an interdisciplinary field which has recently emerged as a combined effort of researchers and practitioners working at the intersection of sound and music computing, interaction design, human-computer interaction, novel interfaces for musical expression, product design, music psychology and cognition, music composition, performance and interactive arts. SID explores ways in which sound can be used to convey information, meaning, aesthetic and emotional qualities in interactive contexts.
    [Show full text]
  • Programming Interactivity by Joshua Noble
    Free Sampler O’Reilly Ebooks—Your bookshelf on your devices! When you buy an ebook through oreilly.com, you get lifetime access to the book, and whenever possible we provide it to you in four, DRM-free file formats—PDF, .epub, Kindle-compatible .mobi, and Android .apk ebook—that you can use on the devices of your choice. Our ebook files are fully searchable and you can cut-and-paste and print them. We also alert you when we’ve updated the files with corrections and additions. Learn more at http://oreilly.com/ebooks/ You can also purchase O’Reilly ebooks through iTunes, the Android Marketplace, and Amazon.com. Programming Interactivity by Joshua Noble Copyright © 2009 Joshua Noble. All rights reserved. Printed in the United States of America. Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472. O’Reilly books may be purchased for educational, business, or sales promotional use. Online editions are also available for most titles (http://my.safaribooksonline.com). For more information, contact our corporate/institutional sales department: (800) 998-9938 or [email protected]. Editor: Steve Weiss Indexer: Ellen Troutman Zaig Production Editor: Sumita Mukherji Cover Designer: Karen Montgomery Copyeditor: Kim Wimpsett Interior Designer: David Futato Proofreader: Sumita Mukherji Illustrator: Robert Romano Production Services: Newgen Printing History: July 2009: First Edition. Nutshell Handbook, the Nutshell Handbook logo, and the O’Reilly logo are registered trademarks of O’Reilly Media, Inc. Programming Interactivity, the image of guinea fowl, and related trade dress are trademarks of O’Reilly Media, Inc. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks.
    [Show full text]