G RASPABLE C UES FOR E VERYDAY R ECOLLECTING The work in this thesis has been carried out: • under the auspices of the J. F. Schouten School for User-System Interaction Research, Technische Universiteit Eindhoven • at Philips Research Laboratories Eindhoven (NatLab), • and was supported by the Eindhoven Embedded Systems Institute (EESI), Technische Universiteit Eindhoven. © 2004, Elise van den Hoven CIP-DATA LIBRARY TECHNISCHE UNIVERSITEIT EINDHOVEN Hoven, Elise A.W.H. van den Graspable cues for everyday recollecting / by Elise A.W.H. van den Hoven - Eindhoven: Technische Universiteit Eindhoven, 2004 – Proefschrift. - ISBN 90-386-1958-8 NUGI 778 Keywords: User system interaction / Tangible interfaces / User-centered design / Prototyping Cover: Memories (depicted by the two cats at the top of the triangle) can be cued by digital sources, such as digital photos (the bottom left cat) as well as physical objects (the photo frame on the right). Cats are chosen as examples of everyday memories. Cover design by Elise van den Hoven and Jan-Willem Luiten, JWL Producties, Eindhoven Printed by Universiteitsdrukkerij, Technische Universiteit Eindhoven G RASPABLE C UES FOR E VERYDAY R ECOLLECTING PROEFSCHRIFT ter verkrijging van de graad van doctor aan de Technische Universiteit Eindhoven, op gezag van de Rector Magnificus, prof.dr. R.A. Van Santen, voor een commissie aangewezen door het College voor Promoties in het openbaar te verdedigen op donderdag 6 mei 2004 om 16.00 uur door Elise Anna Walthera Hendrina van den Hoven geboren te Best Dit proefschrift is goedgekeurd door de promotoren: prof.dr. G.W.M. Rauterberg en prof.dr.ir. J.H. Eggen Copromotor: prof.dr. A. Kohlrausch Een herinnering is een interpretatie van het nu. (Sanne Wallis-de Vries, try-out van “Stuk”, 8 nov. 2002, Stadsschouwburg Eindhoven) Contents 1 Introduction .................................................................................................1 1.1 Context .................................................................................................1 1.1.1 Project Context..............................................................................1 1.1.2 Industrial Context..........................................................................2 1.2 Theoretical Framework..........................................................................3 1.2.1 Definitions ....................................................................................6 1.3 Thesis Outline.......................................................................................7 Section I – Background Overview ......................................................................11 2 Everyday Recollection Examples.................................................................13 2.1 Scrapbooking ......................................................................................13 2.2 Photos.................................................................................................15 2.3 Text.....................................................................................................17 2.4 Music..................................................................................................18 2.5 Odor ...................................................................................................18 3 Related Research ........................................................................................19 3.1 Digital Photos......................................................................................19 3.1.1 Introduction ................................................................................19 3.1.2 Digital-Photo Research................................................................20 3.2 Human Memory..................................................................................25 3.2.1 Recollection Recording...............................................................25 3.2.2 Types of Memory Systems ...........................................................25 3.2.3 Theories on Recollection Storage and Retrieval ...........................26 3.2.4 Autobiographical Memory...........................................................28 3.2.5 Cuing Retrieval............................................................................30 3.2.6 Cuing Autobiographical Memories ..............................................31 vii Section II - Souvenirs ..........................................................................................37 4 Souvenir Study............................................................................................39 4.1 Introduction.........................................................................................39 4.2 Souvenir Focus Group .........................................................................42 4.2.1 Methodology of the Souvenir Focus Group..................................43 4.2.2 Results of the Souvenir Focus Group ...........................................43 4.2.3 Conclusions from the Souvenir Focus Group ...............................46 4.3 Souvenir Questionnaires......................................................................47 4.3.1 Methodology of the Souvenir Questionnaires ..............................47 4.3.2 Results of the Souvenir Questionnaires........................................48 4.3.3 Conclusions from the Souvenir Questionnaires............................57 Section III – Graspable User Interfaces: Implementation and Theory ................59 5 Digital Photo Browser Design.....................................................................61 5.1 Abstract ...............................................................................................61 5.2 Introduction.........................................................................................62 5.3 Digital Photo-Browsing Devices ..........................................................62 5.3.1 Photos combined with Text .........................................................62 5.3.2 Photos combined with Audio ......................................................63 5.3.3 Photos combined with Video.......................................................63 5.3.4 Photos combined with Audio and Video .....................................63 5.3.5 Photos combined with Audio and Odor ......................................64 5.3.6 Photos combined with Physical Objects ......................................64 5.3.7 Photos combined with Physical Objects and Audio .....................65 5.3.8 Photos combined with Physical Objects, Audio and Video..........66 5.3.9 Conclusions on Digital Photo-Browsing Devices .........................66 5.3.10 Why a Graspable User Interface?.............................................67 5.4 Memory Focus Group..........................................................................68 5.4.1 Personal Media as Memory Containers........................................68 5.4.2 Non-Personal Media as Memory Cues .........................................68 5.4.3 Conclusions of the Memory Focus Group....................................69 5.5 Design & Implementation....................................................................70 5.5.1 The User-Interface Design ...........................................................70 5.5.2 The User-System Interaction ........................................................71 5.5.3 The Graphical and Graspable UI Implementation........................75 5.6 Formative Evaluation...........................................................................77 5.6.1 Informal Heuristic Evaluation.......................................................77 viii 5.6.2 Expert Review.............................................................................77 5.6.3 Walkthrough ...............................................................................78 5.6.4 Interview.....................................................................................78 5.6.5 Digital Photo Browser Discussion................................................79 5.7 Summative Evaluation & General Discussion ......................................80 5.7.1 In the Mood for Recollections .....................................................81 5.7.2 Recollections: a Special Case of Story Telling ..............................82 5.7.3 Who is in Control? ......................................................................83 5.7.4 Souvenir Appreciation.................................................................85 5.8 Summary & Conclusions .....................................................................86 6 Graspable User Interfaces ..........................................................................87 6.1 Abstract...............................................................................................87 6.2 Introduction ........................................................................................88 6.3 Definitions ..........................................................................................88 6.4 Graspable User Interface Categories....................................................89 6.5 Graspable User Interface Category Extension.......................................91 6.5.1 Generic Graspable User Interfaces ..............................................95 6.5.2 Personal Graspable User Interfaces..............................................95 6.6 Discussion...........................................................................................94 6.7 Conclusions ........................................................................................97