Bonjour! Greeting Gestures for Collocated Interaction with Wearables Steven Houben, Simon Perrault, Marcos Serrano To cite this version: Steven Houben, Simon Perrault, Marcos Serrano. Bonjour! Greeting Gestures for Collocated Inter- action with Wearables. 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (ACM MobileHCI 2015), Aug 2015, Copenhagen, Denmark. pp. 1146- 1152. hal-01363312 HAL Id: hal-01363312 https://hal.archives-ouvertes.fr/hal-01363312 Submitted on 9 Sep 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Open Archive TOULOUSE Archive Ouverte ( OATAO ) OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible. This is an author-deposited version published in : http://oatao.univ-toulouse.fr/ Eprints ID : 15345 The contribution was presented at MobileHCI 2015 : http://mobilehci.acm.org/2015/ To cite this version : Houben, Steven and Perrault, Simon and Serrano, Marcos Bonjour! Greeting Gestures for Collocated Interaction with Wearables. (2015) In: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (ACM MobileHCI 2015), 24 August 2015 (Copenhagen, Denmark). Any correspondence concerning this service should be sent to the repository administrator: [email protected] Bonjour! Greeting Gestures for Collo- cated Interaction with Wearables Steven Houben Marcos Serrano Abstract University College London University of Toulouse - IRIT Wearable devices such as smartwatches (SW) and UCL Interaction Centre / ICRI Cities Toulouse, France head-worn displays (HWD) are gaining popularity. To London, UK [email protected] improve the collocated capabilities of wearables, we [email protected] need to facilitate collocated interaction in a socially ac- ceptable manner. In this paper we propose to explore widespread used greeting gestures such as handshakes 1,2 Simon Perrault or head gestures to perform collocated interactions with 1 Yale-NUS College wearables. These include pairing devices or information 2 NUS-HCI Lab, National University of exchange. We analyze the properties of greetings and Singapore how they can map to different levels of wearable pair- Singapore ing (family, friend, work, stranger). This paper also [email protected] suggest how these gestures could be detected with SWs and HWDs. Author Keywords Smartwatch; Head-worn Display; Wearable interaction; Input techniques; Device Pairing. Introduction Wearable devices such as smartwatches, sports arm- bands, head-mounted displays and smart glasses are increasingly finding their way into people’s everyday life. Together with existing devices, such as phones, tablets and traditional desktop-based computers, they form an elaborate device ecology that allows users to human communication. We argue that by informing the appropriate and choose devices based on their af- design of interaction techniques and applications for fordances, properties and functionality. Users are no wearables with existing social protocols and gestures, longer interacting with single devices, but rather use a users will be empowered to appropriate and use them multitude of devices as portals into a shared infor- in a more effective and less social awkward way. In this mation space. Within the research community the com- paper, we describe the properties of greetings and the plexities, interactions and usefulness of traditional de- relation to ad hoc collocated interactions with weara- vices, such as phones and tablets, are relatively well bles, and we introduce two technology concepts that understood [4, 10, 14]. These novel wearable devices, implement and embrace this design space. however, pose a set of new fundamental social chal- lenges from the user perspective related to (i) device Interaction Scenario configuration and pairing, (ii) information exchange, Alice just returned from Korea, where she took many and (iii) collaborative work in collocated situations. pictures and videos using her head-mounted display. When meeting her colleague Bob, they shake hands to Current advances in wearable computing are increas- greet, causing the system to make a collegial associa- ingly exploring technical solution to these challenges by tion between their devices. After receiving a buzz from covering novel gestural interactions with wearables [9, the watch, they both know that their devices are paired 11, 12] and interactions distributed between wearables and ready. Alice talks about all the exciting stuff she and handheld devices [1, 5, 6, 7]. However, it is un- has done on holiday, and asks whether Bob wants to clear what the social implications of these techniques see some of the pictures she took. Alice then touches are and how they might be appropriated by end-user. the side of her HWD to browse through her holiday pic- tures until she finds the one she wanted to show to In this work, we propose exploring social greetings, Bob. She then performs a swipe gesture on the HWD in which are the first step in creating a natural and appro- the direction of Bob, who is offered to receive the im- priate interaction between humans [8]. These social age. After accepting it by touching his own HWD, he Figure 1. Two examples of greet- interactions have been previously applied to Human sees it appearing on the screen. After a short chat ings: western handshaking and thai greeting. Robot Interaction (HRI) [3]. However, work on HRI about the holiday, Alice waves goodbye to Bob as she is mostly focuses on the phases of the greetings rather leaving. This causes the watch to buzz again to indicate than on the properties of the greetings gestures, which that the device connection is broken off. The image that are crucial in the context of interaction with wearable was shared with Bob’s HWD is removed. devices. Later that day, Alice meets her boyfriend Frederik. In this position paper, we propose to use greetings ges- When they meet she kisses him, causing the system to tures for collocated interactions with wearable devices create a personal association between the devices. A that are based on existing accepted social conventions, buzz on their smartwatch confirmed the pairing of their interactions and protocols used in non-digital human to devices. Frederik asks whether she can share one of the videos she made during her trip. Alice again brows- to social zones, identifying four zones between intimate es through her archive of pictures and videos. While (0-50cm) and public (>4m) [2]. This concept has been browsing Frederik can see a preview of all the images successfully explored for cross-device interactions using and videos that his girlfriend made. When spotting a the concepts of F-formations (the physical arrangement video still where Alice was having a cocktail, he laughs of a group of persons) and micro-mobility (interperson- and asks Alice to send that video. Alice swipes in the al orientation of devices) [10]. Kendon [8] identified direction of Frederik to send the full video to Frederik, different types of greeting gestures according to these who immediately starts watching it. After leaving, the inter-personal distance, from distance salutation to final devices disconnect automatically after the system de- approach and close salutation. Distant salutation is tected that they are no longer in the same place. Fred- usually associated with gestures such as waving, head erik, however, keeps the video and sends it to his tossing, head lowering, nodding or head dipping [8]. playlist using a touch gestures on his HWD. Other approaches include palm presentation; smiling and head setting (erect head for instance). Closing sal- This envisioned solution takes advantage of the fact utation can involve non-contact salutation, handshake, that wearable devices are embedded directly on users embraces or other cultural-dependent salutations such who can thus simply perform everyday life gestures to as bowing. The entire salutation process is, thus, a de- perform collocated interaction with their wearables. fined process with several clearly separate steps. However many parameters need to be taken into ac- count in order to design such interactions. This requires Group Dynamics and People an in-depth exploration of the design space and social Along with the formation, the number of people in- implications. volved in the greetings defines the social context, i.e. from private to public. Each type of context will engage Social Properties of Greetings the participants in a different level of collocated interac- Social properties of greetings can be leveraged for col- tion. People generally change their behavior depending located wearable interactions, in particular to configure on the size of the group. These temporal processes of or pair collocated devices. This sections is not an ex- change determine the intra- and intergroup dynamics haustive list but rather an initial summary of properties within or between several groups.