Gummi: a Bendable Computer
Total Page:16
File Type:pdf, Size:1020Kb
Gummi: A Bendable Computer Carsten Schwesig Ivan Poupyrev Eijiro Mori Interaction Lab, Sony CSL Interaction Lab, Sony CSL Creative Development Group Takanawa Muse Building Takanawa Muse Building Sony Design Center 3-14-13 Higashigotanda 3-14-13 Higashigotanda 6-7-35 Kitashinagawa Shinagawa-ku, Tokyo Shinagawa-ku, Tokyo Shinagawa-ku, Tokyo 141-0022 Japan 141-0022 Japan 141-0001 Japan ABSTRACT Gummi is an interaction technique and device concept based on physical deformation of a handheld device. The device consists of several layers of flexible electronic components, including sensors measuring deformation of the device. Users interact with this device by a combination of bending and 2D position control. Gummi explores physical interaction techniques and screen interfaces for such a Flexible Display device. Its graphical user interface facilitates a wide range of 2D Position Sensor interaction tasks, focused on browsing of visual information. We implemented both hardware and software prototypes to explore and evaluate the proposed interaction techniques. Our evaluations have shown that users can grasp Gummi's key interaction principles within minutes. Gummi demonstrates promising possibilities for new interaction techniques and devices based on flexible electronic components. Author Keywords Handheld devices, mobile computing, interaction design, Figure 1: Gummi Device and Bending Interaction GUI, embodied interaction, flexible electronics, smartcards. flexible and have no mechanical parts. We envision a ACM Classification Keywords device, approximately the size of the credit card, that can be H5.2. [Information interfaces and presentation (e.g., HCI)]: comfortably put into a pocket or slipped into a wallet. User interfaces – Graphical user interfaces (GUI), Input The development of such a deformable computer may seem a devices and strategies, Interaction styles, Screen design; very remote possibility. However, rapid advances in flexible J.7 [Computers in other systems]: Consumer products. electronics make such a device feasible in the near future. INTRODUCTION A range of flexible electronic devices and components has recently been demonstrated, such as flexible transistors and Gummi is a concept of a novel device and interaction style full color, high-resolution flexible OLEDs with a thickness based on bending of a deformable handheld computing of 0.2mm [5, 12]. Flexible electronics are predicted to device (Figure 1). Ideally, the proposed device would become one of the core technologies that would facilitate consist of several layers of flexible electronic components: the creation of small, thin, efficient and inexpensive mobile a flexible organic, light-emitting display (OLED) on top, devices for future pervasive computing environments [19]. flexible electronic circuits in the middle and a flexible, This technology was one of the main sources of inspiration touch-sensitive panel on the bottom. Embedded sensors for the Gummi project. would measure physical deformation of the device. The resulting bendable computer would be extremely thin, Interaction is a major challenge in designing a flexible, bendable computer. Even if we could develop a bendable Permission to make digital or hard copies of all or part of this work for computer the size and thickness of a credit card, how personal or classroom use is granted without fee provided that copies are would users be able to interact with it? Previous ideas not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, or for applications of flexible electronics typically disregard republish, to post on servers or to redistribute to lists, requires prior specific interaction and instead focus on ergonomic and aesthetic permission and/or a fee. aspects. Recurring themes are digital newspapers, electronic CHI 2004, April 24–29, 2004, Vienna, Austria. maps, roll-out and wearable displays, but not much thought Copyright 2004 ACM 1-58113-702-8/04/0004…$5.00. elements of the WIMP paradigm are absent from Gummi, for example we do not have the concept of a pointer in our user interface. At the same time, the Gummi interface remains systematic and consistent: our informal evaluations have shown that first-time users can grasp key ideas of Gummi in a matter of minutes. In this paper we present the basic concept of this new device and its interaction style. RELATED WORK With the proliferation of small mobile computing devices, the importance of creating effective and easy to use interfaces for them has become evident. The challenges are well known in the HCI community: small displays Photo courtesy of Junko Kimura limit space for visual information, there is little room for Figure 2: Mock-Up Model of a Bendable Computer buttons or other electromechanical controllers. It has been recognized that traditional desktop GUI are difficult to has been given to human-computer interaction with adapt to mobile devices [17, 8, 6]. There have been several such devices. Gummi exploits a key property of flexible research directions that address these challenges. electronic technology – physical flexibility – to create a new interaction style and device concept (Figure 2). Commercial personal, digital assistants (PDA) often adapt the traditional WIMP interaction paradigm. Equipped with The Gummi project is also part of a wider area of research pen and touch-sensitive displays, they feature familiar GUI into user interfaces for mobile devices. Designing mobile elements, such as dialog boxes, scroll bars, widgets and device interfaces that are easy and pleasant to use has been a buttons. This approach is problematic because, as devices challenging problem for the HCI community. One of the key and screens become smaller, pointing and clicking on problems is that although standard Windows, Icons, Mouse small interface elements becomes increasingly difficult. and Pointer (WIMP) interfaces are reasonably effective for Furthermore, icons and widgets occupy precious screen desktop computer environments, they are difficult to use on estate and external input devices, such as pens, occupy a small, handheld computing devices. Mobile HCI research second hand and are easily misplaced [17, 15]. tends to either adapt WIMP interfaces to the limitations of mobile devices [20] or to enhance existing WIMP interfaces Context-aware and location-based interfaces propose to with new input modalities [6]. In most cases, however, the present content on mobile, handheld devices depending underlying WIMP paradigm is unchanged: whether we use on current user context, defined in terms of location, time a pen, a mouse or a trackpad, pointing and clicking remains or activity. This approach promises to use context as an the conceptual basis for most human-computer interaction. intelligent filter of data, limiting displayed information to what is currently relevant to the user [14, 16, 3]. Determining It is certainly important to enhance and improve WIMP- context, however, remains a difficult challenge. based mobile interfaces, but we believe that it is also relevant to explore new, non-WIMP interaction paradigms To cope with a small screen size, a variety of zooming and for mobile devices. New technologies that allow different fish-eye viewing techniques have been proposed [17, 11]. and unexplored input modalities present an opportunity These techniques intelligently distort visual information to create novel, non-WIMP interaction styles. Flexible so that only information within the userʼs attention focus electronics are certainly one of those technologies. is presented in detail, while peripheral data is simplified or abstracted [17, 4]. Another approach is to reformat visual Gummi differs from WIMP interfaces in both its physical content to adapt it to mobile devices – examples are systems interaction elements and in its GUI. Users interact with a like Digestor [2] and M-links [20]. Transparent overlays Gummi device by physically deforming it and by touching of control widgets were also proposed as a solution for the sensor on its back (Figure 1). No buttons, mechanical the small screen size [8]. One particular problem in using switches or traditional touch screens are used, so that the all these techniques is in providing interaction techniques display can cover the entire surface of the device. Gummiʼs to control levels of distortion, transparency and zooming: graphical user interface facilitates a wide range of adding additional widgets on the screen to control levels of interaction tasks and applications: browsing hyperlinked fish-eye distortion or zooming defeats the purpose of these visual information such as web pages, viewing maps and techniques - saving screen space [17, 8]. In Gummi, we use photographs, playing games, reading e-mail and even bending to control zooming and transparency. writing short messages. Many Gummi interface elements were inspired by existing GUI techniques, such as zooming Research into embodied interfaces is perhaps most relevant interfaces and use of transparency [11, 8]. However, key to Gummi. It suggests the augmentation of handheld devices with sensors to allow users to interact with the device by physically manipulating it in their hands. Typical examples Flexible OLED display include tilting and touching parts of the device [6, 15, 7]. For Bending Sensor example, users can navigate a large graphical map by tilting Flexible Power Source the device [15]. On the output side, some information can Flexible