Pointing Devices for Wearable Computers
Total Page:16
File Type:pdf, Size:1020Kb
Hindawi Publishing Corporation Advances in Human-Computer Interaction Volume 2014, Article ID 527320, 10 pages http://dx.doi.org/10.1155/2014/527320 Review Article Pointing Devices for Wearable Computers Andrés A. Calvo and Saverio Perugini Department of Computer Science, University of Dayton, 300 College Park, Dayton, OH 45469-2160, USA Correspondence should be addressed to Saverio Perugini; [email protected] Received 29 July 2013; Revised 20 December 2013; Accepted 22 January 2014; Published 24 March 2014 Academic Editor: Eva Cerezo Copyright © 2014 A. A. Calvo and S. Perugini. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. We present a survey of pointing devices for wearable computers, which are body-mounted devices that users can access at any time. Since traditional pointing devices (i.e., mouse, touchpad, and trackpoint) were designed to be used on a steady and flat surface they are inappropriate for wearable computers. Just as the advent of laptops resulted in the development of the touchpad and trackpoint, the emergence of wearable computers is leading to the development of pointing devices designed for them. However, unlike laptops, since wearable computers are operated from different body positions under different environmental conditions for different uses, researchers have developed a variety of innovative pointing devices for wearable computers characterized by their sensing mechanism, control mechanism, and form factor. We survey a representative set of pointing devices for wearable computers using an “adaptation of traditional devices” versus “new devices” dichotomy and study devices according to their control and sensing mechanisms and form factor. The objective of this paper is to showcase a variety of pointing devices developed for wearable computers and bring structure to the design space for wearable pointing devices. We conclude that a de facto pointing device for wearable computers, unlike laptops, is not likely to emerge. 1. Introduction touchpad moves the cursor in the same direction [2]. An isometric joystick senses the force vector applied to it to An input device allows a user to interact with a computer by determine which direction and how fast the cursor has been converting human motor responses into signals a computer moved [2]. It is mounted on the center of a laptop computer’s processes. A pointing device is a type of input devices that keyboard and is referred to generally as a trackpoint.A allows a user to interact with a computer by moving a cursor touchpad and/or trackpoint is embedded into the chassis of on a monitor to select icons and trigger desired actions. a laptop allowing a user to operate each while viewing the The de facto pointing device for desktop computers isa laptop’s monitor. A trackpoint is especially suitable for small mouse, which was invented by Douglas England in 1967 [1]. laptopssinceithasatinyfootprint(i.e.,itismuchsmaller To manipulate the cursor, a user moves a mouse on a flat than a touchpad) [1]. The touchpad and trackpoint are the de surface; the cursor’s motion is proportional to the relative facto pointing devices for laptops. change in position of the mouse. A similar pointing device A wearable computer is a body-mounted device that a designed for desktop computers is a trackball—an upside- user can access at any time. The adjective “wearable” refers down mouse that allows a user to control the cursor by to “the use of the human body as a support environment rotating the ball in the direction of desired cursor motion. for the product” [3]. The portability of wearable computers Unlike most hardware devices, the mouse has endured for allows them to be used not only pervasively, but also while several decades [2]. However, a mouse is ineffective if a user engaged in other activities (e.g., in the battlefield or operating is unable to operate it on a flat and steady surface. Thus, the room) [4]. Since traditional pointing devices (i.e., mouse, emergenceofanincreaseintheuseoflaptopsresultedinthe touchpad, trackpoint, and trackball) were designed to be development of touchpads and isometric joysticks. used with desktop and laptop computers, which were not A touchpad is a small rectangular pad that responds to intended to be used in concurrence with other activities, they touch and is found on a laptop; moving a finger across a are inappropriate for wearable computers. Just as the advent 2 Advances in Human-Computer Interaction of laptops resulted in the development of the touchpad and thus, constrain gaze. Finger-tracking devices allow a user trackpoint, the emergence of wearable computers is leading to control the cursor by moving his fingers, usually in the to the development of pointing devices designed for them. direction of intended motion. Since fingers usually have a People operate wearable computers from different body high level of dexterity, these devices allow a user to precisely positions under different environmental conditions for dif- control the cursor. Wrist-tracking devices allow users to ferent uses. Possible positions include standing, walking, control the cursor using wrist movements. Forearm-tracking and prone. Possible environmental conditions include illu- devices allow a user to control the cursor with her forearm mination, acoustic noise, and temperature. Possible uses independently of wrist or finger movement. Pointing devices include surgery, combat, and sports. These aspects (i.e., that a user operates with his hand but do not explicitly track positions, environmental conditions, and uses) may change finger or wrist position are referred to here as hand-operated as a user operates a wearable computer [4]. We summarize devices. this contextual landscape for pointing devices for wearable Pointing devices can have other control mechanisms. For computers as instance, a pointing device can use eye tracking [5]. However, pointing devices based on eye tracking are currently more × × . body positions environmental conditions uses (1) appropriate for desktop, as opposed to wearable computers, becausethesensorsarelargeandtheaccuracyispoorin This wide cross-product has led to the development of a mobile environments [6]and,thus,arenottreatedfurther variety of innovative wearable pointing devices. here. Pointing devices can also be tongue-operated [7]or We survey a representative set of pointing devices for controlled by an EEG [8]orEMG[9]. We do not consider wearable computers and classify them using an “adaptation of these here because they are generally invasive (i.e., either traditional devices” versus “new devices” dichotomy. Adap- in a user’s mouth or sensors are cumbersome with current tations of traditional devices consist of traditional pointing technology). devices adapted for use with wearable computers. In contrast, The control mechanism of a pointing device is an impor- we refer to pointing devices for wearable computers that are tant design choice since it designates the muscle groups that not adaptations of traditional devices as new devices. We manipulate the pointing device and, as a result, control the study these devices according to their control and sensing cursor. These muscle groups determine the upper bound of mechanisms and form factor. the bandwidth of the device as measured using Fitts’ law [10] The objective of this paper is to showcase a rich variety of and, therefore, must be selected with consideration of the pointing devices, with diverse characteristics, developed for device intended uses and body positions of a user [11]. In wearable computers and bring structure to the design space other words, the muscle groups that control the cursor must for wearable pointing devices. We conclude that a de facto provide the pointing device with sufficient bandwidth for pointing device for wearable computers, unlike laptops, is not typical pointing tasks of the intended uses and body positions likely to emerge. of a user. Thispaperisorganizedasfollows.Section 2 discusses the three primary characteristics from which we survey 2.2. Sensing Mechanisms. Pointing devices utilize sensors, devices: control and sensing mechanisms and form factor. which output the magnitude of a physical quantity as an Section 3 covers adaptations of traditional pointing devices electrical signal, to measure the motor responses of a user while Section 4 surveys a variety of new devices. We identify and move the cursor accordingly. Since sensors determine tradeoffs in the design of wearable pointing devices and the movements that a device is sensitive to, the choice of conclude in Section 5. control mechanism is dependent on the choice of sensing mechanism. A deficient choice in the selection of a sensor can 2. Characteristics of Pointing Devices lead to usability problems [2]. The four sensing mechanisms we consider are acoustic sensors, cameras, inertial sensors, We characterize wearable pointing devices based on their and electromechanical sensors (see the bottom of Figure 2). control and sensing mechanisms and form factor. Note that A device that employs an acoustic sensor measures distinct implementations of the same type of device may each the propagation delay between an acoustic source and the use a different sensing mechanism. For instance, optical and corresponding sensor to determine the separation between scroll ball mice use different sensors but are referred to as them. Either the source or the sensor is placed on a user, mice nonetheless. who manipulates the cursor by changing the relative position between the source and sensor. 2.1. Control Mechanisms. The control mechanism of a point- A device that employs a camera utilizes image processing ing device refers to the movements made by a user to to track a user’s movement and move the cursor accordingly. manipulate the cursor. The control mechanisms we consider For such a device to operate effectively, with the exception of are head-tracking, finger-tracking, wrist-tracking, forearm- an optical mouse, a user’s fingers must be within the purview tracking, and hand-operated. of the camera in an illuminated environment.