Wearable Glasses for the 20-20-20 Rule to Alleviate Computer Vision Syndrome
Total Page:16
File Type:pdf, Size:1020Kb
Tiger: Wearable Glasses for the 20-20-20 Rule to Alleviate Computer Vision Syndrome Chulhong Min Euihyeok Lee Nokia Bell Labs, UK KOREATECH, Republic of Korea [email protected] [email protected] Souneil Park Seungwoo Kang∗ Telefonica Research, Spain KOREATECH, Republic of Korea [email protected] [email protected] ABSTRACT digital screens causes various symptoms such as eyestrain, We propose Tiger, an eyewear system for helping users follow dry eyes, and blurred vision, referred to as Computer Vision the 20-20-20 rule to alleviate the Computer Vision Syndrome Syndrome (CVS) [3, 33]. In addition, CVS symptoms also symptoms. It monitors user’s screen viewing activities and decrease the work productivity, thereby having a significant provides real-time feedback to help users follow the rule. For economic impact [27]. According to the report by the Vision accurate screen viewing detection, we devise a light-weight Council [11], nearly 90% of Americans use digital devices for multi-sensory fusion approach with three sensing modalities, two or more hours each day. 65% of Americans experience color, IMU, and lidar. We also design the real-time feedback CVS symptoms. Our survey with 131 participants shows that to effectively lead users to follow the rule. Our evaluation they already experience various symptoms but they do not shows that Tiger accurately detects screen viewing events, know the desirable practice of eye rest correctly. and is robust to the differences in screen types, contents, To mitigate CVS symptoms, some previous works [12, 14] and ambient light. Our user study shows positive perception attempt to stimulate eye blink. They provide intervention of Tiger regarding its usefulness, acceptance, and real-time when detecting a decrease of blink rate while users view a feedback. screen. Although blinking prevents dry eyes, it is a partial solution to the CVS symptoms. The eyes use significantly CCS CONCEPTS more muscles when focusing on objects at a near distance, • → and continual screen usage easily causes eye strain [33]. Human-centered computing Ubiquitous and mo- 1 bile computing systems and tools; We propose Tiger , an eyewear system to help users fol- low the 20-20-20 rule in their daily lives. The rule suggests KEYWORDS to take a 20-second break to view objects of 20 feet away Computer Vision Syndrome; 20-20-20 rule; Eyewear every 20 minutes of screen use [1, 3, 4, 11, 33]. The rule is one of the recommended strategies to alleviate CVS since tak- 1 INTRODUCTION ing frequent breaks to look at faraway objects significantly Digital screens are ubiquitous and indispensable in our lives, relieves the symptoms. Tiger monitors users’ screen view- but they are a double-edged sword. They benefit our pro- ing activities and provides real-time feedback to help users ductivity, entertainment, and information access; however, take necessary actions. More specifically, Tiger notifies users arXiv:1906.05047v1 [cs.HC] 12 Jun 2019 excessive use of them hurts our eyes. The prolonged use of that they need to 1) take a short break if they are viewing a screen for more than 20 minutes, 2) see 20 feet away if they ∗Corresponding author are looking at nearby objects during the break, and 3) return Permission to make digital or hard copies of all or part of this work for to their previous activity if the break reaches 20 seconds. personal or classroom use is granted without fee provided that copies are not We believe that the form factor of eyeglasses has unique made or distributed for profit or commercial advantage and that copies bear advantages in achieving the goal. Detection of screen usages this notice and the full citation on the first page. Copyrights for components alone could be approached through screen-centric observation, of this work owned by others than ACM must be honored. Abstracting with i.e., monitoring users from the device being used. Typical credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request examples of this approach are timer-based reminder applica- permissions from [email protected]. tions [5–7]. There are also recent techniques that use a front MobileHCI ’19, October 1–4, 2019, Taipei, Taiwan camera of smartphones [18] or analyze keyboard/touch in- © 2019 Association for Computing Machinery. teractions for more accurate detection. However, developing ACM ISBN 978-1-4503-6825-4/19/10...$15.00 https://doi.org/10.1145/3338286.3340117 1Tiger is an abbreviation of "TIme to Give your Eyes a Rest". MobileHCI ’19, October 1–4, 2019, Taipei, Taiwan Trovato and Tobin, et al. a system for providing effective guidance to the rule goes Age 10s (2), 20s (89), 30s (18), 40s (7), 50s (15) far beyond simple screen view detection. It should also de- Gender Male (81), female (50) tect whether a user looks at something at a long distance Occupation Student (46), office worker (24), professions while taking a rest. Moreover, the screen usages should be (21), researchers (11), sales job (8), other (21) monitored across devices as modern users are often equipped Table 1: Demographics of survey participants. with multiple heterogeneous devices. We believe an eyewear enables viewer-centric observation, i.e., observing all what a user sees, which can fulfill the above requirements. [12, 14, 17]. EyeProtector measures the viewing distance to To build Tiger as a standalone wearable system, we address a mobile phone using a front camera and alerts when the a range of challenges. First, we develop an eyewear proto- distance is too short [18]. While we believe that these works type that carefully combines necessary sensors and actuators are complementary to our work for a comprehensive CVS for accurate screen view detection and effective real-time solution, we focus on the recommended practice for screen feedback. Second, we design a light-weight, multi-sensory viewing and build a tailored system to guide users according fusion technique for screen viewing detection. Rather than to the 20-20-20 rule. relying on a power-hungry camera-based approach, we fuse Eye tracking & gaze-based interaction. A large body three sensing modalities, color, IMU, and lidar, each of which of work has been made on eye tracking and gaze-based in- recognizes color patterns of objects being seen, head move- teraction for both stationary and mobile devices [13, 15, 20]. ment, and viewing distance, respectively. Third, we design However, their primary goal is to accurately identify the real-time feedback to effectively guide users to follow the point of the gaze or recognize a motion of the eyes given a rule. To devise perceptible and comfortable feedback, we display area. For accurate tracing, they commonly employ a consider a number of parameters, e.g., actuator placement, hardware device tied to the target display area, e.g., a head- actuation intensity, and duration, and identify suitable pa- mounted display [9] or a camera [30]. Though it is possible rameter values. To the best of our knowledge, Tiger is the to adapt the solutions of these works for implementing the first wearable system for the 20-20-20 rule. 20-20-20 rule, an application of them would be confined to a Extensive experiments are conducted to evaluate various specific target display. Also, continuous usage of a camera aspects of Tiger. First, we collect 800 minutes long data under and real-time image processing would incur heavy burden diverse realistic scenarios. Our evaluation results show that to battery-powered devices. Tiger accurately detects screen viewing events, and is robust There are a few initial works based on eyewear devices to the differences in screen types, contents, and ambient for gaze tracking [23, 24, 34]. As they are making progress light. Second, our user study with 10 participants shows on building power efficient solutions, they can be potentially the positive perception of Tiger about its usefulness and helpful for detecting general screen viewing activities. acceptance. The real-time feedback of Tiger is also easily Screen use detection. Zhang et al. proposed a system perceivable and comfortable. to detect moments of screen watching during daily life ac- tivities based on first-person videos from a wearable camera 2 RELATED WORK [35]. Wahl et al. proposed a method for screen use detection using a color sensor in smart eyeglasses [31]. In this paper, The 20-20-20 rule and applications. Many ophthalmic organizations such as American Optometric Association, we find out that the sole use of the color sensor canmake American Academy of Ophthalmology, and Canadian Asso- false-positive errors and thus propose a multi-sensory fusion ciation of Optometrists suggest following the 20-20-20 rule including an IMU and a distance measurement sensor to in daily lives to alleviate CVS [1, 3, 4]. There are mobile and make Tiger more robust to various situations. In addition to desktop applications as well as browser extensions devised screen use detection, we devise effective feedback and build to help users follow the rule [5–7]. However, they simply pro- a wearable system to help users follow the rule. vide timer-based periodic notifications regardless of whether 3 MOTIVATION a user actually views a screen or not. They are not able to check if a user takes a break looking at something 20 feet Screen Use & Eye Rest Survey away. Also, they burden users to install on every device they One may argue that people would relax their eyes well if they use. experience CVS symptoms and are aware of the importance Applications and systems for eye health. As men- of the eye rest.