URCousin: Universal Remote COntrol USer INterface Larix Lee Johnson Tsai Software Engineering Architecture Laboratory LERSSE University of British Columbia University of British Columbia 2356 Main Mall 2356 Main Mall Vancouver, BC, V6T 1Z4 Vancouver, BC, V6T 1Z4 [email protected] [email protected] ABSTRACT someone would operate a television set. Moreover, there are In this paper, we describe the design, development, and usability many ways to do the same task; a person in North America would testing of a universal remote control user interface. This user flip a light switch up to turn on a light, while a person in the interface needs to be easy to use and accessible by people who are United Kingdom will flip a light switch down[5]. Unfortunately, mobility impaired, yet it can be used and adopted by the general even a light switch may be impossible to manipulate for someone public as well. The main hypotheses are that the aspects of who is physically disabled, or perhaps who just has his or her familiarity, selective filtering, and freedom of choice will make hands full at the moment. In these two cases, a universal remote the universal remote control user interface more easy to use. control device would assist greatly. This paper attempts to During usability testing, participants generally are satisfied with address the issue of how people interact with devices through a the user interface. However, the usability testing shows universal remote control, the creation of a universal remote significant design issues. The three aspects in which the system control user interface, and the analysis of the results after design is based may not positively affect ease of use as it was performing usability testing. intended. Increasing the user-device interaction speed will greatly increase the feeling of ease of use. 2. MOTIVATION There are many people who are physically or mobility-impaired. ACM Classification: In both United States and Canada, one in ten adults have reported as being physically or mobility disabled [2] [14]. Due to the large H5.2 [User Interfaces]: Graphical User Interfaces, Input devices disability population, many human-rights groups were formed to and interaction techniques, Interaction styles pressure the government to make legislation changes to promote equality and increase accessibility in products and facilities [6]. General Terms For example, Microsoft is required to integrate accessibility Standardization, Human Factors, Design, Experimentation features into the Windows operating system for the American (and Canadian) markets. Keywords Universal user interface, universal remote control, adaptive user 2.1 Accessibility and Universality interface, accessibility Universal accessibility is an active research area in both the academic world and in industry. Current universal access systems use input devices like oversized keyboards, key-guards, 1. INTRODUCTION trackballs, sip-and-puff switches, magnification systems, head- In today’s urban world, it is almost impossible to go a day in the tracking units or voice dictation often cannot be easily applied to city without interfacing with any of the myriad of systems and devices in public spaces, and often rely on an external, personal devices that surround us everyday. From doors to crosswalk controller. Output systems are normally tailored to the user’s buttons, the selection of these systems and devices vary greatly. needs. For example, if the user is both visually and mobility Each device has its own unique way to interact with it; the way impaired, then the user can use a voice prompt for device someone operates a coffeemaker would be different than the way operation. For those that are not visually impaired but cannot physically access a device, sometimes bringing the user interface directly to the user will be sufficient. Fortunately, the majority of devices today is state-based and thus employs the use of buttons, which can easily be represented by a graphical user interface. An attempt to address the latter category of people by designing a universal graphical user interface that can be displayed on a personal controller for universal remote controlling will be described in detail. The scope of this paper will focus on graphical user interfaces and touch-screens for user interaction. 2.2 Universal Remote Controlling requirement that all manufacturers must abide by a fixed interface It is clear that accessibility is an increasingly important issue in layout with minimal stylistic and functional customization [13]. the management of both personal and public facilities. The goal This is a deterrent for manufacturer adoption because of the is to make things easier and more convenient for the user, and a limited customization and branding to distinguish the product good universal remote control system should be based on this from other competitors’ products [9]. Furthermore, these systems reasoning. A universal remote control system often employs a do not address the issue that users may want to use different user three-prong system design. The three fundamentals are: interfaces for a particular device, as a matter of accessibility or simply user preference [8]. - Universal communication hardware - Universal communication protocol 3. UNIVERSAL REMOTE CONTROL - Universal user interfaces USER INTERFACE Although there is significant research in centralized automation 2.2.1 Universal Communication Technology systems, remote controls, and universal graphical user interfaces, In the past twenty-five years, there has been much development in there is no prior work on a universal remote control interface for the realm of communications technology. Since the 1970’s, when the public domain. Although some protocols and standards, like Ethernet was being developed, stable communication network V2’s XIML and AAIML, describe how to layout user interface technologies expanded to include electrical wire-signals, infrared objects universally on to a controller screen, only the AAIML beams, fiber-optics, and wireless electromagnetics. Moreover, standard addresses the possibility of developing common user communication protocols are becoming more domain specific, interface layouts [13]. from utility protocols like TCP/IP to control protocols like Zigbee and to personal level protocols like Bluetooth. Today, the In the context of a universal interface, there is little research on wireless revolution made wireless devices virtually everywhere, developing a universal set of user interfaces that can be applied to as it is not uncommon to find cellular phones and watches any target device being controlled. A new universal graphical equipped with 802.11 (WiFi) or Bluetooth wireless antennas. If user interface system for universal remote controlling is being universality is based on adoption rates, which are proportional to proposed in hopes to address certain issues. ubiquity of an item, then WiFi and Bluetooth can be classified as a universal communications technology. 3.1 Ethnographic Study The first few steps in designing the proposed universal user 2.2.2 Universal User Interfaces interface is to observe how people interact with devices that they The concept of a universal user interface is an area that has not use daily, and to observe and analyze the issues of the current been addressed in great detail. Again, the term “universal” here “universal” remote control systems that can be found in the means the interconnectivity and interoperability of user interfaces consumer market today. across multiple devices. There are a number of attempts at creating standards to describe user interfaces, like Extensible 3.1.1 Daily Devices Interface Markup Language, (XIML), Abstract User Interface Beginning with ourselves, we created a list of public and private Markup Language (AUIML), Alternate Abstract Interface devices that we commonly use in our day to day rituals. We also Markup Language (AAIML), User Interface Markup Language walked to a local shopping centre and observed people (UIML), and W3C Device Independence Working Group manipulating various devices as well. To find even more devices, (DIWG) [3][4]. The AAIML, featuring a descriptive structured we created various scenarios in which a mobility-impaired person user interface support, is a good match to the aims of the universal in a wheelchair may have difficulty accessing devices daily. remote control. Moreover, the AAIML is part of a set of five Table 1 below illustrates a few examples of our observations. standards in the American National Standards Institute (ANSI) that make up the V2 “universal remote console” system[4][13]. Table 1. Private and public devices encountered daily As mentioned above, the V2 universal remote console is based on Domain Devices a set of five ANSI standards that, together, will address the needs Alarm Fridge/Freezer and scope of a universal remote control system. Although this clock/watch Microwave/Stove system has strong credibility, it is not considered as the standard Doors Oven/Toaster/Kettle yet. There are other attempts from Stanford University and Lights Sink/Toilet University of Hawaii with the Archimedes project [12] as well as Private Thermostats Television/VCR Carnegie Mellon University with the Pebbles project [7]. Phone/cellular DVD-Player Moreover, there are two patents filed in the United States that phone Audio Systems/Radio address the issues of a universal remote control [1][10]. PDA/computer CD-Player/MP3 Player However, these attempts have been proprietary. It is important to