Automatically Generating High-Quality User Interfaces for Appliances
Total Page:16
File Type:pdf, Size:1020Kb
Automatically Generating High-Quality User Interfaces for Appliances Jeffrey Nichols December 2006 CMU-HCII-06-109 Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Pittsburgh, Pennsylvania 15213 Thesis Committee: Brad A. Myers, Chair Scott E. Hudson John Zimmerman Dan R. Olsen, Jr., Brigham Young University Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy Copyright © 2006 Jeffrey Nichols. All rights reserved. This research was supported in part by the National Science Foundation (through the author’s Graduate Re- search Fellowship and grants IIS-0117658 and IIS-0534349), Microsoft, General Motors, the Pittsburgh Digital Greenhouse, and Intel. Equipment supporting this research was generously donated by Mitsubishi Elec- tric Research Laboratories, VividLogic, Lantronix, Lutron, IBM Canada, Symbol Technologies, Hewlett- Packard, and Lucent. The views and conclusions contained herein are those of the author and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of any sponsoring party or the U.S. Government. Keywords: Automatic interface generation, aggregate user interfaces, handheld computers, personal digital assistants, mobile phones, home theater, appliances, personal universal con- troller (PUC), user interface description languages (UIDLs), remote controls, multi-modal interfaces, speech recognition, Smart Templates, user interface consistency, personal consis- tency, familiarity ii Automatically Generating High-Quality User Interfaces for Appliances Jeffrey Nichols iii iv Abstract0B In this dissertation, I show that many appliance usability problems can be addressed by mov- ing the user interface from the appliance to a handheld device that the user is already carrying, such as a Personal Digital Assistant (PDA) or mobile phone. This approach, called the Personal Universal Controller (PUC), takes advantage of the increasing pervasiveness of wireless communication technologies that will allow handheld devices to communicate di- rectly with appliances. Automatic generation of the appliance user interface allows the PUC to create interfaces that are customized to the platform of the controller device, the user’s previous experience, and all the appliances that are present in the user’s current environment. This dissertation makes several contributions to the state of the art in automatic interface generation: • Automatic generation that makes use of dependency information to determine a better structure for the generated user interfaces • The general Smart Templates technique for incorporating domain-specific design con- ventions into an appliance specification and automatically rendering the conventions appropriately on different platforms and in different interface modalities • Algorithms that apply knowledge of similarity between specifications and interfaces the user has previously seen to generate new interfaces that are personally consistent • Algorithms that use a model of the content flow between appliances to generate task- based interfaces that combine functionality from multiple appliances An evaluation of the PUC system compared the automatically generated interfaces for two all-in-one printers with the manufacturer’s interfaces for the same two appliances and found that users of the automatically generated interfaces were twice as fast and four times as suc- cessful for both common and complex tasks. The evaluation also shows that the PUC’s consistency features allow users to be twice as fast when using a new appliance that is similar to an appliance they have previously encountered. This evaluation is the first known user study of automatically generated interfaces compared to human designs, and it shows that automatic generation of user interfaces for end users is now viable for interactive systems. v vi For my parents vii viii Table of Contents AbstractU U .................................................................................................................................v ListU of FiguresU ...................................................................................................................xvii ListU of Tables.....................................................................................................................U xxv AcknowledgementsU U ......................................................................................................... xxvii 1U U IntroductionU U 1 1.1U U TheU Personal Universal ControllerU ..................................................................... 7 1.2U U OutsideU the ScopeU ............................................................................................ 13 1.3U U ContributionsU U .................................................................................................. 14 1.4U U DissertationU OverviewU ...................................................................................... 15 2U U RelatedU Work U 17 2.1U U ControlU of AppliancesU ...................................................................................... 18 2.1.1U U CommercialU ProductsU ............................................................................. 18 2.1.2U U CommercialU StandardsU ........................................................................... 20 2.1.2.1U U INCITS/V2U StandardU ............................................................. 20 2.1.2.2U U UniversalU Plug and PlayU .......................................................... 21 2.1.2.3U U DigitalU Living Network AllianceU .............................................. 22 2.1.2.4U U HomeU Audio-Video InteroperabilityU ......................................... 22 2.1.2.5U U JINIU U ....................................................................................... 23 2.1.2.6U U OSGiU U ..................................................................................... 23 2.1.3U U ResearchU SystemsU .................................................................................... 23 2.1.3.1U U UniversalU InteractorU ................................................................ 23 2.1.3.2U U IBMU Universal Information ApplianceU ..................................... 24 2.1.3.3U U ICrafterU U .................................................................................. 24 2.1.3.4U U XwebU U ...................................................................................... 25 2.1.3.5U U UbiquitousU InteractorU .............................................................. 25 ix 2.1.3.6U U AnalysesU of Actual Remote Control UsageU .................................. 26 2.1.3.7U U DiamondHelpU U ......................................................................... 26 2.1.3.8U U RoadieU U .................................................................................... 26 2.2U U AutomaticU & Guided User Interface DesignU..................................................... 27 2.2.1U U EarlyU Model-Based SystemsU ..................................................................... 28 2.2.1.1U U MickeyU ....................................................................................U 28 2.2.1.2U U JadeU U ........................................................................................ 29 2.2.1.3U U UIDEU U ..................................................................................... 29 2.2.1.4U U HumanoidU U .............................................................................. 30 2.2.1.5U U MastermindU U ............................................................................ 30 2.2.1.6U U ITSU U ........................................................................................ 30 2.2.1.7U U TRIDENTU U ............................................................................. 31 2.2.2U U Model-BasedU Systems for Very Large Interfaces and Platform IndependenceU 31 2.2.2.1U U Mobi-DU U .................................................................................. 32 2.2.2.2U U ConcurTaskTreesU U .................................................................... 32 2.2.2.3U U XIMLU U ..................................................................................... 33 2.2.2.4U U IBMU PIMA and MDATU ......................................................... 33 2.2.2.5U U UIMLU and TIDEU ................................................................... 33 2.2.2.6U U TERESAU U ................................................................................ 34 2.2.2.7U U USIXMLU U ................................................................................ 34 2.2.2.8U U XAMLU and XULU ..................................................................... 34 2.2.2.9U U SUPPLEU U ................................................................................ 35 2.3U U AggregateU User InterfacesU ................................................................................. 36 3U U PreliminaryU User Studies U 39 3.1U U Hand-DesignedU User InterfacesU ........................................................................ 39 3.2U U UserU StudiesU ..................................................................................................... 42 3.2.1U U ProcedureU U .............................................................................................. 42 3.2.2U U EvaluationU U ............................................................................................ 42 3.3U U StudyU #1U .........................................................................................................