HCI Application: Ubiquitous Computing History Principles of Ubiquitous Computing Paradigms Desktop Computing Mobile Computing
Total Page:16
File Type:pdf, Size:1020Kb
History Mark Weiser HCI Application: Ubiquitous (1952-1999) Computing ►Chief Technologist Xerox PARC ►Began Ubiquitous Computing Project in 1988 Organizational & ►Weiser, M. "The Computer for the Twenty-First Task Social Issues Century”, Scientific American, 1991, 94-100 ►Mark Weiser’s vision Computers everywhere, disappearing/integrated in Design environment/objects around us Computer no longer isolates us from tasks/environment, no longer focus of attention Technology Humans Social impact: similar to writing: found everywhere from clothes labels to billboards Similar to electricity which surges invisibly through the walls of every home, office, car Principles of Ubiquitous Computing Paradigms ►Getting computing “off the desktop” Connect with what else people do “Pervading” the physical world = “Pervasive”, “Ambient”, “Situated” ►Many ways to break the traditional PC model Many communities working hard Many different definitions Figure 1. The major trends in computing ►Paradigms of Ubiquitous Computing: “… the third wave in computing, just now beginning. Mobile / Wireless computing First were mainframes, each shared by lots of people. Now we are in the PC era, person and machine staring Hands-free UI / Intelligent environment uneasily at each other across the desktop. Disaggregated computing / Migrating UI Next comes ubiquitous computing, or the age of calm Location-sensitive data & services technology, when technology recedes into the Invisible computing background of our lives." Wearable computing Desktop Computing Mobile Computing Network Network UI UI Processor Device Processor Device Data StoreBus Bus Data Store Data Store Differences w. desktop comp: Everything is smaller Bus provides speed, connection, ID, trust, synchrony Power is limited Processor assumes minimum suite of devices Network connection is wireless Key feature: User has to sit in chair Person is standing or moving! Wearable Computing Invisible Computing Variation on mobile computing Everything in the world is electronically active Novel UI devices enable novel Your attention is on your task applications Of course, there are computers present Stand-alone VR (Virtual Reality) With location, AR (Augmented Reality) “Calm” or “ambient” computing Related: Personal memory devices; Physical icons Calm Technology Hands-Free Computing ► Proposed by Mark Weiser & Seely Brown in 1995 ► “Calm”: technology that informs but doesn't demand our focus or attention Network ► Contrast with the way technology is designed now: in your face, highly interactive,using multiple modalities, etc ► Moves easily between center of attention & periphery UI speak ► Other word for Ambient Interfaces (Ishii) Processor ► Example: Device move dangling string representing network traffic (Jeremijenko) look Inner office windows Bus point ► Reading: http://sandbox.xerox.com/hypertext/ Data Store weiser/calmtech/calmtech.htm Data Store gesture Change UI devices to work at a distance No need to carry anything Mobility very limited Intelligent Environment Wireless Connectivity Network Wireless Access Point UI Device UI Proximity Processor Device ? Bus UI Bus Device Data Store Device Proximity connectivity (e.g. Bluetooth): Per-device (no wires needed) Hands-free with greater area of coverage Ad hoc networking (peer-to-peer) Need connectivity for UI devices Locality of connection ≠ locality of access Need to dynamically select UI devices If device is static, you know where you are Location-Sensitive Computing Non-Traditional Devices Computing experience changes as you move Migrating (“Follow-Me”) UI Why be limited to traditional computing devices? Location-Specific Data More pervasive, more subtle, more informative Need device to know where you are Cell phone, GPS, active badge, camera, … Enable novel applications – “immobile robot” Ubiquitous Computing An interconnected system People Ubiquitous Computing = Mobile Computing + opens doors Intelligent Environment User Interface generates TAN incoming call updates location t n e S time, location e Applications m n e s g i n & Behaviors a g n a & M address book M ce Environ o r Devices d alert, events e u l o in s ment e any weather service acoustic alerts g R school closings Specialized Ubicomp Devices What makes technology disappear? ►LoveGety – Japan, 1998 (matchmaker) ►Psychological effect of learning (transparency) When people learn something sufficiently well, they ►Pirates! – Viktoria Institute (treasure hunt, combat) cease to be aware of it, they can focus beyond the ►Human Pacman – University of Singapore technology on new (true) goals Called “compiling” by H. Simon, or “periphery” by J. ►The ARQuake Project, at the University Seely Brown of Southern Australia ►Distribution of technology (distributed computing) ►EasyLiving - Microsoft ►Physical invisibility (devices embedded everywhere) ►Location: must know where users are in order to provide appropriate services Outdoor: GPS, wireless/cellular networks Indoor: active badges, electronic tags, vision, motion detectors, keyboard activity ►Scale ►Context awareness/automated functions Context-Aware Computing How? Automated Capture ►Context: any information that can be used to characterize the situation of an entity (who, where, ►Automated capturing everyday experiences when, what) Machines are better at some of these things than we are ►Computing services sense aspects of environment ►Multiple streams of information need to be (location, objects, identity, emotion,…) and tailor captured provided services ►Logging of events for later use ►Using context to: present relevant information: e.g., ‘smart’ museum guide ►Summarizing and making available to the user in perform an action automatically, e.g., print to nearest multiple formats printer ►Capturing of process? show an action that use can choose, e.g., want to phone ►But the number in this email? At what level to integrate information streams? Shall user be able to modify the captured streams? Which information is important? Scale Scale ►Desktop screens vary by a factor of 2.5 in size and a ►Some interaction techniques for desktop will not factor of 4 in pixels work ►Ubicomp screens vary by factors of 100 in size and a Real estate problem on small devices factor of 625 in pixels Can’t reach menubar on wall-size devices Æ gesture/voice modality? Cell phone to interactive wall (3796 x 1436 pixels) Æ even nano-scale device? ►How do you ensure presentation consistency across different devices? ►How do you ensure privacy and security? ►Significant implications for design tools Moving target problem Tools for coordinating multiple, distributed, communicating devices Scenario: Turning on the lights Identification vs. Privacy ►How? ►People enter the space as “unknowns” Flip a switch ►How to establish person’s identity? Dialog box with buttons Password by keyboard or voice Touch a map with lamp indicators “Turn on the room lights” Active badge or cardkey Make a funny gesture Scan eye / fingerprint / face It’s dark outside ►Privacy issues You enter the room, you sit down by that desk lamp Passive identification = unobtrusive use of cameras / voice ►How to activate? When your whole life is on the network, where does the Built in by hardware manufacturer information go? You program the behavior If no “active badge” assumed, people can’t physically turn Learn by repetition off identification ►Technological implications People need to trust the system Tracking: location/pose/activity Need clear policies, deeply rooted in system Sensors: gesture/voice/light recognition Keep sensitive data in secure places Privacy Issues Challenges and existing solutions ►One consequence of Ubicomp ►Challenges Way more data about us can be gathered (and used). Potentially a great thing for collaborative algorithms Unfamiliar environments Dynamic, ad hoc and shared (difficult to determine ►But, it’s potentially a great problem because... access rights) Protection of the user data generated and maintained by the environment No central control Privacy of individuals who use the environment High data rate (must be processed in real-time) Ability of legitimate users to make use of data recorded Collaborative applications in the environment ►Existing solutions (inadequate for ubicomp) Dealing with high-speed streams of data Based on authentication/authorization model Everyday Risks Extreme Risks Require a piece of running code to actively check permissions Friends, Family Employers Government Stalkers, Muggers _________________________________ _________________________________ __________________________ _________________________________ Why won’t it work for ubicomp? Dynamic, distributed, environment; protecting agent can be bypassed. Over-protection Over-monitoring Civil liberties Well-being Social obligations Discrimination Personal safety Others? Embarrassment Reputation Potential solutions (?) Other Problem – Localized Scalability ►Empower people so they can choose to share: the right information ►As smart spaces grow in sophistication, the with the right people or services intensity of interactions between a user’s personal at the right time computing space and his/her surroundings ►Clear value proposition increases. ►Simple and appropriate control and feedback ►This has severe bandwidth, energy, and distraction ►Plausible deniability implications for a ubicomp user. ►Limited retention of data ►The presence of multiple users will further ►Decentralized control complicate this problem. ►Special