CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
History of HCI
Personalities: CS 160: Lecture 2 * Vannevar Bush - Universal information access * J.C.R. Licklider - Networking, Agents * Ivan Sutherland - Sketchpad Professor John Canny * Doug Engelbart - Mouse, GUI, Word proc... * Ted Nelson - Hypertext Fall 2004 * Alan Kay - OO programming, Laptops * Don Norman - Cognitive principles * Jacob Nielsen - Usability
9/1/2004 1 9/1/2004 2
History of HCI History of HCI
Systems: Politics * Memex - 1945 (concept) * Military Funding *Sketchpad -1963 + NDRC - OSRD - ARPA – DARPA * Elite universities (MIT, Stanford, CMU, Berkeley) * NLS (oNLine System) - 1963-68 * NSF 1950 present +(mouse ‘64) 1968 * Xerox PARC - 1970 present * Xerox Alto ‘72, Star ‘81 Dynabook * Apple - NeXT *Grid Compass 1983 * Hypertext 1967... 1983 * Apple Lisa ‘83, Mac ‘84, NeXT ‘88 + Prototypes: HES 1969, ZOG 1975... * Powerbook 1991 + Xanadu 1981, not funded ‘til 87 (Hypercard 1987) * HTML, HTTP 1994 + 1989 Xanadu -> Autodesk, WWW proposal
9/1/2004 3 9/1/2004 4
Online History People
There was an excellent PBS special on the history of Vannevar Bush (1890-1974) computing that covered most of these topics: * Engineer by training (MIT) http://www.pbs.org/opb/nerds2.0.1/ * Differential analyzer - 1930 * Led computing research in ‘30s * Created military research + NDRC ‘40, OSRD ‘41-47 * Managed nuclear weapons research throughout the 40’s * Wrote “science - the endless frontier” 1945 * Military consultant through 50’s 9/1/2004 5 9/1/2004 6
1 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
Memex People
Its 1945, what should the ultimate computer look Bush’s “as we may think” 1945 like? * Proposed the “Memex” a very modern computer
What should it do?
9/1/2004 7 9/1/2004 8
Bush’s Memex Post-Memex
Individuals store all personal books, records, After WWII, Bush continued to push for communications analogue computers (and against digital). Items retrieved rapidly through indexing, keywords, cross references,... Can annotate text with margin notes, comments... Which just goes to show that people with Can construct a trail through great ideas don’t get it right all the time… the material and save it Acts as an external memory
9/1/2004 9 9/1/2004 10
J.C.R. Licklider J.C.R. Licklider 1915-1990 1915-1990
Ph.D. 1942 Rochester, Psychologist At ARPA, Licklider promoted Started “Human Engineering group” at computing research and sponsored: MIT’s Lincoln labs in 1951 * Time-sharing Tried to evolve psych. into a department *Networking within MIT’s Electrical Engineering ARPA created in 1958 in response to * Engelbart’s and Sutherland’s Sputnik, “Lick” became director of CS online computing work research in 1962. With ARPA sponsorship, the first CS Why was this controversial at the time? programs were created: * MIT, CMU, Berkeley, Stanford
9/1/2004 11 9/1/2004 12
2 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
J.C.R. Licklider Man-Computer publications Symbiosis - 1960
Man-computer symbiosis – 1960 Did self-observation of his daily work. Libraries of the future – 1965 * Observed that much work was mundane and related to accessing and organizing information The computer as communication device - 1968 Proposed: * Digital libraries * Display screens with pen input and character recognition * Wall displays for collaborative work * Speech recognition and production for HCI
9/1/2004 13 9/1/2004 14
The Computer as a Networks, Time-sharing Communication Device - 1968
Cooperative work with shared and individual Much of Licklider’s sponsored research was screens unpopular in the engineering community: Pen chat “Time-sharing is a waste of valuable computer Online communities time” Agents – OLIVERs On-Line Vicarious Expediter “Why are we doing this?” and Responder * BBN engineer about the first computer network
9/1/2004 15 9/1/2004 16
Ivan Sutherland Ivan Sutherland 1938 - 1938 -
MIT Ph.D. in 1963 Sketchpad was a very modern pen-based Ph.D. work was “Sketchpad” interactive system that support CAD design and Pioneered computer graphics and CAD 3D modeling. Started Evans and Sutherland in 1968 Its novelty was its interactivity (real-time computing was practically non-existent).
9/1/2004 17 9/1/2004 18
3 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
Doug Engelbart Doug Engelbart 1925 -
Ph.D. UC Berkeley (EE) in 1955 How would you implement Bush’s Thesis on “plasma digital devices” Memex in 1963? - a way into computing Strongly influenced by Bush’s article Moved to SRI, started formulating human augmentation ideas in 1959 Funding from ARPA in 1963 NLS (oNLine System) demo 1968
9/1/2004 19 9/1/2004 20
Engelbart’s innovations Engelbart’s work
NLS (1968) featured: Continued at SRI, worked on network extensions * Video screen and keyboard Funding dwindles through the 70’s…, AI ↑ HCI ↓ * Mouse and chordal keyboard NLS project sold in 1977 to Tymshare * Videoconferencing * Half of the (~40) NLS engineers moved to Xerox PARC, others to Tymshare *Hypertext linking * Engelbart fired from SRI in ’77, moves to Tymshare * Word processing Migrated to McDonnell-Douglas in 1984, until 1989 *E-mail pushed for open hypertext systems * A window system Started Bootstrap institute in 1989 * User testing!
9/1/2004 21 9/1/2004 22
Ted Nelson Engelbart’s work 1937 - M.A. Sociology, Harvard ’63 80s and 90s: Personal computing and the web happen Coined “hypertext” in 1960 Worked with Van Dam at Engelbart Receives the ACMTuring award in 1997 Brown on HES – 1967 Designed Xanadu in 1981 “For an inspiring vision of the future of interactive computing *Global hypertext and the invention of key technologies to help realize this vision” * Pay-per-view *Not funded until 1987 Hypertext as a more natural medium than linear text for creative writing “I build paradigms. I work on complex ideas and make up words for them. It is the only way.”
9/1/2004 23 9/1/2004 24
4 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
Tim Berners-Lee/ Alan Kay Mark Andreessen 1940 - Ph.D. 1969 (Utah) Computer Graphics Berners-Lee Co-developed the HTTP/HTML standard as an open standard (1991). In 1968, met Seymour Papert (LOGO) in the MIT AI Lab. Key facilitator was an active -kids can program! user group (Physicists) who needed hypertext. Moved to Xerox PARC in 1972 Mark Andreessen added the Started developing “Smalltalk”, “Mosiac” browser which in the Learning Research Group simplified access and opened First general OO programming language up the “web” to anyone (1993). Influenced by Simula * Engineers can program!
9/1/2004 25 9/1/2004 26
Alan Kay @ PARC Alan Kay @ PARC
Dynabook (first personal computer) conceived by Dynabook (laptop computer) conceived in 1968, well Kay in 1968. ahead of its time. What should it look like? As interim steps, Kay pushes the Xerox Alto (1972) and Star, the first real personal computers.
Xerox Alto
9/1/2004 27 9/1/2004 28
Alan Kay @ PARC The Star group
The Star (1981 and begun in 1975) in particular The Star design team developed a new was a very advanced machine. It had most of the methodology for system design: “WIMP” elements we know today. Task analysis The Star was the result of Wide range of users extensive user testing, and Usage scenarios its design has stood the test of time (Liddle article). Decomposition of design: * display and control interface Many design features were *User’s conceptual model better than its successors (e.g. object-oriented editing Many prototyping cycles features) Desktop metaphor, direct manipulation, WYSIWYG
9/1/2004 29 9/1/2004 30
5 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
Star -> Mac Alan Kay after PARC
But the Star was expensive and slow ($25k). Kay worked briefly at Atari, then became an Apple Steve Jobs and Apple engineers visited PARC in fellow in 1984. Often visited the MIT Media Lab 1979, and that set the path for Apple in the 80’s and 90’s. 15 PARC engineers migrated to Apple In 1996 he left for Disney to become a Disney Apple Lisa ships in 1983 at $10,000, fellow. and fails in the marketplace Left Disney because of cutbacks, joined HP labs in 2002. The Apple Macintosh ships in 1984 at $2500, and the personal computing market changes for good
9/1/2004 31 9/1/2004 32
Alan Kay quote Small Devices
"Don't worry about what anybody else is going to The Apple Newton was the first “PDA” (1993) but do… The best way to predict the future is to didn’t succeed commercially. invent it. Really smart people with reasonable Still popular, though out funding can do just about anything that doesn't of production. violate too many of Newton's Laws!" Has achieved a kind of cult status.
9/1/2004 33 9/1/2004 34
Palm Pilot Palm Pilot
Jeff Hawkins was an EE with an interest in Next try “Zoomer” 1993 - a failure commercially cognitive science and the brain. Intensive studies of Zoomer users began in 1994. Worked at GRiD. Decided the PDA should be a Wrote Ph.D. proposal at Berkeley paper replacement, not a PC in Biophysics in 1987 - rejected. replacement. Back to GRiDPad - first pen Switched to graffiti. computer? Shrunk to pocket size. Developed a handwriting Unveiled the Palm Pilot in 1994. recognizer based on his interests in the Brain.
9/1/2004 35 9/1/2004 36
6 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
Tablet PC Smart phones
Excellent writing surface, Qualcomm’s PDQ 1999 (Jacobs) - phone pen, digital ink. with a complete Palm Pilot inside. Compromise on: Other models followed. *Keyboard Latest generation of phones *Weight support “applets”. * Battery life Motorola J2ME phones. Still trying to be a PC. Qualcomm’s BREW Many formats, will natural (binary) environment. selection choose a winner? GPS will enable location- - or is it headed the way based services. of the Newton?
9/1/2004 37 9/1/2004 38
Phono-photo-orga-loca-lizers
Butler Lampson (Time-sharing, Dynabook, Alto, Turing award) argues that when devices are “close enough” (e.g. factor of two) in size and cost, they collapse. Break
So, cell phones, PDAs, cameras, GPS’s will merge into one product.
9/1/2004 39 9/1/2004 40
Admin issues HCI principles
First assignment is due next Wednesday in class Wilfred Hansen (1971) introduced principles for If you’re ready you can hand it in at end of today. UI design: http://www.cs.berkeley.edu/~jfc/cs160/F04 - “Know the user” notes, handouts are there under “lectures” “Minimize Memorization” Class account forms will be handed out next week “Optimize Operations” Section times –9,10 am Tuesday –poll “Engineer for Errors” Lab times - poll Ombudsperson – volunteer?
9/1/2004 41 9/1/2004 42
7 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
HCI principles HCI principles
Don Norman introduced many principles from “The Psychology of Human-Computer Interaction” cognitive science: by Card, Moran and Newell, 1983 (1980s – 90s) Included mechanistic models of human behavior, Mental representation. the MHP or “Model Human Processor”. Gibson’s affordances. Direct Manipulation (WYSIWYG). Human-centered design.
9/1/2004 43 9/1/2004 44
HCI principles HCI principles
John Gould (1988) in “How to Design Usable Jacob Nielsen fostered a science of “Usability” in Systems” outlined many modern principles of UI the 1990s. design: Structured processes for evaluation and Early, continuous, focus on users development of UIs and web sites. Early and continuous user testing Pioneered “heuristic evaluation” Iterative Design and other low-cost usability Integrated Design methods. Emphasized the economic benefit of usability improvement to Suggested observation of users in their companies. workplace, “thinking aloud”, videotaping, task analysis, discovery of work context,…
9/1/2004 45 9/1/2004 46
What hasn’t happened Contextual Inquiry (yet)
Main advocates: Hugh Beyer and Karen Holtzblatt Virtual Reality: create a world in the computer Contextual Design book published in 1997 that’s like the “real world”: Microsoft “BOB”. Structured interview process and thinking aloud. Almost universal now in user interface design.
9/1/2004 47 9/1/2004 48
8 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
What hasn’t happened What hasn’t happened (yet) (yet)
VR still has potential, but it must be applied Speech interfaces haven’t “taken over” UI design. carefully. Keep in mind that: There are growing applications of speech People adapt their real-world skills quite well to interfaces (especially telephone systems). non-physical environments: navigation on the web. But speech-only is very cumbersome, you can’t Much of the detail in the physical world is scan, search visually, select or use graphics- irrelevant to the task. imagine finding an Amazon book with speech only! In the real world, we rely a great deal on text and In real life, we still prefer text and graphics to documents. communicate complex ideas. Existing 2D interfaces are optimized to the kinds Speech requires shared understanding and of information access that we need to do. “everyday” knowledge that is hard for computers.
9/1/2004 49 9/1/2004 50
What hasn’t happened What hasn’t happened (yet) (yet)
Today, most HCI researchers believe speech will Intelligent “agents” that you interact with like a be used in combination with other I/O modes person. whenever possible. There are some examples and this is still a This is the area of “Multimodal” UIs. research area, but it has been found that: Some benefits of agent interaction apply in much simpler cases: people are “influenced by” and make human-like attributions to text interfaces. Agents can “get in the way” of the user and their task – the opposite of direct manipulation. Successful agents are complex and expensive to build – no profit for the company.
9/1/2004 51 9/1/2004 52
What hasn’t happened The future? (yet)
On the other hand, agents have great potential Smart rooms, cars & homes for entertainment. Wearable computers Many successful games use agents, e.g. The Sims Multimodal and tangible UIs Toys are appearing with agent-like behavior Context-aware and “anywhere” (Sony’s Aibo). interfaces This creates powerful infrastructure for agent design, which may yield results for HCI.
9/1/2004 53 9/1/2004 54
9 CS 160, Fall ‘04 User Interface Design, Prototyping,, & Evaluation Professor Canny
Summary Summary (contd)
Many seminal ideas came from the very early The theoretical influences in HCI have not been years of computing obvious (a little cognitive science and AI, quite a Considering the user (even if its yourself) leads to lot of anthropology and social psychology). new ideas User-centered design and iteration evolved by Innovation happened in bursts, depending on trail-and-error. funding and the right environment Some appealing kinds of interaction haven’t taken A modern design process led to a very modern over (VR, speech, agents) – beware naïve models of design (the Xerox Star) human behavior.
9/1/2004 55 9/1/2004 56
10