Today's topic
Input / output devices Input / Output devices, mouse, keyboard, etc. technologies and techniques Taxonomies Evaluation Diane Lingrand Next time: [email protected] displays http://www.polytech.unice.fr/~lingrand About 3D space and more
SI3 – Master ISI : IHM02 2006/2007 1 SI3 – Master ISI : IHM02 2006/2007 2
Inputs / outputs Text entry
Input Handwritten text (keyboard, handwritten) totally free position (mouse, GPS, ...) constrained audio (speech recognition) Keyboards visual (image, video: tracking, recognition) hardware / software Output mobility (wearable computer, mobile audio (precomputed, speech synthesis) phone, PDAs, ...) visual (precomputed, synthetic image) handicap tactil (force feedback, vibration, ...) SI3 – Master ISI : IHM02 2006/2007 3 SI3 – Master ISI : IHM02 2006/2007 4 Graffiti, Calligrapher 8.3, Keyboard's layout xscribble AZERTY, QWERTY, ..., Dvorak (1936).
uni-stroke alphabet SI3 – Master ISI : IHM02 2006/2007 5 SI3 – Master ISI : IHM02 2006/2007 6
Ergonomic keyboards Logical keyboard
Mackenzie and Zhang, CHI'99
Hunter, Zhai and Smith, CHI 2000
SI3 – Master ISI : IHM02 2006/2007 7 SI3 – Master ISI : IHM02 2006/2007 8 Games Wearable computer
SI3 – Master ISI : IHM02 2006/2007 9 SI3 – Master ISI : IHM02 2006/2007 10
Mobility
2005 Twiddler WristPC
http://www.redwoodhouse.com/wearable/index.php? module=pagemaster&P AGE_user_op=view_page&PAGE_id=7&MMN_position=16:7 SI3 – Master ISI : IHM02 2006/2007 11 SI3 – Master ISI : IHM02 2006/2007 12 Chord Keyboard: Microwriter Another Chord Keyboards (1980) BAT keyboard (Infogrip)
CyKey (Bellaire Electronics)
SI3 – Master ISI : IHM02 2006/2007 13 SI3 – Master ISI : IHM02 2006/2007 14
Keyboards for PDA Mobile phone
Example: Glyph (F. Poirier, Univ. Bretagne Sud)
SI3 – Master ISI : IHM02 2006/2007 15 SI3 – Master ISI : IHM02 2006/2007 16 Glyph alphabet Motor handicap
limiting displacements logical keyboard Ex: KeyGlasses (M. Raynal, Univ. Toulouse)
SI3 – Master ISI : IHM02 2006/2007 17 SI3 – Master ISI : IHM02 2006/2007 18
Pointing devices Mouse
absolute / relative invented in 1967 by graphic tablet, touchscreen, optical pen Douglas Engelbart and co. mouse, joystick, trackball direct / indirect « any device that is capable of producing Control to Display Ratio cursor motion » ? touchscreen, optical pen graphic tablet, mouse, joystick, trackball
SI3 – Master ISI : IHM02 2006/2007 19 SI3 – Master ISI : IHM02 2006/2007 20 Evaluation of pointing task: Alternative pointing devices Fitt's law (1954)
A W where :
MT is the average time taken to complete the movement. pointing stick trackball a and b are empirical constants, and can be determined by fitting a straight line to measured data. A is the distance from the starting point to the center of the target or amplitude of movement. W is the width of the target measured along the axis of motion. W can also be thought of as the allowed error touchpad foot mouse tolerance in the final position, since the final point of the motion must fall within ± W/2 of the target's centre. touchscreen,SI3 – Master ISI : IHM02 2006/2007 camera mouse, eye mouse ...21 SI3 – Master ISI : IHM02 2006/2007 22
Accot and Zhai Steering law Joystick (1997) Extension to 2D space Axes (absolute value) Buttons (up/down) Hats (discrete value: up, right, ...) Special case of path = straight tunnel Trackballs (relative 2D value) of constant width W
SI3 – Master ISI : IHM02 2006/2007 23 SI3 – Master ISI : IHM02 2006/2007 24 Other .... Gaming
Mouth joystick « as a » joystick Joypad, ....
Jouse2 (Infogrip)
SI3 – Master ISI : IHM02 2006/2007 25 SI3 – Master ISI : IHM02 2006/2007 26
Eye - tracking Positionning
Method: GPS Image Processing Wifi Cornea reflexion RFID Magnetic system Camera tracking: eye, head, hand, Mobile (on user head) / fixed (computer) body, ... 2D / 3D (?) ...
SI3 – Master ISI : IHM02 2006/2007 27 SI3 – Master ISI : IHM02 2006/2007 28 Use your imagination ! Taxonomies
An exhaustive list is unusable GKS: logical device Locator, Stroke, Valuator, Choice, Pick, String Laval Virtuel, 2006 1974-84 :Foley Select, Position, Orient, Ink, Text, Value Gestaction 3D 1983: Buxton 1991: Card, Mackinlay and Robertson
SI3 – Master ISI : IHM02 2006/2007 29 SI3 – Master ISI : IHM02 2006/2007 30
1984: Foley 1983: Buxton's Taxonomy
SI3 – Master ISI : IHM02 2006/2007 31 SI3 – Master ISI : IHM02 2006/2007 32 Card, Mackinlay's radio MacKinlay VolumeKnob =
Limitations Ouputs
2D event (x;y) 2D event (x;y) Audio Visual screen / monitor glasses retinal Touch / Force 1D sensor 1D sensor 1D sensor 1D sensor XY equivalent ??? SI3 – Master ISI : IHM02 2006/2007 35 SI3 – Master ISI : IHM02 2006/2007 36 BCI: Brain Computer Tools and libraries Interfaces
Non-invasive / Invasive Using different input devices: Paralysed people drivers libraries: control of a robotic arm, ... VRPN : Virtual Reality Peripheral Network Blind people SDL (www.libsdl.org): Simple DirectMedia Layer camera + electrodes in the visual cortex Speech recognition Speech synthesis (TTS=text-to-speech) http://en.wikipedia.org/wiki/Speech_synthesis Handwritten recognition SI3 – Master ISI : IHM02 2006/2007 37 SI3 Gestures– Master ISI : IHM02 recognition 2006/2007 38
CHI at the Movie Theater Bibliography
Ken Hinckley « The Human-Computer Interaction Handbook: Fundamentals, 1968 2003 Evolving Technologies and Emerging Applications » , chapter 7, 2003, J.A. Jacko and A. Sears editors. J. Accot and Sh. Zhai « More than dotting the i's Foundations for crossing-based interfaces » CHI 2002 2001 2002 Bill Buxton: http://www.billbuxton.com
SI3 – Master ISI : IHM02 2006/2007 39 SI3 – Master ISI : IHM02 2006/2007 40