Today's topic Input / output devices Input / Output devices, mouse, keyboard, etc. technologies and techniques Taxonomies Evaluation Diane Lingrand Next time: [email protected] displays http://www.polytech.unice.fr/~lingrand About 3D space and more SI3 – Master ISI : IHM02 2006/2007 1 SI3 – Master ISI : IHM02 2006/2007 2 Inputs / outputs Text entry Input Handwritten text (keyboard, handwritten) totally free position (mouse, GPS, ...) constrained audio (speech recognition) Keyboards visual (image, video: tracking, recognition) hardware / software Output mobility (wearable computer, mobile audio (precomputed, speech synthesis) phone, PDAs, ...) visual (precomputed, synthetic image) handicap tactil (force feedback, vibration, ...) SI3 – Master ISI : IHM02 2006/2007 3 SI3 – Master ISI : IHM02 2006/2007 4 Graffiti, Calligrapher 8.3, Keyboard's layout xscribble AZERTY, QWERTY, ..., Dvorak (1936). uni-stroke alphabet SI3 – Master ISI : IHM02 2006/2007 5 SI3 – Master ISI : IHM02 2006/2007 6 Ergonomic keyboards Logical keyboard Mackenzie and Zhang, CHI'99 Hunter, Zhai and Smith, CHI 2000 SI3 – Master ISI : IHM02 2006/2007 7 SI3 – Master ISI : IHM02 2006/2007 8 Games Wearable computer SI3 – Master ISI : IHM02 2006/2007 9 SI3 – Master ISI : IHM02 2006/2007 10 Mobility 2005 Twiddler WristPC http://www.redwoodhouse.com/wearable/index.php? module=pagemaster&P AGE_user_op=view_page&PAGE_id=7&MMN_position=16:7 SI3 – Master ISI : IHM02 2006/2007 11 SI3 – Master ISI : IHM02 2006/2007 12 Chord Keyboard: Microwriter Another Chord Keyboards (1980) BAT keyboard (Infogrip) CyKey (Bellaire Electronics) SI3 – Master ISI : IHM02 2006/2007 13 SI3 – Master ISI : IHM02 2006/2007 14 Keyboards for PDA Mobile phone Example: Glyph (F. Poirier, Univ. Bretagne Sud) SI3 – Master ISI : IHM02 2006/2007 15 SI3 – Master ISI : IHM02 2006/2007 16 Glyph alphabet Motor handicap limiting displacements logical keyboard Ex: KeyGlasses (M. Raynal, Univ. Toulouse) SI3 – Master ISI : IHM02 2006/2007 17 SI3 – Master ISI : IHM02 2006/2007 18 Pointing devices Mouse absolute / relative invented in 1967 by graphic tablet, touchscreen, optical pen Douglas Engelbart and co. mouse, joystick, trackball direct / indirect « any device that is capable of producing Control to Display Ratio cursor motion » ? touchscreen, optical pen graphic tablet, mouse, joystick, trackball SI3 – Master ISI : IHM02 2006/2007 19 SI3 – Master ISI : IHM02 2006/2007 20 Evaluation of pointing task: Alternative pointing devices Fitt's law (1954) A W where : MT is the average time taken to complete the movement. pointing stick trackball a and b are empirical constants, and can be determined by fitting a straight line to measured data. A is the distance from the starting point to the center of the target or amplitude of movement. W is the width of the target measured along the axis of motion. W can also be thought of as the allowed error touchpad foot mouse tolerance in the final position, since the final point of the motion must fall within ± W/2 of the target's centre. touchscreen,SI3 – Master ISI : IHM02 2006/2007 camera mouse, eye mouse ...21 SI3 – Master ISI : IHM02 2006/2007 22 Accot and Zhai Steering law Joystick (1997) Extension to 2D space Axes (absolute value) Buttons (up/down) Hats (discrete value: up, right, ...) Special case of path = straight tunnel Trackballs (relative 2D value) of constant width W SI3 – Master ISI : IHM02 2006/2007 23 SI3 – Master ISI : IHM02 2006/2007 24 Other .... Gaming Mouth joystick « as a » joystick Joypad, .... Jouse2 (Infogrip) SI3 – Master ISI : IHM02 2006/2007 25 SI3 – Master ISI : IHM02 2006/2007 26 Eye - tracking Positionning Method: GPS Image Processing Wifi Cornea reflexion RFID Magnetic system Camera tracking: eye, head, hand, Mobile (on user head) / fixed (computer) body, ... 2D / 3D (?) ... SI3 – Master ISI : IHM02 2006/2007 27 SI3 – Master ISI : IHM02 2006/2007 28 Use your imagination ! Taxonomies An exhaustive list is unusable GKS: logical device Locator, Stroke, Valuator, Choice, Pick, String Laval Virtuel, 2006 1974-84 :Foley Select, Position, Orient, Ink, Text, Value Gestaction 3D 1983: Buxton 1991: Card, Mackinlay and Robertson SI3 – Master ISI : IHM02 2006/2007 29 SI3 – Master ISI : IHM02 2006/2007 30 1984: Foley 1983: Buxton's Taxonomy SI3 – Master ISI : IHM02 2006/2007 31 SI3 – Master ISI : IHM02 2006/2007 32 Card, Mackinlay's radio MacKinlay VolumeKnob = <R , [0 o, 270 o], , I, [0 o, 270 o], {}> and z = R : [0 o, 270 o] [0o, 270 o] Robertson z (1997) Volume = < InputDomain: [0, 25] decibels> Connection composition: Connect (VolumeKnob, Volume, f( deg) = C * decibels) v VolumeKnob Volume Layout composition: VolumeKnobT1(x) SelectionKnobT2(x) StationKnobT3(x) Merge composition: GenericTablet = Generic1DTablet X Generic1DTablet SI3 – Master ISI : IHM02 2006/2007 33 SI3 – Master ISI : IHM02xy 2006/2007 x y 34 Limitations Ouputs 2D event (x;y) 2D event (x;y) Audio Visual screen / monitor glasses retinal Touch / Force 1D sensor 1D sensor 1D sensor 1D sensor XY equivalent ??? SI3 – Master ISI : IHM02 2006/2007 35 SI3 – Master ISI : IHM02 2006/2007 36 BCI: Brain Computer Tools and libraries Interfaces Non-invasive / Invasive Using different input devices: Paralysed people drivers libraries: control of a robotic arm, ... VRPN : Virtual Reality Peripheral Network Blind people SDL (www.libsdl.org): Simple DirectMedia Layer camera + electrodes in the visual cortex Speech recognition Speech synthesis (TTS=text-to-speech) http://en.wikipedia.org/wiki/Speech_synthesis Handwritten recognition SI3 – Master ISI : IHM02 2006/2007 37 SI3 Gestures– Master ISI : IHM02 recognition 2006/2007 38 CHI at the Movie Theater Bibliography Ken Hinckley « The Human-Computer Interaction Handbook: Fundamentals, 1968 2003 Evolving Technologies and Emerging Applications » , chapter 7, 2003, J.A. Jacko and A. Sears editors. J. Accot and Sh. Zhai « More than dotting the i's Foundations for crossing-based interfaces » CHI 2002 2001 2002 Bill Buxton: http://www.billbuxton.com SI3 – Master ISI : IHM02 2006/2007 39 SI3 – Master ISI : IHM02 2006/2007 40.