Edgewrite with a PDA Stylus Edgewrite with a Desktop Trackball

Total Page:16

File Type:pdf, Size:1020Kb

Edgewrite with a PDA Stylus Edgewrite with a Desktop Trackball EEddggeeWWrriittee:: AA VVeerrssaattiillee DDeessiiggnn ffoorr AAcccceessssiibbllee TTeexxtt EEnnttrryy Jacob O. Wobbrock & Brad A. Myers, Human-Computer Interaction Institute, Carnegie Mellon University www.edgewrite.com Overview EdgeWrite with a PDA Stylus EdgeWrite with a Desktop Trackball EdgeWrite on a Mobile Phone EdgeWrite is a versatile design for Makes PDA text entry more Provides a gestural Provides a gestural means of accessible text entry. It provides stability to accessible to people with alternative for trackball mobile phone text entry for users with motor impairments or under motor impairments. users resigned to on- able-bodied users "on the screen keyboards. go," e.g., while walking. May situational impairments caused by using Characters are made by be less dependent on visual mobile devices "on the go." EdgeWrite moving the stylus along the Trackball EdgeWrite is less attention than Multitap methods are gestural and can be done by edges and into the corners of visually intense and less and/or T9. feel. EdgeWrite characters mimic Roman the EdgeWrite square. This tedious than an on-screen letters, improving guessability and provides stability to people keyboard. Two mobile phone versions: learnability. EdgeWrite is available on with tremor or experiencing various devices for both handheld and vibration. Instead of physical Isometric joystick on the edges, Trackball Edge- front or back of the phone. desktop text entry. Write relies on "pulsing" the ball at angles which Touch-sensitive buttons Thesis indicate desired corners. where the 1, 2, 4 and 5 keys Graffiti "d", misrecognized EdgeWrite "d", recognized A versatile design for accessible text entry Results This is a crossing task. serve as the EdgeWrite corners. based on movement along edges and into Able-bodied novices were 18% Results more accurate than Graffiti after corners can outperform predominant text Able-bodied users wrote at ~10 wpm and ~4% total errors 15 minutes of practice (1.21 vs. entry methods on a variety of desktop and after 45 minutes of practice. They were not trackball users. 1.43 kspc, p<.05). There was no Evaluation handheld computing devices when subject Average Error Rates significant difference in speed Average Speed The mobile phone versions will be evaluated in a study of to motor or situational impairments. 15 (6.6 vs. 7.2 wpm, n.s.). text entry while walking. Able-bodied users will 10 12.75 experience vibrational tremor and divided *Lower kspc is better (i.e. more accurate). M 9.96 10.00 P W visual attention while walking. EdgeWrite will 5 6.75 Alphabet be compared to Multitap and/or T9. Users with motor impairments were 200-400% more All EdgeWrite versions use the same 0 alphabet. Characters are defined by the accurate with EdgeWrite than with Graffiti in writing "a-z" Subject and "0-9" 2 times for a total of 72 characters per user. order in which they hit corners within the Sessions with a 15-year trackball user showed he was faster EdgeWrite square. Example (Cerebral Palsy): "The dog is going fast" (5.0 vs. 4.3 wpm, p<.05) and left fewer errors on average Graffiti: "The g i gbsiangu% fast" (8 errors) (1.35% vs. 2.35%, n.s.) with Trackball EdgeWrite than with his letters punctuation set unset EdgeWrite: "The dog is going fast" (0 errors) preferred on-screen keyboard. He now uses EdgeWrite. a b c ç d e f g . , ' " : ; ? ! Average Jim's Average Speeds Jim's Average Uncorrected Errors Parkinson's MD 7 6 h i I j k l m n / \ | ` ~ @ # $ 98.3% 6 On-screen 94.4% Ew 98.7% Ew 5 On-screen 5 Keyboard 75.9% 4 Keyboard t o p q r s t u v % ^ & * - _ + = n M 4 30.6% Graffiti 33.0% Graffiti e Trackball P c 3 Trackball r W e 3 EdgeWrite EdgeWrite P 2 w x y z capitalization ( ) [ ] < > { } 2 Spastic CP CP 1 1 0 0 100.0% Ew 100.0% Ew 1 3 4 10 12 14 15 1 3 4 10 12 14 15 84.0% Graffiti 96.0% Graffiti Graffiti Ew Week Number Week Number numbers and accents extended set unset 1 2 3 4 5 6 7 8 · ° ‘ ’ “ ” ® § Other EdgeWrite Versions 9 0 ™ © ¢ × ÷ € ¥ Edges Size Position Sensing £ µ ß ¤ ‹‹ ›› ² ³ Physical Virtual None Tiny Small Medium Absolute Relative Continuous Discrete Accents are made immediately after the letters PDA Stylus Touch buttons? PDA Stylus StampPad Touchpad PDA Stylus PDA Stylus Touch buttons? they modify. Not all letters can be accented. ^ Touchpad Wrist watch Touchpad Touchpad ` ` ^ ~ .. ° ¸ ¿ ¡ – — ± ‰ Lift StampPad Touch buttons? StampPad StampPad Wrist Watch Wrist watch Wrist watch Wrist watch Game Joystick Touch buttons? Thumbstick Thumbstick Wheelchair Thumbstick Thumbstick Wheelchair Wheelchair Wheelchair whitespace extended Snap-to- set unset n o space backspace enter tab i Center t a t n e Touch buttons Touch buttons Touch buttons Touch buttons menu shortcut f f g g ð æ ƒ œ ø m Four Keys Four keys Four keys Four keys Four keys Touchpad g e Adaptive S Timeout h h i These extended characters can be capitalized in the usual manner. f g Ð Æ F Œ Ø Trackball Wand? Isometric joy Trackball Wand? Trackball Trackball i |f word word g| Isometric joy Wand? Isometric joy Isometric joy Movement Wand? StampPad Ceases EdgeWrite Alphabet, version 2.1.5 (C) 2005 Human-Computer Interaction Institute, Carnegie Mellon University Power Wheelchair Joystick.
Recommended publications
  • UC Berkeley UC Berkeley Electronic Theses and Dissertations
    UC Berkeley UC Berkeley Electronic Theses and Dissertations Title Perceptual and Context Aware Interfaces on Mobile Devices Permalink https://escholarship.org/uc/item/7tg54232 Author Wang, Jingtao Publication Date 2010 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California Perceptual and Context Aware Interfaces on Mobile Devices by Jingtao Wang A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor John F. Canny, Chair Professor Maneesh Agrawala Professor Ray R. Larson Spring 2010 Perceptual and Context Aware Interfaces on Mobile Devices Copyright 2010 by Jingtao Wang 1 Abstract Perceptual and Context Aware Interfaces on Mobile Devices by Jingtao Wang Doctor of Philosophy in Computer Science University of California, Berkeley Professor John F. Canny, Chair With an estimated 4.6 billion units in use, mobile phones have already become the most popular computing device in human history. Their portability and communication capabil- ities may revolutionize how people do their daily work and interact with other people in ways PCs have done during the past 30 years. Despite decades of experiences in creating modern WIMP (windows, icons, mouse, pointer) interfaces, our knowledge in building ef- fective mobile interfaces is still limited, especially for emerging interaction modalities that are only available on mobile devices. This dissertation explores how emerging sensors on a mobile phone, such as the built-in camera, the microphone, the touch sensor and the GPS module can be leveraged to make everyday interactions easier and more efficient.
    [Show full text]
  • Motion and Context Sensing Techniques for Pen Computing
    Motion and Context Sensing Techniques for Pen Computing Ken Hinckley1, Xiang ‘Anthony’ Chen1,2, and Hrvoje Benko1 * Microsoft Research, Redmond, WA, USA1 and Carnegie Mellon University Dept. of Computer Science2 ABSTRACT We explore techniques for a slender and untethered stylus prototype enhanced with a full suite of inertial sensors (three-axis accelerometer, gyroscope, and magnetometer). We present a taxonomy of enhanced stylus input techniques and consider a number of novel possibilities that combine motion sensors with pen stroke and touchscreen inputs on a pen + touch slate. These Fig. 1 Our wireless prototype has accelerometer, gyro, and inertial sensors enable motion-gesture inputs, as well sensing the magnetometer sensors in a ~19 cm Χ 11.5 mm diameter stylus. context of how the user is holding or using the stylus, even when Our system employs a custom pen augmented with inertial the pen is not in contact with the tablet screen. Our initial results sensors (accelerometer, gyro, and magnetometer, each a 3-axis suggest that sensor-enhanced stylus input offers a potentially rich sensor, for nine total sensing dimensions) as well as a low-power modality to augment interaction with slate computers. radio. Our stylus prototype also thus supports fully untethered Keywords: Stylus, motion sensing, sensors, pen+touch, pen input operation in a slender profile with no protrusions (Fig. 1). This allows us to explore numerous interactive possibilities that were Index Terms: H.5.2 Information Interfaces & Presentation: Input cumbersome in previous systems: our prototype supports direct input on tablet displays, allows pen tilting and other motions far 1 INTRODUCTION from the digitizer, and uses a thin, light, and wireless stylus.
    [Show full text]
  • User Guide Blackberry 8800 Smartphone SWD-280419-0222085634-001 Contents
    User Guide BlackBerry 8800 Smartphone SWD-280419-0222085634-001 Contents BlackBerry basics..................................................................................................................................................................................................................................9 Switch applications..........................................................................................................................................................................................................................................9 Assign an application to a Convenience key................................................................................................................................................................................................9 Set owner information......................................................................................................................................................................................................................................9 Turn on standby mode......................................................................................................................................................................................................................................9 About links.........................................................................................................................................................................................................................................................9
    [Show full text]
  • 2019 Streamlight® Tactical Catalog
    CELEBRATING 45 YEARS SOLVING LIGHTING PROBLEMS. INTRODUCING NEW PRODUCTS. ® 90 IT’S WHAT WE DO. PROTAC Since 1973, Streamlight has delivered effective, efficient high-performance lighting solutions. The latest technology delivers unmatched performance, unheard of durability and incredible value. We’ve earned our reputation one customer at a time. And we’re not about to let up now. SIEGE ® X USB 2 GET MORE INFO AT: STREAMLIGHT.COM / 800-523 –7488 / 610-631-0600 TLR-8 ® G RAIL-MOUNTED LIGHT TLR-6 ® NON-LASER TLR-6 ® FOR SIG SAUER P365 PROTAC ® RAIL MOUNT HL-X LASER BANDIT ® PRO USB HEADLAMP TLR-VIR ® II SPECIALTY PRODUCT TL-RACKER ™ FOREND LIGHT 3 STREAMLIGHT TLRs THE WIDEST RANGE OF WEAPON-MOUNTED LIGHTS Streamlight produces a full line of weapon-mounted lights with the features that law enforcement, conceal & carry, and sportsmen need: high-lumen, laser, and IR. Models to fit long guns and full-size and compact pistols. LIGHT ONLY LIGHT ONLY COMPACT & FULL FRAME PISTOLS UNIVERSAL RAIL-MOUNT MODELS TLR-7® TLR-1 HL® TLR-1® TLR-3® WHITE LIGHT ILLUMINATOR WHITE LIGHT ILLUMINATOR TLR-1®s WHITE LIGHT ILLUMINATOR WHITE LIGHT ILLUMINATOR NEW SUB-COMPACT & COMPACT PISTOLS TRIGGER GUARD & TLR-6® NON-LASER TLR-7® TLR-3® RAIL-MOUNT MODELS WHITE LIGHT ILLUMINATOR WHITE LIGHT ILLUMINATOR WHITE LIGHT ILLUMINATOR NEW LONG GUN / AR SHOTGUN FOREND & RAIL-MOUNT MODELS TLR-1 HL® PROTAC® RAIL MOUNT 1 PROTAC® T L R -1 HP L® TL-RACKER™ (Long Gun Kit) PROTAC® RAIL MOUNT 2 RAIL MOUNT HL-X (Long Gun Kit) WHITE LIGHT ILLUMINATOR/FOREND WHITE LIGHT ILLUMINATOR WHITE
    [Show full text]
  • KSPC (Keystrokes Per Character) As a Characteristic of Text Entry Techniques
    KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques I. Scott MacKenzie Dept. of Computer Science York University Toronto, Ontario, Canada M3J 1P3 +1 416 736 2100 WQEGOIR^MI$EGQSVK Abstract. KSPC is the number of keystrokes, on average, to generate each character of text in a given language using a given text entry technique. We systematically describe the calculation of KSPC and provide examples across a variety of text entry techniques. Values for English range from about 10 for methods using only cursor keys and a SELECT key to about 0.5 for word prediction techniques. It is demonstrated that KSPC is useful for a priori analyses, thereby supporting the characterisation and comparison of text entry methods before labour-intensive implementations and evaluations. 1 Introduction An important research area in mobile computing is the development of efficient means of text entry. Interest is fueled by trends such as text messaging on mobile phones, two-way paging, and mobile web and email access. Coincident with this is the continued call in HCI for methods and models to make systems design tractable at the design and analysis stage [5]. This paper addresses these two themes. We propose a measure to characterise text entry techniques. It is calculated a priori, using a language model and a keystroke-level description of the technique. The measure is used to characterise and compare methods at the design stage, thus facilitating analyses prior to labour-intensive implementations and evaluations. 2 Keystrokes per Character (KSPC) KSPC is an acronym for keystrokes per character. It is the number of keystrokes required, on average, to generate a character of text for a given text entry technique in a given language.
    [Show full text]
  • Off-The-Shelf Stylus: Using XR Devices for Handwriting and Sketching on Physically Aligned Virtual Surfaces
    TECHNOLOGY AND CODE published: 04 June 2021 doi: 10.3389/frvir.2021.684498 Off-The-Shelf Stylus: Using XR Devices for Handwriting and Sketching on Physically Aligned Virtual Surfaces Florian Kern*, Peter Kullmann, Elisabeth Ganal, Kristof Korwisi, René Stingl, Florian Niebling and Marc Erich Latoschik Human-Computer Interaction (HCI) Group, Informatik, University of Würzburg, Würzburg, Germany This article introduces the Off-The-Shelf Stylus (OTSS), a framework for 2D interaction (in 3D) as well as for handwriting and sketching with digital pen, ink, and paper on physically aligned virtual surfaces in Virtual, Augmented, and Mixed Reality (VR, AR, MR: XR for short). OTSS supports self-made XR styluses based on consumer-grade six-degrees-of-freedom XR controllers and commercially available styluses. The framework provides separate modules for three basic but vital features: 1) The stylus module provides stylus construction and calibration features. 2) The surface module provides surface calibration and visual feedback features for virtual-physical 2D surface alignment using our so-called 3ViSuAl procedure, and Edited by: surface interaction features. 3) The evaluation suite provides a comprehensive test bed Daniel Zielasko, combining technical measurements for precision, accuracy, and latency with extensive University of Trier, Germany usability evaluations including handwriting and sketching tasks based on established Reviewed by: visuomotor, graphomotor, and handwriting research. The framework’s development is Wolfgang Stuerzlinger, Simon Fraser University, Canada accompanied by an extensive open source reference implementation targeting the Unity Thammathip Piumsomboon, game engine using an Oculus Rift S headset and Oculus Touch controllers. The University of Canterbury, New Zealand development compares three low-cost and low-tech options to equip controllers with a *Correspondence: tip and includes a web browser-based surface providing support for interacting, Florian Kern fl[email protected] handwriting, and sketching.
    [Show full text]
  • Chapter 9. Input Devices
    Table of contents 9 Input devices .................................................................................................................9-1 9.1 Keyboards ............................................................................................................. 9-4 9.2 Fixed-function keys .............................................................................................. 9-6 9.3 Pointing devices.................................................................................................... 9-7 9.3.1 General........................................................................................................... 9-7 9.3.2 Mouse ............................................................................................................ 9-9 9.3.3 Joystick and trackball .................................................................................. 9-10 9.3.3.1 General..................................................................................................9-10 9.3.3.2 Hand-operated displacement joysticks .................................................9-10 9.3.3.3 Finger-operated displacement joysticks................................................9-11 9.3.3.4 Thumb tip and fingertip-operated displacement joysticks....................9-13 9.3.3.5 Hand-operated isometric joysticks........................................................9-13 9.3.3.6 Thumb tip and fingertip-operated isometric joysticks..........................9-14 9.3.3.7 Ball controls..........................................................................................9-14
    [Show full text]
  • Virtual Reality Controllers
    Evaluation of Low Cost Controllers for Mobile Based Virtual Reality Headsets By Summer Lindsey Bachelor of Arts Psychology Florida Institute of Technology May 2015 A thesis Submitted to the College of Aeronautics at Florida Institute of Technology in partial fulfillment of the requirements for the degree of Master of Science In Aviation Human Factors Melbourne, Florida April 2017 © Copyright 2017 Summer Lindsey All Rights Reserved The author grants permission to make single copies. _________________________________ The undersigned committee, having examined the attached thesis " Evaluation of Low Cost Controllers for Mobile Based Virtual Reality Headsets," by Summer Lindsey hereby indicates its unanimous approval. _________________________________ Deborah Carstens, Ph.D. Professor and Graduate Program Chair College of Aeronautics Major Advisor _________________________________ Meredith Carroll, Ph.D. Associate Professor College of Aeronautics Committee Member _________________________________ Neil Ganey, Ph.D. Human Factors Engineer Northrop Grumman Committee Member _________________________________ Christian Sonnenberg, Ph.D. Assistant Professor and Assistant Dean College of Business Committee Member _________________________________ Korhan Oyman, Ph.D. Dean and Professor College of Aeronautics Abstract Title: Evaluation of Low Cost Controllers for Mobile Based Virtual Reality Headsets Author: Summer Lindsey Major Advisor: Dr. Deborah Carstens Virtual Reality (VR) is no longer just for training purposes. The consumer VR market has become a large part of the VR world and is growing at a rapid pace. In spite of this growth, there is no standard controller for VR. This study evaluated three different controllers: a gamepad, the Leap Motion, and a touchpad as means of interacting with a virtual environment (VE). There were 23 participants that performed a matching task while wearing a Samsung Gear VR mobile based VR headset.
    [Show full text]
  • Displaying Images on the SMART Sympodium
    Displaying Images on the SMART Sympodium Anything you can display on your computer monitor will be projected onto the SMART Sympodium when you are connected to the system. For example, you could display: Word Documents Images Pages on the Internet PowerPoint Presentations Statistical or Design Programs Touching the SMART Sympodium screen with the pen stylus is equivalent to clicking on your computer screen using your mouse. Tap once on the Sympodium for a single mouse click; tap twice on the Sympodium for a double click. Drawing on the Sympodium Screen Use the stylus attached to the SMART Sympodium to draw on the screen. Do not write on the SMART Sympodium screen with dry-erase markers or pens. Note that the stylus pen color is changeable. It will write in the color you select by pen color selection buttons located at the top of the Sympodium screen. Also note that the pen and mouse are interchangeable. However if you lay the pen on the screen,the mouse will not function properly. Always rest the pen near the inside bottom of the screen when not in use. Note the buttons at the bottom of the Sympodium panel. These are shortcuts to some of the Sympodium tools. By default, the Floating Tools are not active. To activate them, click on the Start Menu and then "SMART Board Tools". The toolbar will fade in on the left side of the screen. To customize the appearance of your tools: Click on the "Gear" icon at the bottom of the Floating Toolbar. Drag the desired tool onto the bar; likewise, drag the undesired tool away.
    [Show full text]
  • LNCS 4551, Pp
    Stylus Enhancement to Enrich Interaction with Computers Yu Suzuki, Kazuo Misue, and Jiro Tanaka Department of Computer Science, University of Tsukuba 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, Japan {suzuki,misue,jiro}@iplab.cs.tsukuba.ac.jp Abstract. We introduce a technique to enrich user interaction with a computer through a stylus. This technique allows a stylus to be manipulated in the air to operate applications in new ways. To translate the stylus manipulation into application behavior, we take an approach that we attach an accelerometer to the stylus. Such a stylus allows control through new operations like rolling and shaking, as well as through conventional operations like tapping or making strokes. An application can use these operations to switch modes or change parameters. We have implemented a number of applications, called the “Oh! Stylus Series,” that can be used with our proposed technique. Keywords: Stylus Enhancement, Interaction, Accelerometer, Behavior. 1 Introduction Computer operations based on a stylus, compared to those with a mouse, have the advantage of being direct and easy to understand. In terms of the interaction style, though, most stylus operations simply replace mouse operations, so these operations do not take advantage of all the ways a pen-shaped device can be handled. Potential interface techniques have not been realized because computers cannot detect stylus positions and movements when a conventional stylus is not touching the display. Our goal is to make pen-based applications more useful by enabling a computer to detect such manipulations of a stylus and use them to govern applications run on the computer.
    [Show full text]
  • Video Game Systems Uncovered
    Everything You Ever Wanted To Know About... VIDEO GAMES But Never Dared To Ask! Introduction: 1 With the holidays quickly approaching the odds are you will be purchasing some type of video game system. The majority of U.S. households currently have at least one of these systems. With the ever changing technology in the video world it is hard to keep up with the newest systems. There is basically a system designed for every child’s needs, ranging from preschool to young adult. This can overwhelming for parents to choose a system that not only meets your child’s needs but also gives us the best quality system for our money. With the holidays coming that means many retailers will be offering specials on video game systems and of course the release of long awaited games. Now is also the time you can purchase systems in bundles with games included. Inside you will learn about all of these topics as well as other necessities and games to accompany to recent purchase. What you’ll find here: 2 In this ebook you will learn about console and portable video game systems, along with the accessories available. You will also find how many games each system has to offer. You will get an in depth look at the pro’s and con’s of each current system available in stores today, and the upcoming systems available in the near future. As a concerned parent you should also be aware of the rating label of the games and what the rating exactly means.
    [Show full text]
  • Neonatal Intubation Simulation with Virtual Reality and Haptic Feedback
    Neonatal Intubation Simulation with Virtual Reality and Haptic Feedback BME 400 University of Wisconsin Madison Department of Biomedical Engineering October 10th, 2018 Team Members: Team Leader: Carter Griest ​ Communicator: Isaac Hale ​ BSAC: Sara Martin ​ BPAG: Jessi Kelley ​ BWIG: Joey Campagna ​ Advisor: Beth Meyerand (Medical Imaging) ​ Clients: Dr. Ryan McAdams and Dr. Brandon Tomlin ​ Abstract Respiratory distress syndrome (RDS), a neonatal disease characterized by difficulty breathing, is remarkably common among premature infants, affecting up to 60% of the population. Patient outcomes resulting from RDS are undesirably poor. Neonatal intubation, the primary treatment for RDS, is an extremely difficult procedure to perform. Unsatisfactory patient outcomes are in part due to ineffective training methods, which include video instruction and intubation performed on mannequins. A more realistic training method that better replicates the procedure’s technical challenges and stressful nature would enhance physician competency, resulting in improved clinical outcomes. Virtual reality (VR) is an innovative tool becoming increasingly used in the medical field, particularly for simulations. VR provides a means by which individuals can be visually and acoustically immersed in a non-physical, yet responsive, environment. Via the incorporation of haptic feedback devices, virtual simulations can include somatosensory feedback, greatly increasing simulation realism. Cutting edge medical VR simulations with haptic feedback already exist and represent the future of medical training. Integration of a well-designed virtual environment with haptic devices that imitate a neonatal intubation procedure would provide a more effective means of training. Currently, the simulation includes a prototype operating room, and beginnings of a 3D replication of a neonate and upper respiratory anatomy.
    [Show full text]