Designing for Numerical Transcription Typing: Frequent Numbers Matter

Total Page:16

File Type:pdf, Size:1020Kb

Designing for Numerical Transcription Typing: Frequent Numbers Matter Designing for Numerical Transcription Typing: Frequent Numbers Matter CANDIDATE Sarah EM Wiseman A dissertation submitted in partial fulfilment of the requirements for the degree of: Doctor of Philosophy of University College London UCL Interaction Centre, Department of Psychology and Language Sciences, University College London DECLARATION I, Sarah Wiseman, confirm that the work presented in this thesis is my own. Where infor- mation has been derived from other sources, I confirm that this has been indicated in the thesis. Abstract In the text entry domain, the task of number entry is often overlooked despite the prevalence of number entry tasks in the real world. Number entry often occurs in safety critical contexts, such as the medical domain, where errors can lead to patient death. In order to prevent errors from happening, it is important to design devices that help the user in their number entry task, and guard against error. To do this effectively, more needs to be known about the task of number transcription so that appropriate design interventions can be created. Current research commonly uses randomly generated numbers in the evaluation of number entry interfaces. However, it is not clear that random numbers are appropriate in this context. The first half of the thesis builds on research that shows that the familiarity of a number can affect how it is read, and investigates how this finding impacts upon transcription of familiar numbers. This is investigated by replicating seminal transcription typing studies using both words and numbers. The results of these experiments suggest that familiar numbers are represented more strongly than non-familiar numbers in memory, and as a result familiar numbers are significantly faster to transcribe. This novel finding then motivates a series of studies that aim to reduce errors in a medical number entry task. First, a log analysis of hospital devices shows that there are clear patterns in the numbers used, providing evidence that medical workers are likely to be more familiar with some numbers rather than others. The knowledge of these frequently used numbers is then utilised in three novel approaches to number entry interface design. First, knowledge of the landscape of frequent numbers in this context is used to create a set of heuristics for the design of number entry interfaces. Second, an experiment shows that adapting the interface specifically for frequent number entry can speed up interaction. Finally an experiment explores how an understanding of the numbers used to program devices can be used to check for and prevent number transcription errors. This thesis highlights the importance of understanding the frequency and familiarity of num- bers used in specific contexts. It explores how this knowledge can improve both evaluation and design of number entry interfaces. Acknowledgements During my PhD I have been surrounded by people who have made the experience not only bearable but enjoyable. I would like to thank a small set of those people here. Unfortunately, there is no space to thank all of my friends who have been there for me when I needed them, but their support has been invaluable. I must thank my PhD supervisors Anna Cox and Duncan Brumby. As a supervisory team they are perfectly balanced and have encouraged me to think big, but still get things done (eventually). Their guidance, at all hours of the day, has helped me produce a piece of work I can feel proud of. Being a part of UCLIC has been an incredibly rewarding experience. I feel very lucky to be able to work in a place where I can call so many people friends. Discussions with many of my colleagues, both in and out of the office, have helped shape this thesis. I would especially like to thank Sandy for chatting throughout the years, and for sharing with me his newly acquired knowledge of the PhD submission process. I was also able to be part of the CHI+MED team. I am thankful to everyone on the team for their useful discussions on my work, and for continuing to be an inspiration by working to make medical devices safer. I would like to thank Anna BD for not only being a proof-reader, but a cheer leader too; both were equally necessary jobs. And thanks too, to Mum for reading the entire thesis and significantly reducing the number of typos and grammar errors. I would finally like to thank my parents and sister for being incredibly supportive of me throughout my academic career. They have always encouraged me in my various pursuits and have inspired me to work hard to achieve my goals. It is thanks to them that I have had the great privilege to be able to do something I love for the last 4 years. 1 Contents 1 Introduction 11 1.1 Motivation . 11 1.2 Thesis Structure . 14 1.3 Contributions . 16 1.3.1 Contribution to Theory . 16 1.3.2 Contribution to Methodology . 17 1.3.3 Contribution to Design . 17 1.4 Summary . 18 2 Motivation 19 2.1 Introduction . 19 2.2 Terminology . 21 2.3 Reading numbers and words . 22 2.3.1 Studies with aphasic patients . 23 2.3.2 Models of number reading . 24 2.3.3 Models of word reading . 26 2.3.4 Summary . 27 2.4 Text Transcription . 28 2.4.1 Number Transcription . 28 2.4.2 Alphabetic Text Transcription . 29 2.4.3 The process of transcription typing . 30 2.4.4 Summary . 36 2.5 Modelling Transcription . 37 2.5.1 TYPIST Model of transcription typing . 37 2.5.2 Queuing Network Model of transcription typing . 39 2.5.3 A model of numerical transcription typing . 40 2.5.4 Summary . 41 2.6 Current Text and Number Entry Research . 42 3 2.6.1 Text Entry . 42 2.6.2 Number Entry . 43 2.6.3 Summary . 46 2.7 Motivation for future work . 47 3 What Is A Familiar Number? 49 3.1 Introduction . 49 3.2 Defining familiar numbers . 50 3.3 Study 1: Gathering a set of familiar numbers . 53 3.3.1 Method . 54 3.3.2 Results . 56 3.3.3 Discussion . 57 3.3.4 Limitations . 59 3.3.5 Conclusion . 60 3.4 Study 2: What makes a number familiar? . 61 3.4.1 Method . 61 3.4.2 Results . 63 3.4.3 Discussion . 64 3.4.4 Limitations . 64 3.4.5 Conclusion . 65 3.5 Summary . 65 4 Applying Transcription Metrics to Numerical Typing 67 4.1 Introduction . 67 4.2 Typing metrics . 68 4.2.1 Eye-Hand Span . 71 4.2.2 Replacement Span . 72 4.2.3 Copy Span . 73 4.2.4 Interkey Interval . 74 4.2.5 Error Rate . 75 4.3 Investigating the phenomena . 75 4.4 Study 3: Eye-Hand Span . 77 4.4.1 Overview . 77 4.4.2 Method . 77 4.4.3 Results . 81 4.4.4 Discussion . 83 4.4.5 Conclusion . 85 4.5 Study 4: Eye-Hand Span Replication . 86 4 4.5.1 Method . 86 4.5.2 Results . 87 4.5.3 Discussion . 89 4.5.4 Limitations . 91 4.5.5 Conclusion . 92 4.6 Study 5: Replacement Span . 93 4.6.1 Overview . 93 4.6.2 Method . 93 4.6.3 Results . 96 4.6.4 Discussion . 99 4.6.5 Limitations . 101 4.6.6 Conclusion . 102 4.7 Study 6: Copy Span . 103 4.7.1 Overview . 103 4.7.2 Method . 103 4.7.3 Results . 106 4.7.4 Discussion . 109 4.7.5 Limitations . 110 4.7.6 Conclusion . 110 4.8 Discussion . 111 4.8.1 Measures of span.
Recommended publications
  • A Multilingual Keyboard and Mouse Interface for Motor-Impaired Users
    SUITEDasher – A Multilingual Keyboard and Mouse Interface for Motor-Impaired Users David Lyle and Bill Manaris Computer Science Department, College of Charleston 66 George Street, Charleston, SC 29424, USA [email protected], [email protected] Abstract This paper presents the design of SUITEDasher – an open-source, multilingual speech user interface for motor- impaired users. SUITEDasher’s architecture is based on SUITEKeys – a speech user interface for manipulating a speech keyboard and mouse. SUITEDasher has three main design objectives: (a) to improve on the usability of its predecessor; (b) to provide for multilingual access; and (c) to be platform independent. To achieve these objectives, SUITEDasher employs a minimal graphical user interface, and incorporates a trigram-based probabilistic model from Dasher – a text-entry interface driven by pointing gestures. Multilingual access is achieved through a set of syntactic, lexical, and (potentially) phonetic models that may be loaded dynamically at run time. Finally, SUITEDasher is being implemented in Java as a cross-platform (Windows, Mac OS X, and Linux) application. While refining the design, we have developed several prototypes, the latest of which has been implemented in Visual Basic and C++ on the Windows platform. Preliminary usability results indicate that, in terms of typing speed, SUITEDasher appears to be 30% faster than its predecessor, and as fast as Dasher. Keywords: Universal access, motor impairments, speech user interfaces, listening keyboard, usability evaluation. 1 Introduction Several studies have been performed exploring the effectiveness of speech as an alternative to the physical keyboard for alphanumeric data entry. Murray et al. (1983) found that, in the context of controlling cursor movement, keyboard input is twice as fast and more preferred by users compared to speech.
    [Show full text]
  • 7 35138412 1.Pdf (2.296Mb)
    MAUU(D)5900 MASTER THESIS in Universal Design of ICT October 2018 An Accessible Directions-based Text Entry Method Using Two-thumb Touch Typing Linghui Ye Department of Computer Science Faculty of Technology, Art and Design Master Thesis Phase III Report Contents Abstract ......................................................................................................................................................... 3 1. Introduction .............................................................................................................................................. 5 2. Related work ............................................................................................................................................. 8 3. The prototype ......................................................................................................................................... 15 3.1 Physical direction .............................................................................................................................. 20 3.2 Resolving ambiguities ....................................................................................................................... 23 3.3 Special characters ............................................................................................................................. 23 4. Methodology ........................................................................................................................................... 25 4.1 Experimental design .........................................................................................................................
    [Show full text]
  • Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion
    1 Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion JOHN J. DUDLEY, University of Cambridge, United Kingdom KEITH VERTANEN, Michigan Technological University, USA PER OLA KRISTENSSON, University of Cambridge, United Kingdom We present the VISAR keyboard: an augmented reality (AR) head-mounted display (HMD) system that supports text entry via a virtualised input surface. Users select keys on the virtual keyboard by imitating the process of single-hand typing on a physical touchscreen display. Our system uses a statistical decoder to infer users’ intended text and to provide error-tolerant predictions. There is also a high-precision fall-back mechanism to support users in indicating which keys should be unmodified by the auto-correction process. A unique advantage of leveraging the well-established touch input paradigm is that our system enables text entry with minimal visual clutter on the see-through display, thus preserving the user’s field-of-view. We iteratively designed and evaluated our system and show that the final iteration of the system supports a mean entry rate of 17.75 wpm with a mean character error rate less than 1%. This performance represents a 19.6% improvement relative to the state-of-the-art baseline investigated: a gaze-then-gesture text entry technique derived from the system keyboard on the Microsoft HoloLens. Finally, we validate that the system is effective in supporting text entry in a fully mobile usage scenario likely to be encountered in industrial applications of AR HMDs. CCS Concepts: • Human-centered computing → Text input; Additional Key Words and Phrases: augmented reality, text entry 1 INTRODUCTION Recent progress in head-mounted displays (HMDs) for augmented reality (AR), such as the Microsoft HoloLens, demonstrates the commercial potential of AR to support new forms of interaction and work in a range of industries including construction, education and health.
    [Show full text]
  • Digital Access Project
    DIGITAL ACCESS PROJECT LEARNING MODULE Computer hardware, basic digital terminology and typing skills Code: M5BO Prepared by: ITPIO October 2018 This project has been funded with support from the European Commission. This publication reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein. Contents SUMMARY ..............................................................................................................................5 KEYWORDS .............................................................................................................................5 MODULE OBJECTIVES .............................................................................................................5 UNIT 1: USING THE INTERFACE OF COMPUTERS .....................................................................7 Specific objectives of Unit 1 ................................................................................................7 Display ................................................................................................................................7 Mouse and Touchpad .........................................................................................................8 Keyboard ............................................................................................................................9 Printer...............................................................................................................................11
    [Show full text]
  • QB-Gest: Qwerty Bimanual Gestural Input for Eyes-Free Smartphone Text Input
    QB-Gest: Qwerty Bimanual Gestural Input for Eyes-Free Smartphone Text Input Linghui Ye1, Frode Eika Sandnes1,2(&) , and I. Scott MacKenzie3 1 Department of Computer Science, Oslo Metropolitan University, 0130 Oslo, Norway [email protected], [email protected] 2 Institute of Technology, Kristiania University College, 0153 Oslo, Norway 3 Department of Computer Science, York University, Toronto, ON M3J 1P3, Canada [email protected] Abstract. We developed QB-Gest, a bimanual text entry method based on simple gestures where users drag their thumbs in the direction of the desired letter while visualizing the Qwerty-layout. In an experiment with four sessions of testing, 20 users achieved text entry rates of 11.1 wpm eyes-free and 14.1 wpm eyes-on. An expert user achieved an eyes-free rate of 24.9 wpm after 10 rounds of entering the-quick-brown-fox phrase. The method holds potential for users with low vision and certain types of reduced motor function. Keywords: Mobile text entry Á Eyes free text Á Gestures Á Qwerty 1 Introduction Smartphones have become an important tool in modern society by facilitating com- munication independent of time and place. Many smartphone tasks require text input, such as searching the web, sending emails, or messaging. Text input typically uses a default virtual keyboard. Yet, many users find it hard to use virtual smartphone key- boards compared to physical desktop keyboards [1], because input requires accurately hitting keys without tactile feedback. Virtual smartphone keys are smaller than physical desktop keys; so, input is both visually intensive and requires careful eye-motor coordination [2].
    [Show full text]
  • 1 Background Many Applications for Handheld Electronic Devices Depend on the User Being Able to Enter Text
    ABSTRACT When using your smartphone (or similar handheld electronic device) with one hand, you have to type with the thumb, which isn’t the finger you would normally use. The more agile fingers are tied up with holding the device. This is due to the interface concept, not to any functional deficit of the human hand. You could operate these devices with the use of all fingers, and not just for typing, but that calls for a different interface paradigm, one that mirrors the ergonomic capabilities of the human hand. You engage this kind of interface where your fingers spontaneously come into contact with the device when you grasp it, not at predetermined locations that are not necessarily easy to reach. This interface dynamically maps the controls of the device to the contact patches of your fingers and generates a visual, audible or haptic tag to tell you what function a finger controls. To activate a control you engage it with the corresponding finger. KEYWORDS Topical† tactile interfaces, atopical* tactile interfaces, operative interaction with back and sides of device, accessibility issues with virtual controls, atypical handheld devices (disks, cylinders, torons etc.) †characterised by operative interactions confined to defined locations *characterised by operative interactions not confined to defined locations 1 Background Many applications for handheld electronic devices depend on the user being able to enter text. To this end, the tactile user interfaces of these devices are configured with a miniature keyboard. The idea behind this is presumably to replicate the functionality of a standard keyboard. This may be aiming a little too high, though.
    [Show full text]
  • Interactions with Smartphones and Smartwatches: Context-Awareness, Text Entry Interfaces, and Input Beyond Touch
    INTERACTIONS WITH SMARTPHONES AND SMARTWATCHES: CONTEXT-AWARENESS, TEXT ENTRY INTERFACES, AND INPUT BEYOND TOUCH Rajkumar Darbar INTERACTIONS WITH SMARTPHONES AND SMARTWATCHES: CONTEXT-AWARENESS, TEXT ENTRY INTERFACES, AND INPUT BEYOND TOUCH Thesis submitted to the Indian Institute of Technology Kharagpur for award of the degree of Master of Science (MS) - by Research by Rajkumar Darbar Under the guidance of Dr. Debasis Samanta Computer Science and Engineering Indian Institute of Technology Kharagpur Kharagpur - 721 302, India July 2016 ⃝c 2016 Rajkumar Darbar. All rights reserved. CERTIFICATE OF APPROVAL 00/00/0000 Certified that the thesis entitled Interactions with Smartphones and Smartwatches: Context-Awareness, Text Entry Interfaces, and Input Beyond Touch submit- ted by Rajkumar Darbar to the Indian Institute of Technology, Kharagpur, for the award of the degree Master of Science has been accepted by the external examiners and that the student has successfully defended the thesis in the viva-voce examination held today. (Member of DAC) (Member of DAC) (Member of DAC) (Supervisor) (Internal Examiner) (Chairman) CERTIFICATE This is to certify that the thesis entitled Interactions with Smartphones and Smart- watches: Context-Awareness, Text Entry Interfaces, and Input Beyond Touch submitted by Rajkumar Darbar to Indian Institute of Technology Kharagpur, is a record of bona fide research work under my supervision and I consider it worthy of consideration for the award of the degree of Master of Science (by Research) of the Institute. Date: 20/07/2016 Dr. Debasis Samanta Associate Professor Computer Science and Engineering Indian Institute of Technology Kharagpur Kharagpur - 721 302, India DECLARATION I certify that a. The work contained in the thesis is original and has been done by myself under the general supervision of my supervisor.
    [Show full text]
  • 30 Fast and Precise Touch-Based Text Entry for Head-Mounted
    30 Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion JOHN J. DUDLEY, University of Cambridge KEITH VERTANEN, Michigan Technological University PER OLA KRISTENSSON, University of Cambridge We present the VISAR keyboard: An augmented reality (AR) head-mounted display (HMD) system that sup- ports text entry via a virtualised input surface. Users select keys on the virtual keyboard by imitating the process of single-hand typing on a physical touchscreen display. Our system uses a statistical decoder to infer users’ intended text and to provide error-tolerant predictions. There is also a high-precision fall-back mechanism to support users in indicating which keys should be unmodified by the auto-correction process. A unique advantage of leveraging the well-established touch input paradigm is that our system enables text entry with minimal visual clutter on the see-through display, thus preserving the user’s field-of-view. We it- eratively designed and evaluated our system and show that the final iteration of the system supports a mean entry rate of 17.75wpm with a mean character error rate less than 1%. This performance represents a 19.6% improvement relative to the state-of-the-art baseline investigated: A gaze-then-gesture text entry technique derived from the system keyboard on the Microsoft HoloLens. Finally, we validate that the system is effective in supporting text entry in a fully mobile usage scenario likely to be encountered in industrial applications of AR HMDs. CCS Concepts: • Human-centered computing → Text input; Additional Key Words and Phrases: Augmented reality, text entry ACM Reference format: John J.
    [Show full text]
  • ( 12 ) United States Patent ( 10 ) Patent No.: US 10,474,347 B2 Tortosa Et Al
    US010474347B2 ( 12 ) United States Patent ( 10 ) Patent No.: US 10,474,347 B2 Tortosa et al. (45 ) Date of Patent : Nov. 12 , 2019 (54 ) AUTOMATED MODIFICATION OF 2012/0036468 A1 * 2/2012 Colley G06F 3/0418 GRAPHICAL USER INTERFACES 715/773 2012/0169613 A1 * 7/2012 Armstrong GO6F 3/04886 345/173 ( 71) Applicant: International Business Machines 2013/0019191 A1 * 1/2013 Arnold G06F 3/04886 Corporation , Armonk , NY (US ) 715/765 2013/0191779 Al 7/2013 Radakovitz et al . ( 72 ) Inventors : Andrea Tortosa , Rome (IT ) ; Francesco Maria Carteri, Rome (IT ) ; Massimo (Continued ) Marra , Rome (IT ) FOREIGN PATENT DOCUMENTS ( 73 ) Assignee : International Business Machines WO 2012127101 A1 9/2012 Corporation , Armonk , NY (US ) ( * ) Notice: Subject to any disclaimer , the term of this OTHER PUBLICATIONS patent is extended or adjusted under 35 Reynaga et al ., “ Exploring the Usability of CAPTCHAS on U.S.C. 154 ( b ) by 542 days . Smartphones: Comparisons and Recommendations” , USEC '15 , Feb. 8 , 2015 , San Diego, CA , USA , pp . 1-10 , Copyright 2015 ( 21) Appl. No .: 14 /918,633 Internet Society , ISBN 1-891562-40-1 , < http://dx.doi.org/10.14722/ usec.2015.23006 > . ( 22 ) Filed : Oct. 21 , 2015 (Continued ) (65 ) Prior Publication Data Primary Examiner Andrew T Chiusano US 2017/0115794 A1 Apr. 27 , 2017 (74 ) Attorney, Agent, or Firm — Dmitry Paskalov (51 ) Int . Cl. ( 57 ) ABSTRACT G06F 3/048 ( 2013.01 ) Information that describes one or more touch events per G06F 3/0488 ( 2013.01) formed on a touchscreen display to interact with a graphical G06F 9/451 (2018.01 ) user interface (GUI ) of a software application is received .
    [Show full text]
  • Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson’S Disease
    Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson’s Disease Yuntao Wang Ao Yu Xin Yi∗ Department of Computer Science and Global Innovation Exchange (GIX), Department of Computer Science and Technology, Key Laboratory of Tsinghua University and University of Technology, Key Laboratory of Pervasive Computing, Ministry of Washington, 98005, WA, USA Pervasive Computing, Ministry of Education, Tsinghua University, [email protected] Education, Tsinghua University, Beijing, China, 100084 Beijing, China, 100084 [email protected] [email protected] Yuanwei Zhang Ishan Chatterjee Shwetak Patel Global Innovation Exchange (GIX), Paul G. Allen School of Computer Paul G. Allen School of Computer Tsinghua University and University of Science and Engineering, University Science and Engineering, University Washington, 98005, WA, USA of Washington, 98195, Seattle, USA of Washington, 98195, Seattle, USA [email protected] [email protected] [email protected] Yuanchun Shi Department of Computer Science and Technology, Key Laboratory of Pervasive Computing, Ministry of Education, Tsinghua University, Beijing, China, 100084 [email protected] ABSTRACT CCS CONCEPTS QWERTY is the primary smartphone text input keyboard confgu- • Human-centered computing ! Text input; Accessibility. ration. However, insertion and substitution errors caused by hand tremors, often experienced by users with Parkinson’s disease, can KEYWORDS severely afect typing efciency and user experience. In this paper, Parkinson’s disease, text entry, QWERTY keyboard, touch model, we investigated Parkinson’s users’ typing behavior on smartphones. statistical decoding In particular, we identifed and compared the typing characteristics generated by users with and without Parkinson’s symptoms. We ACM Reference Format: then proposed an elastic probabilistic model for input prediction.
    [Show full text]
  • Text Blaster: a Multi-Player Touchscreen Typing Game
    Text Blaster: A Multi-Player Touchscreen Typing Game Figure 1: A group playing Text Keith Vertanen Per Ola Kristensson Abstract Blaster. Each player uses an Montana Tech University of St Andrews Text Blaster is a multi-player shoot 'em up game based on Android mobile device to control Butte, Montana USA St Andrews, UK players typing sentences on a mobile device's touchscreen their ship. The global state of [email protected] [email protected] keyboard. Players attempt to be the last player standing the game is shown on the large by using the speed, precision, and timing of their typing to projection wall. annihilate competing players. Our game utilizes a Justin Emge sentence-based decoding approach in which users type an Montana Tech entire sentence before our auto-correction algorithm infers Butte, Montana USA the most likely text. Text Blaster provides an engaging [email protected] and competitive game for use in investigating performance and design aspects of touchscreen text entry interfaces. Haythem Memmi Author Keywords Montana Tech Text entry; game design; touchscreen keyboard Butte, Montana USA [email protected] ACM Classification Keywords H.5.2 [Information interfaces and presentation: User Interfaces]: Input devices and strategies. Introduction Permission to make digital or hard copies of part or all of this work for In this paper we describe Text Blaster, a multi-player personal or classroom use is granted without fee provided that copies are not game that we created based around users typing sentences made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page.
    [Show full text]
  • Ye.Pdf (2.296Mb)
    MAUU(D)5900 MASTER THESIS in Universal Design of ICT October 2018 An Accessible Directions-based Text Entry Method Using Two-thumb Touch Typing Linghui Ye Department of Computer Science Faculty of Technology, Art and Design Master Thesis Phase III Report Contents Abstract ......................................................................................................................................................... 3 1. Introduction .............................................................................................................................................. 5 2. Related work ............................................................................................................................................. 8 3. The prototype ......................................................................................................................................... 15 3.1 Physical direction .............................................................................................................................. 20 3.2 Resolving ambiguities ....................................................................................................................... 23 3.3 Special characters ............................................................................................................................. 23 4. Methodology ........................................................................................................................................... 25 4.1 Experimental design .........................................................................................................................
    [Show full text]