DOCSLIB.ORG

( 12 ) United States Patent ( 10 ) Patent No.: US 10,474,347 B2 Tortosa Et Al

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
( 12 ) United States Patent ( 10 ) Patent No.: US 10,474,347 B2 Tortosa Et Al US010474347B2 ( 12 ) United States Patent ( 10 ) Patent No.: US 10,474,347 B2 Tortosa et al. (45 ) Date of Patent : Nov. 12 , 2019 (54 ) AUTOMATED MODIFICATION OF 2012/0036468 A1 * 2/2012 Colley G06F 3/0418 GRAPHICAL USER INTERFACES 715/773 2012/0169613 A1 * 7/2012 Armstrong GO6F 3/04886 345/173 ( 71) Applicant: International Business Machines 2013/0019191 A1 * 1/2013 Arnold G06F 3/04886 Corporation , Armonk , NY (US ) 715/765 2013/0191779 Al 7/2013 Radakovitz et al . ( 72 ) Inventors : Andrea Tortosa , Rome (IT ) ; Francesco Maria Carteri, Rome (IT ) ; Massimo (Continued ) Marra , Rome (IT ) FOREIGN PATENT DOCUMENTS ( 73 ) Assignee : International Business Machines WO 2012127101 A1 9/2012 Corporation , Armonk , NY (US ) ( * ) Notice: Subject to any disclaimer , the term of this OTHER PUBLICATIONS patent is extended or adjusted under 35 Reynaga et al ., “ Exploring the Usability of CAPTCHAS on U.S.C. 154 ( b ) by 542 days . Smartphones: Comparisons and Recommendations” , USEC '15 , Feb. 8 , 2015 , San Diego, CA , USA , pp . 1-10 , Copyright 2015 ( 21) Appl. No .: 14 /918,633 Internet Society , ISBN 1-891562-40-1 , < http://dx.doi.org/10.14722/ usec.2015.23006 > . ( 22 ) Filed : Oct. 21 , 2015 (Continued ) (65 ) Prior Publication Data Primary Examiner Andrew T Chiusano US 2017/0115794 A1 Apr. 27 , 2017 (74 ) Attorney, Agent, or Firm — Dmitry Paskalov (51 ) Int . Cl. ( 57 ) ABSTRACT G06F 3/048 ( 2013.01 ) Information that describes one or more touch events per G06F 3/0488 ( 2013.01) formed on a touchscreen display to interact with a graphical G06F 9/451 (2018.01 ) user interface (GUI ) of a software application is received . A (52 ) U.S. CI. touch event density map based on a frequency of touch CPC G06F 370488 ( 2013.01 ) ; G06F 9/451 events on the touchscreen display as a function of touch (2018.02 ) event position on the touchscreen display is generated . One ( 58 ) Field of Classification Search or more portions of the touchscreen display that received the CPC .... GO6F 3/0416 ; G06F 3/0481 ; G06F 3/0488 ; highest density of touch events are identified . At least one of: G06F 9/451 dimension of the one or more graphical elements of the GUI See application file for complete search history . associated with the one or more identified portions of the touchscreen display, a dimension of a touchscreen display (56 ) References Cited area that corresponds to the one or more graphical elements , U.S. PATENT DOCUMENTS and a position relative to the one ormore graphical elements of the touchscreen display area are modified . 8,786,664 B2 7/2014 Hornyak et al . 9,244,604 B1 * 1/2016 Lewbel G06F 3/0488 17 Claims, 6 Drawing Sheets 200 START DETERMINE THAT 202 MONITORING INTERVAL IS COMPLETE 204 GENERATE DENSITY MAP 206 IDENTIFY PORTIONS OF GUI TO MODIFY 208 MODIFY GUI END US 10,474,347 B2 Page 2 ( 56 ) References Cited U.S. PATENT DOCUMENTS 2013/0219518 Al 8/2013 Sambamurthy et al. 2014/0068498 A1 * 3/2014 Olsen G06F 11/32 715/781 2014/0123060 A1 * 5/2014 Kuscher G06F 3/0488 715/800 2014/0317171 A1 10/2014 Fox et al. 2014/0327629 A1 11/2014 Jobs et al . 2015/0128049 Al 5/2015 Block et al . 2015/0135109 Al 5/2015 Zambetti et al . 2016/0162276 A1 * 6/2016 Peng G06F 8/65 715/744 2017/0090749 A1 * 3/2017 Marsden G06F 3/04886 OTHER PUBLICATIONS Oracle , “ Lightweight User Interface Toolkit : Advanced User Inter faces for Mass -Market Phones” , JAVATM , Oracle Data Sheet , pp . 1-3 , Copyright © 2010 , Oracle and /or its affiliates. Mell et al. , “ The NIST Definition of Cloud Computing, ” National Institute of Standards and Technology, U.S. Department of Com merce, Special Publication 800-145, Sep. 2011 , pp . 1-7 . * cited by examiner U.S. Patent Nov. 12 , 2019 Sheet 1 of 6 US 10,474,347 B2 100 130 s STORAGE COMPUTER SYSTEM 132 DATA STORE 120 NETWORK 110 CLIENT COMPUTER SYSTEM -112 -114 GRAPHICAL USER ANALYSIS ENGINE INTERFACE 116 118 TOUCHSCREEN APPLICATION DISPLAY FIG . 1 U.S. Patent Nov. 12 , 2019 Sheet 2 of 6 US 10,474,347 B2 200 START 3 DETERMINE THAT 202 MONITORING INTERVAL IS COMPLETE 204 GENERATE DENSITY MAP 206 IDENTIFY PORTIONS OF GUI TO MODIFY 208 MODIFY GUI END FIG . 2 U.S. Patent Nov. 12 , 2019 Sheet 3 of 6 US 10,474,347 B2 300 302 UP s 304 DOWN FIG . 3A 306 320 Y 302 308 3109 304 DOWN FIG . 3B 340 312 n UP 314 DOWN FIG . 3C U.S. Patent Nov. 12 , 2019 Sheet 4 of 6 US 10,474,347 B2 400s 412 408 PERSISTENT STORAGE COMMUNICATIONSUNIT FIG.4 406 MEMORY RAM 416 418 CACHE -404 PROCESSOR(S) INTERFACE(S) DEVICE(S) I/O 402 EXTERNAL 414 420 422 DISPLAY U.S. Patent Nov. 12 , 2019 Sheet 5 of 6 US 10,474,347 B2 50 10 54B SHA 54N FIG.5 154C 54A U.S. Patent Nov. 12 , 2019 Sheet 6 of 6 US 10,474,347 B2 7 68 85 75 67 66 74 65 FIG.6 3/2 73 Z-7-7-7-7/ 64 72 63 71 6261 91 81 Z HARDWAREANDSOFTWARE WORKLOADS 90 MANAGEMENT 80 VIRTUALIZATION 70 ? 60 US 10,474,347 B2 1 2 AUTOMATED MODIFICATION OF modifying graphical user interfaces implemented by touch GRAPHICAL USER INTERFACES display computer systems. Graphical user interfaces, for example , virtual keyboards, may be automatically modify BACKGROUND OF THE INVENTION for each user interacting with an application executed on 5 touch - display computer systems, based on user input and The present invention relates generally to the field of touchscreen computer systems, and more particularly ,modi analyzed touchscreen touch events . fying graphical user interfaces of touchscreen computer FIG . 1 is a block diagram of graphical user interface systems. (GUI ) modification environment 100 , in accordance with an Touchscreen computer systems often implement a graphi embodiment of the present invention . GUI modification cal user interface (GUI ) enabling users of touchscreen 10 environment 100 includes client computer system 110 and computer systems to interact with one or more applications storage computer system 130. Client computer system 110 executed on the touch -display computer systems. For and storage computer system 130 can be a desktop comput example , GUIs may include virtual keyboards which emu ers , laptop computers , specialized computer servers , or any late physical computer keyboards . Virtual keyboards enable other computer systemsknown in the art , in accordance with users of touch -display computer systems to input alphanu- 15 an embodiment of the invention . In certain embodiments , meric data using a text entry interface . Users that use client computer system 110 and storage computer system touch - display computer systemsmay have varying physical 130 represent computer systems utilizing clustered comput capabilities , physical limitations, and / or personal prefer ers and components to act as a single pool of seamless ences when interacting with one or more applications resources when accessed through network 120. In certain executed on a touch - display computer system . 20 embodiments , client computer system 110 and storage com puter system 130 represent virtual machines. In general , SUMMARY client computer system 110 and storage computer system 130 are representative of any electronic devices , or combi An automated modification of graphical user interfaces nation of electronic devices, capable of executing machine (GUI ) is provided . Information that describes one or more 25 readable program instructions in accordance with an touch events performed on a touchscreen display to interact embodiment of the invention , as described in greater detail with a graphical user interface (GUI ) of a software appli with regard to FIG . 4. In other embodiments , client com cation is received . A touch event density map based on a puter system 110 and storage computer system 130 may be frequency of touch events on the touchscreen display as a implemented in a cloud computing environment, as isfunction generated of touch . One event or more position portions on the oftouchscreen the touchscreen display 30 described in relation to FIGS . 5 and 6 . display that received a highest density of touch events are Client computer system 110 represents a platform by identified . One or more graphical elements of the GUI which one or more users can interact with application 116 , associated with the one or more identified portions of the via GUI 114 presented on touchscreen display 118. Client touchscreen display are identified . Responsive to determin computer system 110 includes analysis engine 112 , GUI 114 , ing that the one or more graphical elements of the GUI 35 application 116 , and touchscreen display 118. In this associated with the one or more identified portions of the embodiment, a user of client computer system 110 may use touchscreen display do not align with a threshold alignment application 116 by interacting with GUI 114 which is value , at least one of: a dimension of the one or more presented on touchscreen display 118. The phrase , " touch graphical elements of the GUI associated with the one or event” as used herein , refers to a user input ( e.g., touch , more identified portions of the touchscreen display , a dimen- 40 tapped , swipe, etc.) on touchscreen display 118 performed sion of a touchscreen display area that corresponds to the by a user of client computer system 110 to interact with a one or more graphical elements , and a position relative to the portion of GUI 114 and is associated with touch event one or more graphical elements of the touchscreen display information . For example , a user may perform a touch event area are modified . on touchscreen display 118 to interactwith a specific graphi 45 cal element of GUI 114 ( e.g., a Home button ).
Load more

Recommended publications
  • A Multilingual Keyboard and Mouse Interface for Motor-Impaired Users
    SUITEDasher – A Multilingual Keyboard and Mouse Interface for Motor-Impaired Users David Lyle and Bill Manaris Computer Science Department, College of Charleston 66 George Street, Charleston, SC 29424, USA [email protected], [email protected] Abstract This paper presents the design of SUITEDasher – an open-source, multilingual speech user interface for motor- impaired users. SUITEDasher’s architecture is based on SUITEKeys – a speech user interface for manipulating a speech keyboard and mouse. SUITEDasher has three main design objectives: (a) to improve on the usability of its predecessor; (b) to provide for multilingual access; and (c) to be platform independent. To achieve these objectives, SUITEDasher employs a minimal graphical user interface, and incorporates a trigram-based probabilistic model from Dasher – a text-entry interface driven by pointing gestures. Multilingual access is achieved through a set of syntactic, lexical, and (potentially) phonetic models that may be loaded dynamically at run time. Finally, SUITEDasher is being implemented in Java as a cross-platform (Windows, Mac OS X, and Linux) application. While refining the design, we have developed several prototypes, the latest of which has been implemented in Visual Basic and C++ on the Windows platform. Preliminary usability results indicate that, in terms of typing speed, SUITEDasher appears to be 30% faster than its predecessor, and as fast as Dasher. Keywords: Universal access, motor impairments, speech user interfaces, listening keyboard, usability evaluation. 1 Introduction Several studies have been performed exploring the effectiveness of speech as an alternative to the physical keyboard for alphanumeric data entry. Murray et al. (1983) found that, in the context of controlling cursor movement, keyboard input is twice as fast and more preferred by users compared to speech.
    [Show full text]
  • 7 35138412 1.Pdf (2.296Mb)
    MAUU(D)5900 MASTER THESIS in Universal Design of ICT October 2018 An Accessible Directions-based Text Entry Method Using Two-thumb Touch Typing Linghui Ye Department of Computer Science Faculty of Technology, Art and Design Master Thesis Phase III Report Contents Abstract ......................................................................................................................................................... 3 1. Introduction .............................................................................................................................................. 5 2. Related work ............................................................................................................................................. 8 3. The prototype ......................................................................................................................................... 15 3.1 Physical direction .............................................................................................................................. 20 3.2 Resolving ambiguities ....................................................................................................................... 23 3.3 Special characters ............................................................................................................................. 23 4. Methodology ........................................................................................................................................... 25 4.1 Experimental design .........................................................................................................................
    [Show full text]
  • Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion
    1 Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion JOHN J. DUDLEY, University of Cambridge, United Kingdom KEITH VERTANEN, Michigan Technological University, USA PER OLA KRISTENSSON, University of Cambridge, United Kingdom We present the VISAR keyboard: an augmented reality (AR) head-mounted display (HMD) system that supports text entry via a virtualised input surface. Users select keys on the virtual keyboard by imitating the process of single-hand typing on a physical touchscreen display. Our system uses a statistical decoder to infer users’ intended text and to provide error-tolerant predictions. There is also a high-precision fall-back mechanism to support users in indicating which keys should be unmodified by the auto-correction process. A unique advantage of leveraging the well-established touch input paradigm is that our system enables text entry with minimal visual clutter on the see-through display, thus preserving the user’s field-of-view. We iteratively designed and evaluated our system and show that the final iteration of the system supports a mean entry rate of 17.75 wpm with a mean character error rate less than 1%. This performance represents a 19.6% improvement relative to the state-of-the-art baseline investigated: a gaze-then-gesture text entry technique derived from the system keyboard on the Microsoft HoloLens. Finally, we validate that the system is effective in supporting text entry in a fully mobile usage scenario likely to be encountered in industrial applications of AR HMDs. CCS Concepts: • Human-centered computing → Text input; Additional Key Words and Phrases: augmented reality, text entry 1 INTRODUCTION Recent progress in head-mounted displays (HMDs) for augmented reality (AR), such as the Microsoft HoloLens, demonstrates the commercial potential of AR to support new forms of interaction and work in a range of industries including construction, education and health.
    [Show full text]
  • Digital Access Project
    DIGITAL ACCESS PROJECT LEARNING MODULE Computer hardware, basic digital terminology and typing skills Code: M5BO Prepared by: ITPIO October 2018 This project has been funded with support from the European Commission. This publication reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein. Contents SUMMARY ..............................................................................................................................5 KEYWORDS .............................................................................................................................5 MODULE OBJECTIVES .............................................................................................................5 UNIT 1: USING THE INTERFACE OF COMPUTERS .....................................................................7 Specific objectives of Unit 1 ................................................................................................7 Display ................................................................................................................................7 Mouse and Touchpad .........................................................................................................8 Keyboard ............................................................................................................................9 Printer...............................................................................................................................11
    [Show full text]
  • QB-Gest: Qwerty Bimanual Gestural Input for Eyes-Free Smartphone Text Input
    QB-Gest: Qwerty Bimanual Gestural Input for Eyes-Free Smartphone Text Input Linghui Ye1, Frode Eika Sandnes1,2(&) , and I. Scott MacKenzie3 1 Department of Computer Science, Oslo Metropolitan University, 0130 Oslo, Norway [email protected], [email protected] 2 Institute of Technology, Kristiania University College, 0153 Oslo, Norway 3 Department of Computer Science, York University, Toronto, ON M3J 1P3, Canada [email protected] Abstract. We developed QB-Gest, a bimanual text entry method based on simple gestures where users drag their thumbs in the direction of the desired letter while visualizing the Qwerty-layout. In an experiment with four sessions of testing, 20 users achieved text entry rates of 11.1 wpm eyes-free and 14.1 wpm eyes-on. An expert user achieved an eyes-free rate of 24.9 wpm after 10 rounds of entering the-quick-brown-fox phrase. The method holds potential for users with low vision and certain types of reduced motor function. Keywords: Mobile text entry Á Eyes free text Á Gestures Á Qwerty 1 Introduction Smartphones have become an important tool in modern society by facilitating com- munication independent of time and place. Many smartphone tasks require text input, such as searching the web, sending emails, or messaging. Text input typically uses a default virtual keyboard. Yet, many users find it hard to use virtual smartphone key- boards compared to physical desktop keyboards [1], because input requires accurately hitting keys without tactile feedback. Virtual smartphone keys are smaller than physical desktop keys; so, input is both visually intensive and requires careful eye-motor coordination [2].
    [Show full text]
  • 1 Background Many Applications for Handheld Electronic Devices Depend on the User Being Able to Enter Text
    ABSTRACT When using your smartphone (or similar handheld electronic device) with one hand, you have to type with the thumb, which isn’t the finger you would normally use. The more agile fingers are tied up with holding the device. This is due to the interface concept, not to any functional deficit of the human hand. You could operate these devices with the use of all fingers, and not just for typing, but that calls for a different interface paradigm, one that mirrors the ergonomic capabilities of the human hand. You engage this kind of interface where your fingers spontaneously come into contact with the device when you grasp it, not at predetermined locations that are not necessarily easy to reach. This interface dynamically maps the controls of the device to the contact patches of your fingers and generates a visual, audible or haptic tag to tell you what function a finger controls. To activate a control you engage it with the corresponding finger. KEYWORDS Topical† tactile interfaces, atopical* tactile interfaces, operative interaction with back and sides of device, accessibility issues with virtual controls, atypical handheld devices (disks, cylinders, torons etc.) †characterised by operative interactions confined to defined locations *characterised by operative interactions not confined to defined locations 1 Background Many applications for handheld electronic devices depend on the user being able to enter text. To this end, the tactile user interfaces of these devices are configured with a miniature keyboard. The idea behind this is presumably to replicate the functionality of a standard keyboard. This may be aiming a little too high, though.
    [Show full text]
  • Interactions with Smartphones and Smartwatches: Context-Awareness, Text Entry Interfaces, and Input Beyond Touch
    INTERACTIONS WITH SMARTPHONES AND SMARTWATCHES: CONTEXT-AWARENESS, TEXT ENTRY INTERFACES, AND INPUT BEYOND TOUCH Rajkumar Darbar INTERACTIONS WITH SMARTPHONES AND SMARTWATCHES: CONTEXT-AWARENESS, TEXT ENTRY INTERFACES, AND INPUT BEYOND TOUCH Thesis submitted to the Indian Institute of Technology Kharagpur for award of the degree of Master of Science (MS) - by Research by Rajkumar Darbar Under the guidance of Dr. Debasis Samanta Computer Science and Engineering Indian Institute of Technology Kharagpur Kharagpur - 721 302, India July 2016 ⃝c 2016 Rajkumar Darbar. All rights reserved. CERTIFICATE OF APPROVAL 00/00/0000 Certified that the thesis entitled Interactions with Smartphones and Smartwatches: Context-Awareness, Text Entry Interfaces, and Input Beyond Touch submit- ted by Rajkumar Darbar to the Indian Institute of Technology, Kharagpur, for the award of the degree Master of Science has been accepted by the external examiners and that the student has successfully defended the thesis in the viva-voce examination held today. (Member of DAC) (Member of DAC) (Member of DAC) (Supervisor) (Internal Examiner) (Chairman) CERTIFICATE This is to certify that the thesis entitled Interactions with Smartphones and Smart- watches: Context-Awareness, Text Entry Interfaces, and Input Beyond Touch submitted by Rajkumar Darbar to Indian Institute of Technology Kharagpur, is a record of bona fide research work under my supervision and I consider it worthy of consideration for the award of the degree of Master of Science (by Research) of the Institute. Date: 20/07/2016 Dr. Debasis Samanta Associate Professor Computer Science and Engineering Indian Institute of Technology Kharagpur Kharagpur - 721 302, India DECLARATION I certify that a. The work contained in the thesis is original and has been done by myself under the general supervision of my supervisor.
    [Show full text]
  • 30 Fast and Precise Touch-Based Text Entry for Head-Mounted
    30 Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion JOHN J. DUDLEY, University of Cambridge KEITH VERTANEN, Michigan Technological University PER OLA KRISTENSSON, University of Cambridge We present the VISAR keyboard: An augmented reality (AR) head-mounted display (HMD) system that sup- ports text entry via a virtualised input surface. Users select keys on the virtual keyboard by imitating the process of single-hand typing on a physical touchscreen display. Our system uses a statistical decoder to infer users’ intended text and to provide error-tolerant predictions. There is also a high-precision fall-back mechanism to support users in indicating which keys should be unmodified by the auto-correction process. A unique advantage of leveraging the well-established touch input paradigm is that our system enables text entry with minimal visual clutter on the see-through display, thus preserving the user’s field-of-view. We it- eratively designed and evaluated our system and show that the final iteration of the system supports a mean entry rate of 17.75wpm with a mean character error rate less than 1%. This performance represents a 19.6% improvement relative to the state-of-the-art baseline investigated: A gaze-then-gesture text entry technique derived from the system keyboard on the Microsoft HoloLens. Finally, we validate that the system is effective in supporting text entry in a fully mobile usage scenario likely to be encountered in industrial applications of AR HMDs. CCS Concepts: • Human-centered computing → Text input; Additional Key Words and Phrases: Augmented reality, text entry ACM Reference format: John J.
    [Show full text]
  • Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson’S Disease
    Facilitating Text Entry on Smartphones with QWERTY Keyboard for Users with Parkinson’s Disease Yuntao Wang Ao Yu Xin Yi∗ Department of Computer Science and Global Innovation Exchange (GIX), Department of Computer Science and Technology, Key Laboratory of Tsinghua University and University of Technology, Key Laboratory of Pervasive Computing, Ministry of Washington, 98005, WA, USA Pervasive Computing, Ministry of Education, Tsinghua University, [email protected] Education, Tsinghua University, Beijing, China, 100084 Beijing, China, 100084 [email protected] [email protected] Yuanwei Zhang Ishan Chatterjee Shwetak Patel Global Innovation Exchange (GIX), Paul G. Allen School of Computer Paul G. Allen School of Computer Tsinghua University and University of Science and Engineering, University Science and Engineering, University Washington, 98005, WA, USA of Washington, 98195, Seattle, USA of Washington, 98195, Seattle, USA [email protected] [email protected] [email protected] Yuanchun Shi Department of Computer Science and Technology, Key Laboratory of Pervasive Computing, Ministry of Education, Tsinghua University, Beijing, China, 100084 [email protected] ABSTRACT CCS CONCEPTS QWERTY is the primary smartphone text input keyboard confgu- • Human-centered computing ! Text input; Accessibility. ration. However, insertion and substitution errors caused by hand tremors, often experienced by users with Parkinson’s disease, can KEYWORDS severely afect typing efciency and user experience. In this paper, Parkinson’s disease, text entry, QWERTY keyboard, touch model, we investigated Parkinson’s users’ typing behavior on smartphones. statistical decoding In particular, we identifed and compared the typing characteristics generated by users with and without Parkinson’s symptoms. We ACM Reference Format: then proposed an elastic probabilistic model for input prediction.
    [Show full text]
  • Text Blaster: a Multi-Player Touchscreen Typing Game
    Text Blaster: A Multi-Player Touchscreen Typing Game Figure 1: A group playing Text Keith Vertanen Per Ola Kristensson Abstract Blaster. Each player uses an Montana Tech University of St Andrews Text Blaster is a multi-player shoot 'em up game based on Android mobile device to control Butte, Montana USA St Andrews, UK players typing sentences on a mobile device's touchscreen their ship. The global state of [email protected] [email protected] keyboard. Players attempt to be the last player standing the game is shown on the large by using the speed, precision, and timing of their typing to projection wall. annihilate competing players. Our game utilizes a Justin Emge sentence-based decoding approach in which users type an Montana Tech entire sentence before our auto-correction algorithm infers Butte, Montana USA the most likely text. Text Blaster provides an engaging [email protected] and competitive game for use in investigating performance and design aspects of touchscreen text entry interfaces. Haythem Memmi Author Keywords Montana Tech Text entry; game design; touchscreen keyboard Butte, Montana USA [email protected] ACM Classification Keywords H.5.2 [Information interfaces and presentation: User Interfaces]: Input devices and strategies. Introduction Permission to make digital or hard copies of part or all of this work for In this paper we describe Text Blaster, a multi-player personal or classroom use is granted without fee provided that copies are not game that we created based around users typing sentences made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page.
    [Show full text]
  • Ye.Pdf (2.296Mb)
    MAUU(D)5900 MASTER THESIS in Universal Design of ICT October 2018 An Accessible Directions-based Text Entry Method Using Two-thumb Touch Typing Linghui Ye Department of Computer Science Faculty of Technology, Art and Design Master Thesis Phase III Report Contents Abstract ......................................................................................................................................................... 3 1. Introduction .............................................................................................................................................. 5 2. Related work ............................................................................................................................................. 8 3. The prototype ......................................................................................................................................... 15 3.1 Physical direction .............................................................................................................................. 20 3.2 Resolving ambiguities ....................................................................................................................... 23 3.3 Special characters ............................................................................................................................. 23 4. Methodology ........................................................................................................................................... 25 4.1 Experimental design .........................................................................................................................
    [Show full text]
  • Optimal-T9: an Optimized T9-Like Keyboard for Small Touchscreen Devices
    Session 4: Mobile and Wearable Text Entry ISS ’18 November 25–28, 2018, Tokyo, Japan Optimal-T9: An Optimized T9-like Keyboard for Small Touchscreen Devices ∗ Ryan Qin1 , Suwen Zhu2, Yu-Hao Lin2, Yu-Jung Ko2, Xiaojun Bi2 2 1 Department of Computer Science Ward Melville High School Stony Brook University East Setauket, New York, USA Stony Brook, New York, USA [email protected] {suwzhu, yuhalin, yujko, xiaojun}@cs.stonybrook.edu ABSTRACT notoriously error-prone and inefficient. Since 26 letters are T9-like keyboards (i.e., 3 × 3 layouts) have been commonly crammed into a small area, each key occupies a very tiny used on small touchscreen devices to mitigate the problem space. Also, because a finger is intrinsically an inaccurate of tapping tiny keys with imprecise finger touch (e.g., T9 input device (a.k.a., Fat finger problem), it is extremely dif- is the default keyboard on Samsung Gear 2). In this paper, ficult to accurately land the input finger on the tiny intended we proposed a computational approach to design optimal T9- key when typing on such a keyboard. like layouts by considering three key factors: clarity, speed, To cope with this challenge, many manufacturers and users and learnability. In particular, we devised a clarity metric to have adopted multi-letter key layouts (i.e., each key may cor- model the word collisions (i.e., words with identical tapping respond to multiple letters), especially on devices with small sequences), used the Fitts-Digraph model to predict speed, touchscreen. For example, the default input method on Sam- and introduced a Qwerty-bounded constraint to ensure high sung Gear 2 is T9 [15]; a number of multi-letter key key- learnability.
    [Show full text]