DOCSLIB.ORG

Handwriting Recognition

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Handwriting Recognition York University – Department of Computer Science and Engineering Handwriting Recognition: The Case for Unistrokes (and how to roll your own recognizer) I. Scott MacKenzie York University 1 York University – Department of Computer Science and Engineering Plan • Pen-based computing • Unistrokes • Recognition • Demo 2 1 York University – Department of Computer Science and Engineering The Pen as an Input Device • Advantages • considerable existing skill • good for annotating, sketching, etc. • handwriting is natural • Disadvantages • handwriting recognition is hard! • in early products, goods delivered did not live up to promises • Goal of “natural handwriting recognition” is elusive 3 York University – Department of Computer Science and Engineering 4 2 York University – Department of Computer Science and Engineering Pen-Based Computers (1989-1995) GRiDPad (Grid) 325 Point (Fujitsu) MessagePad 2100 (Apple) 5 York University – Department of Computer Science and Engineering PalmPilot • Introduced in 1996 by Palm Computing (now 3Com) • First successful pen-based system or PDA (personal digital assistant) • Handwriting recognition using Graffiti • Brainchild of Jeff Hawkins • Founder of Palm (and formerly Grid) 6 3 York University – Department of Computer Science and Engineering Plan • Pen-based computing • Unistrokes • Recognition • Demo 7 York University – Department of Computer Science and Engineering Unistrokes • What is a Unistroke? • A single stylus or finger gesture • Begins when stylus touches tablet surface • Ends when stylus is raised from tablet surface • Each “symbol” is one stroke 8 4 York University – Department of Computer Science and Engineering Unistrokes vs. Graffiti • Unistrokes • Invented by David Goldberg, Xerox PARC a • Patent held by Xerox (issued Jan. 1997) • First presented at INTERCHI ’93 • Graffiti • An ‘example’ of unistrokes • Commercial product • 3COM PalmPilot, HP Omnigo, etc. a Goldberg, D., & Richardson, C. (1993). Touch-typing with a stylus. Proceedings of the INTERCHI '93 Conference on Human Factors in Computing Systems, 80-87. New York: ACM. 9 York University – Department of Computer Science and Engineering Unistrokes Goal: Fast for experts 10 5 York University – Department of Computer Science and Engineering Graffiti Goal: Easy for novices See… MacKenzie, I. S., & Zhang, S. (1997). The immediate usability of Graffiti. Proceedings of Graphics Interface '97, pp. 129-137. Toronto: Canadian Information Processing Society. 11 York University – Department of Computer Science and Engineering Application (TV Remote Control) See… Enns, N., & MacKenzie, I. S. (1998). Touch-based remote control devices. Extended Abstracts of the CHI '98 Conference on Human Factors in Computing Systems, 229-230. New York: ACM. 12 6 York University – Department of Computer Science and Engineering Application (Touchscreen Phone) See… Tinwala, H, & MacKenzie, I. S. (2009). Eyes-free text entry on a touchscreen phone. Proceedings of the IEEE Toronto International Conference – Science and Technology for Humanity – TIC-STH 2009, pp. 83-88. New York: IEEE. 13 York University – Department of Computer Science and Engineering Plan • Pen-based computing • Unistrokes • Recognition • Demo 14 7 York University – Department of Computer Science and Engineering Steps for Recognition • Input x,y coordinates for unistroke • Determine if stroke is a straight line (if so, done!) • Determine min and max for x and y • Normalize points to fit in unit bounding box • Note: box has four quadrants... 15 York University – Department of Computer Science and Engineering Steps (2) 3 0 2 1 16 8 York University – Department of Computer Science and Engineering Steps (3) • Scan points and gather characteristics of stroke: • 1st quadrant • 2nd quadrant • 2nd last quadrant • last quadrant • cumulative x motion (e.g. ‘Z’ = 3) • cumulative y motion (e.g., ‘Z’ = 1) 17 York University – Department of Computer Science and Engineering Steps (3) • starting x direction (+ve, -ve) • starting y direction (+ve, -ve) • stopping x direction (+ve, -ve) • stopping y direction (+ve, -ve) • Compare stroke characteristics with dictionary entries • Find match, done 18 9 York University – Department of Computer Science and Engineering Dictionary Entries • Each entry contains • symbol (the ‘output’) • 1st quadrant • 2nd quadrant • 2nd last quadrant • last quadrant • min cumulative x • max cumulative x 19 York University – Department of Computer Science and Engineering Dictionary Entries (2) • min cumulative y • max cumulative y • starting x motion (+ve, -ve, don’t care) • starting y motion (+ve, -ve, don’t care) • stopping x motion (+ve,-ve, don’t care) • stopping y motion (+ve, -ve, don’t care) • Note: can have multiple entries for each symbol (e.g.cw“0”,ccw“0”) 20 10 York University – Department of Computer Science and Engineering Example Symbol B 3 0 1st quad 2 2nd quad 3 n-1 quad 1 n quad 2 kx min 2.2 kx max 4 ky min 1.5 ky max 2.5 start x don’t care start y + stop x - stop y don’t care 2 1 21 York University – Department of Computer Science and Engineering Plan • Pen-based computing • Unistrokes • Recognition • Demo 22 11 York University – Department of Computer Science and Engineering 23 York University – Department of Computer Science and Engineering Thank You 24 12.
Load more

Recommended publications
  • Toward a Theory of Consumer Interaction with Mobile Technology Devices
    University of Tennessee, Knoxville TRACE: Tennessee Research and Creative Exchange Doctoral Dissertations Graduate School 8-2009 Toward a Theory of Consumer Interaction With Mobile Technology Devices Charles Scott Rader University of Tennessee - Knoxville Follow this and additional works at: https://trace.tennessee.edu/utk_graddiss Part of the Business Administration, Management, and Operations Commons Recommended Citation Rader, Charles Scott, "Toward a Theory of Consumer Interaction With Mobile Technology Devices. " PhD diss., University of Tennessee, 2009. https://trace.tennessee.edu/utk_graddiss/104 This Dissertation is brought to you for free and open access by the Graduate School at TRACE: Tennessee Research and Creative Exchange. It has been accepted for inclusion in Doctoral Dissertations by an authorized administrator of TRACE: Tennessee Research and Creative Exchange. For more information, please contact [email protected]. To the Graduate Council: I am submitting herewith a dissertation written by Charles Scott Rader entitled "Toward a Theory of Consumer Interaction With Mobile Technology Devices." I have examined the final electronic copy of this dissertation for form and content and recommend that it be accepted in partial fulfillment of the equirr ements for the degree of Doctor of Philosophy, with a major in Business Administration. Daniel J. Flint, Major Professor We have read this dissertation and recommend its acceptance: David W. Schumann, Ernest R. Cadotte, Ronald E. Taylor Accepted for the Council: Carolyn R. Hodges Vice Provost and Dean of the Graduate School (Original signatures are on file with official studentecor r ds.) To the Graduate Council: I am submitting herewith a dissertation written by Charles Scott Rader entitled “Toward a Theory of Consumer Interaction with Mobile Technology Devices.” I have examined the final electronic copy of this dissertation for form and content and recommend that it be accepted in partial fulfillment of the requirements for the degree of Doctor of Philosophy with a major in Business Administration.
    [Show full text]
  • Why Did Apple Kill Newton?
    From Pen Computing Magazine #22, June 1998 Why Did Apple Kill Newton? ©Copyright 1998 David MacNeill Early Friday morning, February 27, 1998, Apple Computer made official what the Newton cognoscenti had strongly suspected for six months: the Newton handheld computing platform was dead. The rather terse press release gave the basic facts: Apple will cease all Newton OS hardware and software development, no more products will be made after the existing stock is depleted, and Apple will continue to provide support to users. Brief mention was made of development of a new low-cost Mac OS-based mobile device in the future, but no details were offered. But the most galling omission was the lack of an answer to the question on the minds of hundreds of thousands of shocked, angry Newton owners: Why? Before I attempt to answer this question, let’s take a quick tour of the mercurial five-year career of Newton. This will serve to prepare you for the several explanations we will be considering. A brief history of Newton During its turbulent five-year life, Newton technology was close to death several times, yet always managed to survive. Department heads came and went, but the essential concept of the personal digital assistant (PDA) was too compelling to die easily: A small, inexpensive, pen-based computing device that would accompany you everywhere, and that would learn enough about you to make informed assumptions about how to help you keep track of the myriad little bits of information we all must carry. It would be simple enough for anyone to use, a true computer for the rest of us.
    [Show full text]
  • List of Palm OS Versions Included on Palm Handhelds, and Possible Upgrades
    List of Palm OS versions included on Palm handhelds, and possible upgrades www.palm.com < Home < Support < Knowledge Library Article ID: 10714 List of Palm OS versions included on Palm handhelds, and possible upgrades Palm OS® is the operating system that drives Palm devices. In some cases, it may be possible to update your device with ROM upgrades or patches. Find your device below to see what's available for you: Centro Treo LifeDrive Tungsten, T|X Zire, Z22 Palm (older) Handspring Visor Questions & Answers about Palm OS upgrades Palm Centro™ smartphone Device Palm OS Handheld Palm OS version Palm Desktop & version (out- Upgrade/Update after HotSync Manager of-box) available? upgrade/update update Centro (AT&T) 5.4.9 No N/A No Centro (Sprint) 5.4.9 No N/A No Treo™ 755p smartphone Device Palm OS Handheld Palm OS version Palm Desktop & version (out- Upgrade/Update after HotSync Manager of-box) available? upgrade/update update Treo 755p (Sprint) 5.4.9 No N/A No Treo™ 700p smartphones Device Palm OS Handheld Palm OS version Palm Desktop & version (out- Upgrade/Update after HotSync Manager of-box) available? upgrade/update update Treo 700p (Sprint) Garnet Yes N/A No 5.4.9 Treo 700p (Verizon) Garnet No N/A No 5.4.9 Treo™ 680 smartphones Device Palm OS Handheld Palm OS version Palm Desktop & version (out- Upgrade/Update after HotSync Manager of-box) available? upgrade/update update Treo 680 (AT&T) Garnet Yes 5.4.9 No 5.4.9 Treo 680 (Rogers) Garnet No N/A No 5.4.9 Treo 680 (Unlocked) Garnet No N/A No 5.4.9 Treo™ 650 smartphones Device Palm OS
    [Show full text]
  • Tealtracker User's Manual Table of Contents
    TealTracker User's Manual Program Version 1.44 Last Updated: October 4, 2010 Table of Contents Introduction..................................................................................................................... 1 Description.........................................................................................................................1 Contents ............................................................................................................................1 PalmOS Files (.ZIP Archive)............................................................................................1 Windows Mobile Files (.EXE Installer) ..............................................................................1 Windows Desktop PC File (.EXE Program) ......................................................................1 Installing the Program .........................................................................................................2 Chapter 1 – Overview.................................................................................................... 3 Main Screen.......................................................................................................................3 Time-Clock View ............................................................................................................3 Manual Entry View..........................................................................................................3 Chapter 2 – Accounts ..................................................................................................
    [Show full text]
  • Palm OS Is One of the Most Popular Handheld Operating Systems on the Planet
    Palm and Treo Hacks By Scott MacHaffie ............................................... Publisher: O'Reilly Pub Date: October 2005 ISBN: 0-596-10054-X Pages: 234 Table of Contents | Index Palm OS is one of the most popular handheld operating systems on the planet. From the newest Tungstens and Treos all the way down the family tree, Palms are everywhere. Although the Palm OS is simple to learn and use, there is more to it than meets the eye--from new features in the Palm to capabilities you can get with add-on software, the Palm can be made to do quite a lot. Palm and Treo Hacks gives you tips and tools that show you how to make the most of your Palm. A few minutes spent reading some of the hacks in this book will save you hours of research. Inside this book, you'll learn how to: Find great applications for your Palm and make the most of the ones you're using now Get super-organized, getting more from the built-in Personal Information Manager and learning how to manage complex projects with your Palm Extend the Palm with must-have software and hardware add-ons Take your Palm online, reading email, surfing the web, and sending instant messages Get some rest and relaxation with your Palm, whether it's listening to music, playing classic games, or watching video Written for beginning to experienced Palm users, Palm and Treo Hacks is full of practical, ingenious tips and tricks you can apply immediately. Whether you're looking to master the built-in applications or you want to trick out your Palm to its fullest extent, this book will show you how to get it.
    [Show full text]
  • Downloaded in Jan 2004; "How Smartphones Work" Symbian Press and Wiley (2006); "Digerati Gliterati" John Wiley and Sons (2001)
    HOW OPEN SHOULD AN OPEN SYSTEM BE? Essays on Mobile Computing by Kevin J. Boudreau B.A.Sc., University of Waterloo M.A. Economics, University of Toronto Submitted to the Sloan School of Management in partial fulfillment of the requirements for the degree of MASSACHUBMMIBE OF TECHNOLOGY Doctor of Philosophy at the AUG 2 5 2006 MASSACHUSETTS INSTITUTE OF TECHNOLOGY LIBRARIES June 2006 @ 2006 Massachusetts Institute of Technology. All Rights Reserved. The author hereby grn Institute of Technology permission to and to distribute olo whole or in part. 1 Signature ot Author.. Sloan School of Management 3 May 2006 Certified by. .............................. ............................................ Rebecca Henderson Eastman Kodak LFM Professor of Management Thesis Supervisor Certified by ............. ................ .V . .-.. ' . ................ .... ...... Michael Cusumano Sloan Management Review Professor of Management Thesis Supervisor Certified by ................ Marc Rysman Assistant Professor of Economics, Boston University Thesis Supervisor A ccepted by ........................................... •: °/ Birger Wernerfelt J. C. Penney Professor of Management Science and Chair of PhD Committee ARCHIVES HOW OPEN SHOULD AN OPEN SYSTEM BE? Essays on Mobile Computing by Kevin J. Boudreau Submitted to the Sloan School of Management on 3 May 2006, in partial fulfillment of the requirements for the degree of Doctor of Philosophy Abstract "Systems" goods-such as computers, telecom networks, and automobiles-are made up of mul- tiple components. This dissertation comprises three esssays that study the decisions of system innovators in mobile computing to "open" development of their systems to outside suppliers and the implications of doing so. The first essay considers this issue from the perspective of which components are retained under the control of the original innovator to act as a "platform" in the system.
    [Show full text]
  • Palm™ Macpac. with the Palm Macpac, You and Your Macintosh, You Want
    ® Palm™ MacPac includes: Instant access to your important information. • CD-ROM with Palm™ Desktop 2.0 v 2 and user documentation With any 3Com® connected organizer, it’s easy to make organizing easier. You can view your data • Getting Started Guide • Palm Cradle serial adapter cable take your important information with you. And now, in customizable lists so you see the information ™ • International Technical Support Card Palm™ MacPac. with the Palm MacPac, you and your Macintosh, you want. It lets you memorize those lists so you Palm™ Desktop 2.0 v 2 includes: can be connected as well. It’s the organizing system can instantly switch views to the one that’s most • Calendar (Date Book) you’ve been waiting for. convenient. • Contacts (Address Book) There are special printing options that allow • Tasks (To Do List) The perfect companion to your Mac. you to print labels, address lists, calendars, task • Notes (Memo Pad) The Palm MacPac with Palm™ Desktop software lists, faxes, even print in color. • Desktop import and export formats: TAB delimited and TXT was designed especially for Macintosh users. It is a In addition, there’s an Instant Find feature System Requirements The easy way native Mac OS application, so you know it’s fast and that lets you find contacts quickly and create • Palm Computing® platform handheld reliable. It requires only 1.5MB of RAM to run, so it custom lists for mailings by location, company, • Any Apple Macintosh or compatible for Macintosh won’t bog your system down. And because it was or category. Instant Links–using AppleScript computer with a Power PC processor designed for the Palm Computing® platform, it gives technology–let you write a letter using popular • System 7.5.3 or later users to get • CD-ROM drive you access to a host of Mac applications that are word processing programs or link to a website* being developed for it.
    [Show full text]
  • Emergence Innovation Expansion Perspectives
    8-1/2" 8-1/2" New name. New magazine. Winter 2003 Issue 1 $4.95 Emergence Palm/Handspring into action as one. Page 3 Innovation NEW! Treo ™ 600 smartphone No compromises. Page 4 11" New products. New solutions. Same great value. palmOne® Presorted Standard 400 N. McCarthy Blvd. U.S. Postage Mail Stop 4209 PAID Milpitas, CA 95035 Sacramento, CA Expansion Permit No. 333 NEW! Tungsten™ T3 handheld Promo Code: PMAG1 Stretches viewpoints. John Sample Page 6 123 Main Street Anytown, ST 99999-9999 John Sample, s1234512345s Tepad be kelag diroplay ryepe espad a Perspectives nolonipy rediopy a sowdy. Lyepe espad a NEW! Zire™ 71 handheld nolonipy kelag in sowd rediopy a espay. Tepad be kelag diroplay ryepe espad a Capture the highlights. nolonipy rediopy a sowdy. Page 14 17" CRT-302 • PALM • PALMONE CATALOG FLAT SIZE 17" X 8-1/2" • FOLD SIZE 8-1/2" X 11" FRONT/BACK SPREAD • crt302_catalog.qxd 8-1/2" 8-1/2" palmOne magazine Which handheld is right for you? 12 We’ll help you decide. Winter 2003 Issue 1 Compare the features. Choose one. Or several. We have suggestions for upgrading, too. In this Issue Now from palmOne. 14 You’ll always have a camera – Phone or handheld? Get both in one. any time you need it. 4 Meet the new Treo™ 600 smartphone – small, Snap: It’s a digital camera. Share: It’s an organizer. ™ simple to use with a built-in QWERTY keyboard, It’s called the Zire 71 handheld. plus wireless communications. 16 The gift that’s as easy to use as it is to give.
    [Show full text]
  • Security Use a Smartphone As Your Lockbox Key! Centro Now Certified!
    GE Security Use a smartphone as your lockbox key! Centro now certified! Many agents now use a smartphone or PDA to beam open Supra iBoxes. You can, too, when you subscribe to eKEY service from GE Security! Check with your Board, Association, or MLS for availability of eKEY service in your area. What are smartphones? What are PDA’s? PDA is short for Personal Digital Assistant, commonly called “PalmPilot.” A PDA consolidates your calendar, contacts and other paper systems into one small device you’ll always have with you in your pocket or purse. A smartphone is a PDA that is also a cell phone. Most smartphones include high-speed Internet access, email and other real estate-friendly features, including camera, calculators voice memo capability and more. What is eKEY service? There are two levels of eKEY service. eKEY Basic allows you to open and program your own iBoxes. eKEY Professional adds MLS listing information, maps, agent roster and showing details to your device. With eKEY Professional, you can do business any time, anywhere. See feature comparison chart below. How does an eKEY update? If you are using a smartphone with wireless Internet access, your eKEY will update by itself overnight. If you do not have wireless Internet access, you may update your smartphone through your PC. If you have eKEY service on your PDA, you may update with your PC over your high-speed Internet connection using the factory-supplied PDA cable or cradle. Current smartphone devices Here are the current smartphone devices certified for eKEY service and the wireless carriers supporting them.
    [Show full text]
  • Introduction to Pdas
    c01_02847 9/13/02 11:56 AM Page 1 CHAPTER 1 Introduction to PDAs his chapter provides a brief history of the evolution of mobile wireless databases and introduces the Personal Digital Assistant, or PDA, and typical PDA envi- Tronment. The purpose is to detail all the pieces of this technology at a high level. For those with no knowledge of PDAs, this chapter is an absolute necessity. The Basics The PDA environment and units can be very simple or quite advanced, depending on your level of technical expertise and usage. The term PDA is highly used, but it should really be handheld computer or handheld PC. PDA was initially used because the units mainly contained a daily calendar, personal address book, calculator, to-do list, perhaps a currency exchange program, and usually an international time zone map. In this respect, these units were indeed personal digital assistants, as people would forgo their usually big per- sonal calendar and to-do agendas for these little electronic machines. I remem- ber back in the early 1990s when I received my first PDA, a Texas Instruments digital assistant. I entered all the telephone numbers for all the people I knew, along with their addresses and whatever comments I could find such as birth- days, anniversaries, and upcoming special events. It was fantastic—the calen- dar would sound an alarm on the days I marked for notification. In meetings, I could take brief (very brief) notes and was a whiz with my fancy calculator 1 c01_02847 9/13/02 11:56 AM Page 2 2 CHAPTER 1 that really couldn’t do much more than just the basic functions.
    [Show full text]
  • Handbook for the Palm III™ Organizer Copyright
    Handbook for the Palm III™ Organizer Copyright Copyright © 1998 3Com Corporation or its subsidiaries. All rights reserved. 3Com, the 3Com logo, Palm Computing, Palm Modem, Graffiti, and HotSync are registered trade- marks, and PalmPilot, Palm III, Palm OS, Palm, the Palm Computing Platform logo, the Palm III logo, and the HotSync logo are trademarks of Palm Computing, Inc., 3Com Corporation or its subsidiaries. Other product and brand names may be trademarks or registered trademarks of their respective owners. Disclaimer and Limitation of Liability 3Com Corporation and its subsidiaries assume no responsibility for any damage or loss resulting from the use of this handbook. 3Com Corporation and its subsidiaries assume no responsibility for any loss or claims by third parties which may arise through the use of this software. 3Com Corporation and its subsidiaries assume no responsibility for any damage or loss caused by deletion of data as a result of malfunction, dead battery, or repairs. Be sure to make backup cop- ies of all important data on other media to protect against data loss. Important: Please read the 3Com End User Software License Agreement contained in this handbook before using the accompanying software program(s). Using any part of the software indicates that you accept the terms of the 3Com End User Software License Agreement. 3.5" Software Diskettes Available Palm™ Desktop software is supplied on a CD-ROM disc. If you do not have access to a CD-ROM drive for your computer, you may download the Palm Desktop software from http://www.palm.com. Alternatively, you can order 3.5" diskettes by completing and mailing the diskette order card supplied in the Palm III™ organizer product package, or call to order the diskettes.
    [Show full text]
  • Palm (A): the Debate on Licensing Palm's OS (1997)
    N9-708-514 MAY 20, 2008 RAMON CASADESUS- MASANELL KEVIN BOUDREAU JORDAN MITCHELL Palm (A): The Debate on Licensing Palm’s OS (1997) Shortly after the acquisition of Palm’s parent US Robotics by 3Com in February 1997, 3Com’s CEO, Eric Benhamou, began applying pressure on Palm executives to open up the Palm OS (operating system) to other handheld computer manufacturers. Benhamou pointed to the PC (personal computer) market as evidence that opening up a platform to other firms spurred on hardware development, grew the size of the market and ensured the dominance of one operating system. Specifically, Apple was trotted out as an example of losing out to Microsoft by refusing to license out the Mac OS operating system to other manufacturers such as Hewlett-Packard (HP), Compaq and Dell. Some of the popular press had even proclaimed the downright demise of Apple; Business Week had declared, “The death of an American icon,” on a cover story about Apple in 1996. In contrast, Microsoft Windows had grown to control over 90 per cent of all OSs on PCs by forming broad licensing agreements with original equipment manufacturers (OEMs). 3Com executives were adamant that Palm’s future should not follow Apple’s downfall in the PC market. The message from 3Com was clear: “[Palm should] license early and license broadly, before Microsoft takes [the] market away.”1 Palm’s co-founders – Jeff Hawkins (Product Technology) and Donna Dubinsky (CEO) – argued fervently against Benhamou and 3Com executives. Hawkins and Dubinsky claimed that the market for handhelds was distinct to the PC market.
    [Show full text]