(12) United States Patent (10) Patent No.: US 9,165,478 B2 Carro Et Al
Total Page:16
File Type:pdf, Size:1020Kb
US009 165478B2 (12) United States Patent (10) Patent No.: US 9,165,478 B2 Carro et al. (45) Date of Patent: Oct. 20, 2015 (54) SYSTEMAND METHOD TO ENABLE BLIND (56) References Cited PEOPLE TO HAVE ACCESS TO INFORMATION PRINTED ON A PHYSICAL U.S. PATENT DOCUMENTS DOCUMENT 4,644,339 A 2, 1987 Ruder 4,996,707 A 2/1991 O'Malley et al. (75) Inventors: Fernando Incertis Carro, Valencia 5,223,828 A 6/1993 McKiel, Jr. (ES); Sharon M. Trewin, 5,267,331 A 11, 1993 Swoff Croton-on-Hudson, NY (US) 5,287,102 A 2/1994 McKiel, Jr. 5,325,123 A 6/1994 Bettinardi (73) Assignee: International Business Machines 5,359,675 A 10, 1994 Swoff Corporation, Armonk, NY (US) 5,374,924 A 12/1994 McKiel, Jr. (Continued) (*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 OTHER PUBLICATIONS U.S.C. 154(b) by 3629 days. "Talking Books SpeakVolumes”. Kendra Mayfield, Wired News, Jul. 13, 2000, 4 pgs. http://www.wired.com/news/gizmost (21) Appl. No.: 10/826,810 0,1452,375,00.html. (22) Filed: Apr. 15, 2004 (Continued) (65) Prior Publication Data Primary Examiner — Steven B. Theriault US 2005/0022.108A1 Jan. 27, 2005 (74) Attorney, Agent, or Firm — Schmeiser, Olsen & Watts, LLP: John Pivnichny (30) Foreign Application Priority Data Apr. 18, 2003 (EP) ..................................... O3368O35 (57) ABSTRACT (51) Int. C. A method and system for use in a user system, for accessing G06F 3/048 (2013.01) information related to a physical document. An electronic G09B 2L/00 (2006.01) copy of an existing physical document is identified and G06F 3/048. I (2013.01) located. The electronic copy of the physical document is an GO6F 3/OI (2006.01) exact replica of the physical document. One or more pages of GO6F 3/0488 (2013.01) the physical document are identified. A selected part of the GO6F 3/0484 (2013.01) physical document is identified using the position of points on the identified one or more pages of the physical document and (52) U.S. C. in response, data related to the selected part of the physical CPC ............ G09B 21/001 (2013.01); G06F 3/0481 document is retrieved from the electronic copy of the physical (2013.01); G06F 3/016 (2013.01); G06F document. The retrieved data is presented visually to a visu 3/04842 (2013.01); G06F 3/04886 (2013.01) ally impaired person or orally to a blind person on the user (58) Field of Classification Search CPC. G06F 3/0481; G06F 3/04886; G06F 3/016: system, which enables the visually impaired person to see or G06F 3/0488; G06F 3/04842 hear, respectively, the retrieved data. USPC .................................................. 715/702, 865 See application file for complete search history. 26 Claims, 12 Drawing Sheets Web server (806) Touf Physical document 802) 801) US 9,165.478 B2 Page 2 (56) References Cited 2002/0101447 A1* 8, 2002 Carro ............................ 345,760 2002/015223.6 A1* 10, 2002 Incertis-Carro . 707/5O11 U.S. PATENT DOCUMENTS 2002fO156866 A1* 10, 2002 Schneider .... TO9.218 2003/01 17378 A1* 6/2003 Carro ............................ 345,173 5,400,434 A 3, 1995 Pearson 2003/01 17379 A1* 6/2003 Carro ............................ 345,173 5,461.416 A 10, 1995 Bettinardi 2003,019 1852 A1* 10, 2003 Incertis . TO9,232 5,561,736 A 10, 1996 Moore et al. 2004/0021648 A1* 2, 2004 Blume .. ... 345,179 5,586, 196 A * 12/1996 Sussman ....................... 382,114 2004/0091842 A1* 5, 2004 Carro .... ... 434/112 5,617,507 A 4/1997 Lee et al. 2005, 0028092 A1* 2, 2005 Carro .... T15,526 5,630,060 A 5/1997 Tang et al. 2006/0098899 A1* 5/2006 King et al. .................... 382,305 5,633,674. A * 5/1997 Trulaskeet al. ................ 348.63 5,634,084 A 5, 1997 MalSheen et al. OTHER PUBLICATIONS Sg A EE St. et al. “Paper is Still With us”, Philippa Jane Benson, The Journal of Elec 5715.412 A 2, 1998 Aritsuka et al. tronic Publishing, University of Michigan Press, 7 pgs. http://www. 5.841,979 A 11/1998 Schulhofetal. press.umich.edu/jep/07-02/benson0702.htm. 5,900,908 A 5, 1999 Kirkland “Electronic Journals: What Do Users Think of Them?', Dr. Cliff 5,960,448 A * 9/1999 Reichek et al. ............... T15,236 McKnight, Department of information and Library Studies, 6,018,710 A 1/2000 Wynblatt et al. Loughborough University, Loughborough, Leics LE11 3TU, UK, 7 6,084,556 A 7/2000 Zwern pgs. http: Scholar.google.com/scholar?q=casch.edXCCig2FZQJ: 6,085,161 A 7/2000 MacKenty et al. www.dlulis.ac.jp/ISDL97 pro . 6,088,675 A * 7/2000 MacKenty et al. ........... 7041270 “A Comparison of Reading Paper and On-Line Documents”. 6,115,482 A * 9/2000 Sears et al. .................... 382,114 “Children with Visual Impairment and their Reading: A Comparison 6,127,990 A 10/2000 Zwern Between Reading From Paper and Computer Screen'. E. Kellami, G. 6,184,847 B1 2/2001 Fateh et al. Douglas, R. Long, School of Education, University of Birmingham. 6,289,304 B1 9, 2001 Grefenstette “Fourteen Users in Search of a Newspaper: The Effect of Expectation 6,308,151 B1 10/2001 Smith on Online Behaviour'. Ann Light, School of Cognitive and Comput 6,324,511 B1 * 1 1/2001 Kiraly et al. .................. TO4,260 6.731.315 B1* 5, 2004 Ma et al. ....................... 715,856 ing Sciences, University of Sussex, CSRP 507. 6.731326 B1 5/2004 Bettinardi ....................... 348.63 “The Integration of Low Vision Aids and Other Assistive Devices in 6,823, 184 B1 * 1 1/2004 Nelson .......................... 455,418 Educational and Vocational Settings'. Matthew H. ATer, krista M. 6,940,491 B2 9, 2005 Carro Davis, O.D., Columbia Lighthouse for the Blind, Washington, DC. 6,980,202 B2 * 12/2005 Carro ............................ 345,173 Bell Labs Projects. Multillingual Text-to-Speech Systems, 3 pgs. 7,000, 189 B2* 2/2006 Dutta et al. 71.5/727 http://www.bell-labs.com/project/tts/index.html. 7,013,279 B1* 3/2006 Nelson ... 704/270 Bell Labs Spanish Text-to-Speech Systems, 1 pg. http://www.bell 7,027,038 B2 4/2006 Carro. 345,173 labs.com/project/tts/spanish.html. 7,181,692 B2 2/2007 Siegel . 715/727 IBM TDB; Light pen to use with a transparent electro-luminiscent 7, 194411 B2 3/2007 Slotznicket al. ............. 704/271 display; IP.com No.: IPCOMO00016405D; Original Publication 7,472.3387.212,318 B2 * 12,5/2007 2008 CarroBradbery ...................... 358/474 Dateate NOW.Nov. 5u,30, 2002;ZUU2; IP.comIP Electronic Publication JunJun. 21.21, 2003:ZUU5; 3 7473670 B2 1/2009 Takahashi et al. ............ 505/470 Pages. http://www.ip.com/pubview/IPCOMO00016405D. 2001/0056435 Al 12/2001 Carro ......................... 707 500.1 Patent application for Application No. 14/696,815, filed Apr. 27, 2002/004787.0 A1 4, 2002 Carro 2015. 2002/0069240 A1* 6/2002 Berk ............................. TO9,203 2002/0087598 A1* 7/2002 Carro ............................ 707/513 * cited by examiner U.S. Patent Oct. 20, 2015 Sheet 1 of 12 US 9,165.478 B2 Web servers still Web server EEE (1 O6) www.virgin.net INTERNET NETWORK Visually impaired user User Workstation Touch foil Physical document (102) (101) Early British Kingdoms David Nash Ford reader Document URL barcode (103) (107) U.S. Patent Oct. 20, 2015 Sheet 2 of 12 US 9,165.478 B2 Page number codes are (205) located on Af. bottom left and Early British Kingdoms, by bottom right David Nash corners of g d aS pages ... OO. Ser Workstation (204) Touch foil (202) Physical document (201) Early British Kingdoms David Nash Ford C. Celtic World Ltd, Bigfield, Berkshire, UK (1999) Barcode reader tip/?www.virgin.net/ 17030 (203) Document URL barcode (207) FIG. 2 U.S. Patent Oct. 20, 2015 Sheet 3 of 12 US 9,165.478 B2 bookmark (300) Arthur the Myth Afallach, God of the Underworld Some people believe that King Arthur is so inedricably tied up in Celtic Afallach was the son of Lludd Llaw Ereint (the Silver-Handed). Mytholigy that he must, in origin, have been, not a man at all, but a God He was one of the Celtic gods of the Underworld He ruled Like so many other characters featured in the Malingion, Arthur in his Avalon where he lived with his daughter, Modron, and her nine earliest form, appears almost entirely mythical He and his companions sisters, Avalon was like the Celtic heaven, a peaceful island far have superhuman strength and abilities, and consort with giants and other away where apples grew and after which it became named. It is, mythological creatures. of course, best known as the place where the High-King Arthwyr in the early Welsh poem "Preiddy Annwfn', Arthur visits the Celtic was taken after he was fataly wounded at the Battle of Camlann. Underworld, Annwfn, Even in Geoffrey and Malory, upon being fataly Afallach himself appears in Arthurian legends as King Evelake. wounded in battle, Arthur is carried to the mystical Avalon, apparently the Underworld home of the Celtic god, Afallach. Many gends around the country attest to Arthur's immortality for he ships in one of mumerous The name Arthur itself appears to drive from the Celtic word taves waiting to return and lead his people, The nate Arthur itself Art, meaning "bear". CouldArthur, like so many other Celtic gods, appears to derive from the Celtic word Art, meaning "hear". Could Arthur, be merely a personification of the many revered animals of the like so many other Celtic gods, be merely a personification of the many wild? Later to become humanized like Beli Mawr or Bran the 8.