US 2005.0022.108A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2005/0022.108A1 Carro et al. (43) Pub. Date: Jan. 27, 2005

(54) SYSTEMAND METHOD TO ENABLE BLIND Publication Classification PEOPLE TO HAVE ACCESS TO INFORMATION PRINTED ON A PHYSICAL (51) Int. Cl." ...... G06F 17/21 DOCUMENT (52) U.S. Cl...... 715/500 (75) Inventors: Fernando Incertis Carro, Valencia (57) ABSTRACT (ES); Sharon M. Trewin, The present invention is directed to a user System, a method Croton-on-Hudson, NY (US) for use in a user System, and a computer program for Correspondence Address: accessing information related to a physical document. The John R. Pivnichny method comprises the Steps of: IBM Corporation identifying a physical document; IP Law Dept. IQ0A, Bldg. 40-3 1701 North Street identifying and locating an electronic copy of Said Endicott, NY 13760 (US) identified document; identifying one or a plurality of pages of Said physical (73) Assignee: INTERNATIONAL BUSINESS document and identifying a part of the identified MACHINES CORPORATION, physical document using the position of points ARMONK, NY pressed on a touch foil Successively placed and (21) Appl. No.: 10/826,810 aligned over or under Said identified pages, retrieving from the electronic copy of the physical (22) Filed: Apr. 15, 2004 document, data related to the Selected part of the document; (30) Foreign Application Priority Data presenting Said retrieved data Visually or orally on the Apr. 18, 2003 (EP)...... O3368O35.6 user WorkStation.

(406)

Page sixteen ')

User workstation (404) Physical document (401)

Arthur the Myth Sorryl in it king Arthur is so interially tied in Chi Afallad, Godf the Underworld

Aillai was a sang Lullirwearinth Sker-Harth). Ayigyitkits, it argin, aveler, no trian at that a gal He was are far sieged file Linderworld is led Likew any other darusterialised at the Mangor, ins Awakat where iwi with his dage, fadra, and her nine wrist form, pearsaios intirely rythical ri and biotipeniors sisters. Awake was is the Cirque, swiful islandar

have spectorian sing and abilitics, and consor will tsaraket away wrappisgrew figfier with it east finited it is, nylogical crafts, fears, best known as the place where is Hig-Kag Arthyr was taken frews fataly wounded a dy Built fomain, it is cary tipwm "Pridia Anifa', its the Clie afia intrappears in arteria kends as Kigwile Underwortantril. Even in Geffrey and aper bigaially

wanded in batti, Arikar is arried to k mistiaataka, actrerily ir ------m-m-m-m-m-m-m-m-m-m-m-m- Underworlong is chigi,Rach. enkaroit is coastry triest is Arthur's irritorialisiri is in ore frateria The name Arthristiears to drieficit is callie ward are wing to retan aridiaspapil. Thian Arier listi Artisatig'ar'. Coibarski, iess array pier Cligod, ar' could artiar be titary a prisonificalia fruary evered initials of the spears orite for it Cilic word Art, ification far naty willparissuanesaarisellie Bali Mawr y Branike is so many of Cixi, a tery a rendeninsk fae ultipater heroenkatanizedikr Bei Miner of Breditorsisation of itsatavror the Great &mri, after aisalinas known as alrth's at ere was ided Bank Blissed consulating Urs Major or de Great Bears, a lir Rear-Gx airis, wripped in Switzerland and avia firi, antines know is Archer' fail it was inded a chic irr, at she was, infar, dolls ?tridder is is trace of ki Bar-artis worshipeii, Switzerland reindle, but she was, ia Britisone horists raint artig was a late lition to the it fact, allis sittier it is trait frr in Briain sat arisis Celtic pander duriga resente bipgen worship, or claimarihir was a tradition of Chipants trigg besiegesire it, arrasiyagdiker, the pringsfailurian. - 7 •r's III

s

Touch foil

(402) Page bar code (405) Patent Application Publication Jan. 27, 2005 Sheet 1 of 12 US 2005/0022.108A1

i i E. Web SeWer (106)

www.virgin.net INTERNET NETWORKQ8 (105) 4. Visually impaired user -6 User Workstation

Touch foil Physical document

(102) (101) Early British Kingdoms David Nash Ford

Barcode reader Document URL barcode (103) (107) FIG. 1 Patent Application Publication Jan. 27, 2005 Sheet 2 of 12 US 2005/0022.108A1

Page number codes are (205) located on Early British bottom left and http://www.virgin.net/170301 arly Britis bottom right . Kingdoms, by corners of David Nash

Touch foil

(202) Physical document

(201)

Early British Kingdoms David Nash Ford

Document URL

barcode (207)

FIG. 2 Patent Application Publication Jan. 27, 2005 Sheet 3 of 12 US 2005/0022.108A1

(300) bookmark

Arthur the Myth Afallach, God of the Underworld Some people believe that King Arthur is so inextricably fied up in Celtic Afallah was the son of Lludd Llaw Ereint (the Silver-Handed). Mythology that he must, in origin, have km, not a man at all, but a God He was one of the Celtic gods of the Underworld. He ruled Like so many other characters featured in the Malington, Arthur in his Avalon where he lived with his daughter, Modron, and her nine earliestform, appears almost entirely mythical. He and his companions sisters. Avalon was like the Celtic heaven, a peaceful island far have superhuman strength and abilities, and consort with giants and other away where apples grew and after which it became named. It is, mytholgical creatures. of course, best known as the place where the High-King Arthwyr In the early Welsh poem "Preiddu Annwfn", Arthur visits the Celtic was taken after he was fataly wounded at the Battle of Camlann. Underworld, Annwfn, Even in Geoffrey and Malory, upon being fataly Afallach himself appears in Arthurian gends as King Evelake. wounded in battle, Arthur is carried to the mystical Avalon, apparently the Underworld kome of the Celtic god, Afallach. Manylgends around the country attest to Arthur's immortality for he ships in one of numerous The name Arthur itself appears to derive from the Celtic word caves waiting to retum and lead his people, Ik name Arthur itself Art, meaning "hear". CouldArthur, like so many other Celtic gods, appears to derive from the Celtic word Art, meaning "bear", Could Arthur, be merely a personification of the many revered animals of the like so many other Celtic gods, be merely a personification of the many will? Later to become humanized like Beli Mawr or Bran the revered animals of the wild? Later to become humanized like Beli Mawr or Blessed Ike constellation of Ursa Major or the Great Bear is, Bran the Blessed. The constellation of Ursa Major or the Great Bear is, after all, sometimes known as Arthur's Wain. There was indeed after all sometimes known as Arthur's Wain. There was inded a Celtic a Celtic Bear-God, Artio, worshipped in Switzerland and around Bear-God, Ario, worshipped in Switzerland and around Trier, but she was, Trier, but she was, in fact, a goddess and there is no trace of her in fact, a goddess and there is no trace of her in BritainlSome theorists in Britain Some theorists claim Arthur was a late addition to the claim Arthur was a late addition to the Celtic pantheon during a resurgence Celtic pantheon during a resurgence in pagan worship, or s - la -

Page number barcode (302) (301)

FIG. 3 Patent Application Publication Jan. 27, 2005 Sheet 4 of 12 US 2005/0022.108A1

(406)

User WorkStation (404) Physical document (401)

Arthur the Myth Afallad, God of the Underworld son prp. virw at Kigarders so incariably tiedrin Cit

Afallad was the sor flkul Law Erint (the Siker-Fland). He was one gf the Chigods of the Underwr. He ruled E.lik so many werdaracter fathered in the Makinger, Ariker in his Awilon were liwd with his daughtry, Madron, and her rine arliatform, appears alriast entirely nytical he andkronparriots

sister. Awkat was like the Cli kawn, apartful island far kawsuperhumansimgh and abilitic, and rosart williants and ahrt away where apples grew and fier which it kname named it is,

fryskokaltraherts gfours, kest known as the plair when the High-King Ardwyr was taken after he was fataly wounded a? the Battle sf Canlani. in the early Wikipwm "Pridh Army", Archivisits de Cir Afallad himself appears in Arthurian kends as Kig Ewlaki. Underwr. Anity. Even by Coffrey and Malo, on krig filally wind-din bank, Arthur is carried to dragstica Awka, apartnly the

Underworldkur fake Chiwalad My land around thr

county attest to Arthur's rumoriality for r slips in are fratervis the raine Arthur is arears to derive from the Chi wrd arves willing to return and lead his people, fame Ardar itself Art, maiting "hear". CalArthur, like so many other Cligods,

appears to drive from the Celtic word Ar, raining "ear". Cold Arthur, he merely a prisorgfication if the may rewred animals of the

willplater is erarie anariedlike Eli Mawr or Brun the like so many other Chirol, brmerly a sanjirafia file many

memdanimals f the will later biaonkangrised like Beli Mawr or Betw. The constellation of Ursa Major or the Great Bari,

Bran & Bissed I consulation y Uriy Major of the Creat Bear is, after all, sometimes known as Arthur's Wain. There was inded

a Cali Rear-God artie, worshipped in Switzerland and around sfer all, sometimes known as Arther's in terr was individa Chie

Raf-Go, Artis, wrikipped in Swizard and Froundin, but she was, Trier, ush wis, infar, a golds and then is no tract of her in far, a glls and ther is no trait fit in Britain saw theorisis in Britainsane arriss raig Arikar was a late addition to the ?kin Arihar was a latradition to Chiparitieon dering a resurgence ?hip, or possiya ts &T, the spriggfa human.

(402) Page bar code Barcode reader (405) (403)

FIG. 4 Patent Application Publication Jan. 27, 2005 Sheet 5 of 12 US 2005/0022.108A1

Ser WorkStation (504)

Physical document (501)

l, God of the Underworld was the sort of Ludlaw Erin (the Silver-Handed). one if the Celtical off Underworld. His ruled were he lite with his larger, Madron, and her nine salt was like the Celsir heaver, a peaceful island far ere apples grew and gfier which iterant named it is, best known as the place were the High-Kigardwyr rigfer he was fataly wounded at the Battle of Cerican.

Arthur itself appears to derive for the Celtic word irg"ear". Coullarthur, like so many other Cliegel, ly a personification gf the many reuered animals of the

arrio ame surnalized like Beli Mawr or Braate

roatiar izidisk Bi Mawr or The rostellation of Ursa Major or the Great Bear is,

g Una Major or the Great Bears, , sometimes known as Arthur's kin. There was inded Bear-God, Artis, worshiped in Switzerland and ground

it she was, in fact, audies and irre is no trace firr in Saint theorisis fair arther was a late addition to the or during a restigence inpgar worship, or - - Barcode

reader (503) Touch foil (502)

FIG. 5 Patent Application Publication Jan. 27, 2005 Sheet 6 of 12 US 2005/0022.108A1

Document: http://www.virgin.net/170301/ User WorkStation Page: 16 (604)

From: X=27; Y= 43 (3) READ To: X=152; Y=168

Physical document (601)

God of the Underworld as the son of Llull law Erin (he Silver-Handel).

of the oligods fahr Underworld He ruled

be lived with his daughter, Modron, andler nine

on was like the Clairkawn, sprayful islandfar

als grew and girt which it learn named. It is,

known as the place where the High-King Ardwyr

lar he was fataly would at the Rattle of Camlanri.

bur inef appears to derive for the clic word

g"kar'. Coullarthur, like so many other Celtic gods,

persordfication gf the may rruered animals gf the

from lunariedlike Bei Maw or Bran the

econstellation firsa Major of the Great Bar it, known as Arthur's hain. Irr was indeed ar-Col. Artio, wrshipped in Switzerland arid around was, in fact, a goddess and their is no tracrgfier Sane arists ?lain Arthur was a he addition to the or hering a restigence inpgan wrip, or BarCOde

reader (603) Touch foil (602)

FIG. 6 Patent Application Publication Jan. 27, 2005 Sheet 7 of 12 US 2005/0022.108A1 (700)

Arthur the Myth Some people believe that King Arthur is so inextricably tied up in Celtic E. must, in origin, have been, not a man at all, but a God Like soan other characters featured in the Mabinogion, Arthur in his From 1arliestform, appears almost entirely mythical. He and his companions (701) have superhuman strength and abilities, and consort with giants and other mythological creatures, In the early Welsh poem "Preiddeu Annwfn', Arthur visits the Celtic Underworld, Annwfn, Even in Geoffrey and Malory, upon being fataly wounded in battle, Arthur is carried to the mystical Avalon, apparently the Underworld home of the Celtic god, Afallach. Many legends around the country attest to Arthur's immortality, for he sleeps in one of numerous TO caves waiting to return and lead his people. The name Arthur itself - (702), appears to derive from the Celtic word Art, meaning "bear". Could Arthur, like so many other Celtic gods, be merely a Elli?, revered animals of the wild? Later to become humanized like Beli Mawr or Bran the Blessed. The constellation of Ursa Major or the Great Bear is, after all, sometimes known as Arthur's Wain. There was indeed a Celtic Bear-God, Artio, worshipped in Switzerland and around Trier, but she was, in fact, a goddess and there is no trace of her in BritainlSome theorists claim Arthur was a late addition to the Celtic pantheon during a resurgence in pagan worship, or possibly a mythical hero, the offspring of a human,

I RS888sexissix sessesses: & Saas S&ays & Ski is

FIG. 7 Patent Application Publication Jan. 27, 2005 Sheet 8 of 12 US 2005/0022.108A1

Web server

(806)

III

WWW, Virgin.net INTERNET NETWORK (805) (807)

User workstation (804)

Touch foil Physical document (801)

Barcode gfile Underworld arg Ladlims Enid (akrisher-hak) the Clare afd therwil he me reader E. isk the champagistener

(803) akartwoudyarwas aka when wild deit Figarderwa? all i, writy wandala track yoala. gars in Arthurian as a Felds.

befort M. Aeriw from she disk wal collardu, the unayaker called,

ration fake may mealandsgfair

hear lanfael Brei Mnar mea air

lear syva Myor or de Cra Bar is away Arthur in Ikeng we seaf Galaria wideral insularlal and and air, walls and den & nomy her dowlso da Ardur was far addition dir arid manur in par wrdam

- 7

FIG. 8 Patent Application Publication Jan. 27, 2005 Sheet 9 of 12 US 2005/0022.108A1

170301.PDF - Page 16

Arthur the Myth Some people believe that King Arthur is so inextricably tied up in Celtic e must, in origin, have been, not a man at all, but a God Like so many other characters featured in the Mabinogion, Arthur in his 1rliestform, appears almost entirely mythical He and his companions have superhuman strength and abilities, and consort with giants and other mythological creatures. In the early Welsh poem "Preiddeu Annwfn", Arthur visits the Celtic Underworld, Annwfn, Even in Geoffrey and Malory, upon being fataly wounded in battle, Arthur is carried to the mystical Avalon, apparently the Underworld home of the Celtic god, Afallach. Many legends around the country attest to Arthur's immortality, for he sleeps in one of numerous To caves waiting to return and lead his people. The name Arthur itself - (902) appears to derive from the Celtic word Art, meaning "bear". CouldAal of the many like Beli Mawr or Bran the Blessed. The constellation of Ursa Major or the Great Bear is, after all, sometimes known as Arthur's Wain. There was indeed a Celtic Bear-God, Artio, worshipped in Switzerland and around Trier, but she was, in fact, a goddess and there is no trace of her in Britain Some theorists claim Arthur was a late addition to the Celtic pantheon during a resurgence in pagan worship, or possibly a mythical hero, the offspring of a human.

- l6 -

FIG. 9 Patent Application Publication Jan. 27, 2005 Sheet 10 of 12 US 2005/0022.108A1

Web Servers E.R Web server HE (1006)

& www.virgin.net INTERNET NETWORK& (1005) (1007)

User Workstation (1004) From: X=27; Y= 43 To: x=152; Ys 168 LOADING ...

Touch foil Physical document (1002) (1001) Barcode reader (1003) Ea. ir any was a shriekg causes a jarkarian skie

see is derie is a Clair or cance, likes asket chirai, rain far may freelaiads fak keels sirer arratif also fig walk Crest Bear is a loss Arturiasa was idea

ississauer was a seasia a sle Patent Application Publication Jan. 27, 2005 Sheet 11 of 12 US 2005/0022.108A1

Magnified text (1106) ... he must, in origin, have been, not a man. Text-to-speech at all, but a God. Like so many other (1105) characters featured in the Mabinogion, Arthur in his earliest form, appears al al, but a God. Like so many other characters

figured in the Mabinogion, Arthur in his earliest form, appears almost entirely mythical. He and his companions.

User WorkStation (1104)

Physical document (1101)

the Underworld of the law Enrir (ir Siler-Hand). igel ef the Underworld. He ruled with his dirger, Madre, andler nine

the Cirkenir, a peaceful island far and fier which it became farmed it is, is the platt were the High-King Arthwyr fatally wounded at the Battle of Canariri. in Architrian grids as Kig Ewlak,

appears to derive for the celli word Collardar, like so many other Celtic gods, for of the fitary revered animal file

harnatiellie Beli Mawr or Brar the ion of Ursa Major or the Great Bear is, aw as Arter's air tent was inted

Hair tier was inted a Celtic io, worshipped in Seitzerland and around Siarhardandarvald Irier, but she was, ar, a golds and it is no trage of her fairy it in Britain some theoriss isis clair, Arder was a late edition is the Cali partiewt during a resgrace g a reagenre inpgari worship, or Barcóder " III reader Touch foil (1103) (1102)

FIG. 11 Patent Application Publication Jan. 27, 2005 Sheet 12 of 12 US 2005/0022.108A1

ldentifying a physical document comprising 1201 one or a plurality of pages

Selecting and identifying a page of said physical document 1202

Placing and aligning a touch foil over the . 1203 selected page

identifying a part of the document by pressing -1204 one or a plurality of points over the touch foil

Sending to a server a request for data related to 1205 said selected part of the document

Locating on the server the electronic copy 1206 of the selected physical document

Extracting from the electronic copy on the server the text data comprised in (or related to) the part 1207 selected on the physical document

Receiving on the user workstation the requested 1208 text data

Presenting the received text data by means of a 1209 text-to-speech, magnification or other Software

FIG. 12 US 2005/0022.108A1 Jan. 27, 2005

SYSTEMAND METHOD TO ENABLE BLIND and includes an enhanced Software speech Synthe PEOPLE TO HAVE ACCESS TO INFORMATION Sizer for Speaking in Several languages. PRINTED ON A PHYSICAL DOCUMENT 0010) Note: Windows is a trademark of Microsoft Corporation, a company with corporate headquarters FIELD OF THE INVENTION in Redmond, Wash., USA. 0001. The present invention generally relates to a system 0011 Web Page Readers: This technology reads and method for enabling blind and Visually impaired people aloud text just as it appears on Web pages. For to interact with a physical document and to have access to example, “Home Page Reader' of IBM, understands information printed on a physical document. HTML (Hypertext Markup Language), the program ming language used to design Web pages. Home BACKGROUND OF THE INVENTION Page Reader can accurately read text comprised in tables, or included in graphic descriptions, So that 0002. Accessibility blind users can easily navigate on the Web. 0003. In broad terms, accessibility is the ability for a user to access and use information and technology even if this 0012) Note: IBM is a trademark of International user operates in constrained conditions. Information and BusineSS Machines Corporation, a company with technology can be accessible through appropriate Special corporate headquarters in Armonk, N.Y., USA. ized technical interfaces. The present invention is directed to 0013 Mail Readers: This technology uses a screen a technology to enable visually impaired and blind people to reader for converting the text of an e-mail to speech. access information printed on physical documents. For example, “Lotus Notes Release 5” of IBM, 0004. Many groups, in governments, private industries enables blind users to check the status of their e-mail and universities, are working on ways to guarantee universal (unread, read, deleted), to use calendar functions, access to the on-line world for all individuals in Society. This and to file and organize documents. Social movement, combined with a Strong push to provide a 0014 Braille Editing Systems (BES): These systems better accessibility in the workplace, drives an urgent call for allow users to input Braille characters from the new technologies. keyboard. For instance, IBM provides a BES that can 0005 AS information technology (IT) penetrates all com be downloaded from the IBM Web. mercial and public transactions and communications, it is 0015 Scanning Reading Systems: The information important to ensure accessibility to everyone. Governments printed on a physical document is first Scanned. have begun to define new regulations and Standards to Then, using an OCR (Optical Character Recogni enable people with disabilities to easily acceSS information tion) technique and a speech Synthesizer, this infor technology. For instance, in the US, the federal, State and mation can be read to blind people. For example, local governments have initiated a legislation requiring “Open Book: Ruby Edition 4.0” of IBM is a program computer technology to be accessible to people with dis that transforms a computer, a Sound card, and a abilities. More particularly, in June 2001, the U.S. Federal Scanner into a reading machine for reading books, Government has implemented a legislation known as "Sec magazines, memos, bills, and many other printed tion 508”. Section 508 has changed the rules of the game on documents. how the government must buy information technology and 0016 Screen Magnifiers: These software tools allow in particular “accessible' IT. a visually impaired user to magnify text and images 0006 Countries have established regulations that require on a computer Screen. For example, “MAGic Screen accessibility at Some level, other countries are in the proceSS Magnification', from Henter-Joyce, is a Screen mag of developing Such regulations. In addition, international nification product for Windows. organizations are working to develop accessibility Stan dards. 0017 Portable document magnifiers: The MAXPort by NanoPac, Inc. is a portable magnifying System. 0007 Accessibility Aids for Blind People The user wears a special pair of glasses, points at a 0008 For someone who is completely unable to use a particular part of a physical document and can See a normal Screen or read a printed text, there are two alterna magnified image of Said particular part. tives: Braille reading or Speech. Currently available assis 0018. Access to Printed Material tance for blind and Visually impaired people comprises a wide range of technical Solutions, including document Scan 0019 Reading manuals and reports at work, textbooks at ners and enlargers, interactive Speech Software and cognitive School, and menus at restaurants, and more generally read tools, Screen reader Software and Screen enlargement pro ing printed material at any time and in any place is part of grams. daily life. The present invention is based on the following observation: it is easier and quicker for Sighted people to 0009 Screen Readers: This technology converts text turn over pages of a book than to browse electronic pages on (or other elements) on a computer Screen to speech, a computer Screen. It would be an improvement to provide allowing blind or visually impaired users to hear a similar capability to blind and Visually impaired people. what is displayed on their computer Screen. For For instance, it would be a real improvement for blind example, “Jaws for Windows' is a computer screen people to have the possibility to access information printed reader application from Henter-Joyce. It operates on a physical document directly from this physical docu with Windows NT 4.0, Windows 98 and Windows 95 ment. US 2005/0022.108A1 Jan. 27, 2005

0020 When we compare paper based information with information: paper isn't going away, reading and computer based information, paper has a number of useful Writing are ineXtricably intertwined, and readers properties that computers cannot provide. For instance: Sample and navigate text according to specific pur 0021 paper is portable, familiar and can be easily poses and tasks'. distributed; 0031. Also, in the article entitled “Electronic Journals: What do users think of them?'", by Dr Cliff McKnight, 0022 paper is easy to read, mark, and manipulate. Department of Information and Library Studies, Loughbor 0023 Many electronic systems attempt to replace paper. ough University, Loughborough, Leicester LE113TU, UK, They offer, for instance, a better access to multimedia we can read: Services. However, most users prefer to work with paper and 0032) “A paper journal article is more easily it is difficult to foresee, in a near future, a general and manipulated than an electronic version. AS one stu massive replacement of paper books by electronic books dent subject in the Cafe Jus study remarked: “It is (e.g., by Web accessible e-books). easier to turn the page of a paper journal. More than 0024 Publication entitled “The Last Book”, IBM Sys just page-turning, though, regular journal readers tems Journal, Vol 36, No. 3-1997, by J. Jacobson, B. understand the Structure of journal articles and use Comiskey, C. Turner, J. Albert, and P. Tsao of the MIT that knowledge to aid manipulation, providing rapid Media Laboratory, compares printed books and computer access to the information in an article. For example, Screens in the following terms: Dillon showed that people could reconstruct articles 0025 “A book represents a fundamentally different from a Set of paragraphs with about 80% accuracy. entity than a computer Screen in that it is a physical They also displayed a Similar level of accuracy in embodiment of a large number of Simultaneous Saying which Section of an article isolated Sentences high-resolution displayS. When we turn the page, we had been taken from. Watching a reader pick up an do not lose the previous page. Through evolution the issue of a journal, Skim through the contents, turn to brain has developed a highly Sophisticated Spatial an article and skim through it and then turn back to map. Persons familiar with a manual or textbook can the contents, all in a matter of Seconds, it is clear that find information that they are Seeking with high Such skills are largely automatic. Watching people Specificity, as evidenced by their ability to remember trying to do the Same thing in an electronic journal whether Something that was seen only briefly was on System, it is clear that people will have to learn a the right Side or left Side of a page, for instance. different set of skills'. Furthermore their haptic connection with the brains 0033 Sighted people can browse very easily through Spatial map comprises a highly natural and effective paper catalogs, magazines, newspapers, maps and books by interface, when Such information is embodied on flipping through the pages and by “glancing at pictures and actual multiple physical pages. text. It is also very easy for them to mark and return to 0026. Another aspect of embodying information on Specific parts of a physical document. It would be desirable multiple, Simultaneous pages is that of Serendipity to offer similar possibilities to blind and visually impaired and comparison. We may leaf through a large Volume people and in particular to enable these people to easily of text and graphics, inserting a finger bookmark into browse through the same paper catalogs, magazines, news those areas of greatest interest. Similarly, we may papers, maps and books, and to easily “access” (receive and assemble a large body of Similar matter in order to hear) information related to pictures and text printed on View elements in contrast to one another, Such as pages of these documents. might be done to determine which of a particular Set 0034. The convenience and usefulness of a system for of graphical designs is most Satisfying. enabling blind and Visually impaired people to acceSS infor 0.027 Publication entitled “A Comparison of Reading mation directly from hard-copy documents, to turn over Paper and On-Line Documents”, O'Hara and Sellen, XRCE: pages and to manually Search for text, is well illustrated by Technical Report: EPC-1997-101, Xerox Co. summarizes a in the following article entitled “Talking Books Speak Vol Study comparing reading from paper to reading on-line. AS umes”. by Kendra Mayfield, Wired News, Jul. 13, 2000, reported in this article: 0035) “When George Kerscher began to lose his 0028 “Critical differences have to do with the major Sight in his late twenties, the former teacher realized advantages paper offers in Supporting annotation that he might never be able to read the same way while reading, quick navigation, and flexibility of again. Since he could no longer delve through the Spatial layout. These, in turn, allow readers to deepen written page Kerscher, who has the degenerative their understanding of the text, extract a Sense of its disease retinitis pigmentosa, began listening to audio Structure, create a plan for writing, croSS-refer to books. But while these cassettes helped him read, other documents, and interleave reading and writ they were limited. He couldn't turn pages or Search ing. for text. He had to endure hours of recordings to find the information he needed'. 0029 AS reported in an article entitled “Paper is still with us”, by Ph. Jane Benson- The Journal of Electronic Pub 0036). In fact audio tapes have a drawback which is lishing, published by the University of Michigan Press Similar to the drawback experienced when we Scroll com puter Screens: the user can only go forward or backwards. 0030 “Studies of professionals at work underscore The possibilities of navigation are very limited. It is difficult three points that are critical to the design of Scientific for people with visual impairments, to use audio books or US 2005/0022.108A1 Jan. 27, 2005

Screen readers the same way sighted people do. For instance, 0044) Usually, a method for electronically reading a looking up a recipe or Searching for a gardening tip on an printed document comprises the following Steps: audio tape or on a long electronic book is extremely tedious and time consuming. 0045 placing a page of a text document on a scan ner, 0037 Nowadays, digital audio books are designed to make published documents accessible and navigable for to 0046 digitizing this page for obtaining a pixel bit blind or visually impaired persons. The ANSI/NISO Z39.86 map of the page; Standard, defines a format and content for an electronic file 0047 converting this image to text by means of an Set that comprises a digital audio book and establishes a OCR program executed in a personal computer, this limited Set of requirements for digital audio books playback personal computer being connected to the Scanner; devices. It uses established and new specifications to delin and eate the Structure of digital audio books whose content can 0048 generating speech from the text by means of a range from text with corresponding spoken audio, to audio text-to-speech program. with little or no text. However, if a sighted user of a physical book wishes to discuss a particular Section of Such this book 0049 Currently, reading machines are provided by a with a blind user, the blind user must actively search for a variety of companies, including IBM, TeleSensory, Arken digital copy of the same edition of the book and then must stone and Kurzweil Educational Systems. Unfortunately, Search for the relevant Section. There is a need to enable electronic reading machines Suffer from a variety of func individuals familiar with paper documents to continue to use tional and operational deficiencies that limit their usefulness. those same documents as they age and their vision may be For instance: deteriorating. There is also a need to provide a mechanism by which the text of a familiar physical document may be 0050 Scanning a page is a mechanical operation. It Supplemented by Speech output or display of a more easily takes time to move the electro-optical components of readable version of the text. the Scanner over the page. 0.038. One of the characteristics of the publishing indus 0051 it takes time also to transmit the information try is that most publications can be delivered in a digital from the Scanner to the computer. form. In Some cases, the digital form has really Supplanted 0052 the OCR process for an entire scanned page, the physical one. In other cases, the digital form appears takes a lot of time and resources. complementary to the physical one. However, in most cases, the physical form is till dominant. In fact, in terms of 0053 only a single page can be scanned at the same busineSS models, with the exception of journals and direc time. tories, which tend to follow a Subscription model, most 0054) OCR is prone to error. Prime Recognition, in an publishers have been unable to create profitable digital advertisement for the product PrimeOCR, quotes a typical products and Services, able to generate significant incomes. error rate of 2% for conventional OCR algorithms. Prim Digital audio books represent an important improvement eOCR itself reports an error rate of 0.4%, or 8 errors in a compared to traditional analog audio books. For instance, typical page of 2000 characters. digital audio books provide access to virtually Stored infor mation, offer improved navigation capabilities, allow the use 0055 As a result, even for an experienced user, it can take of keywords for Searching and directly accessing text in more than a minute before an electronic reading machine electronic books. However, due to a relatively limited num can read a single Scanned page. During of after the reading, ber of Vision impaired users, the cost of Such digital audio errors must be corrected. The proceSS is repeated for every books remains relatively high. It results from this that a very page in the document. small number of titles are published both, as printed books 0056 Since scanners are limited in size, another draw and as digital audio books. back concerning electronic reading machines is the reading 0.039 The necessity of using a natural friendly interface of pages with large formats (a newspaper page for instance). for having access to information has been precisely Sum Such pages cannot be Scanned in one pass but require marized by Ann Light, in the article entitled “Fourteen multiple passes. Users in Search of a Newspaper: the Effect of Expectation on 0057 Moreover, a complete electronic reading system Online Behaviour', School of Cognitive and Computing with a computer, a Scanner, and Speech hardware and Sciences, University of Sussex, CSRP507, Software is bulky and non portable. 0040) “People expect the friendly familiar paradigm of 0058. It is clear that reading a text on a paper document media to guide them through uncharted territories of by means of an electronic reading machine involves com information'. plex manipulations and time consuming operations. How 0041 According to prior art, electronic reading machines ever, there are other important deficiencies that limit in using computer-based optical character recognition (OCR) practice the acceptance and usefulness of electronic reading are widely used to help Visually impaired people and people machines. Basically, the tasks required for using these with reading difficulties to read information on paper docu electronic reading machines are far to be “natural”. Reading ments. An electronic reading machine basically comprises physical documents by means of an electronic reading machine, has nothing in common with the automatic “natu 0042 a personal computer connected to a Scanner ral' way of reading practiced by Sighted people. and operating with an OCR Software, and 0059 A mobile scanning pen comprising an optical char 0043 text-to-speech hardware and software. acter recognition function, can also be used for producing a US 2005/0022.108A1 Jan. 27, 2005

digital version of a printed document. Wizcom's Quicklink program for enabling a blind or visually impaired perSon, to Pen Personal Scanner is an example of Such pen. However, acceSS information printed on a physical document, directly Scanning printed words using Such a pen can be rapidly from Said physical document, Simply by pointing and touch tedious and laborious. Each line must be individually (and ing a desired part of Said document. More particularly, the accurately) Scanned and a reasonable visual acuity is method comprises the Steps of: required. The present invention does not require a good Vision, as only two physical markers are required to define 0070) identifying a physical document; the part of the document that must be read. 0071) identifying and locating an electronic copy of 0060. As a conclusion, it is important to enable blind Said identified document; people to easily and conveniently access information com prised in hard-copy publications that are read everyday by 0072 identifying one or a plurality of pages of said Sighted people. physical document and identifying a part of the identified physical document using the position of OBJECTS OF THE INVENTION points pressed on a touch foil Successively placed and aligned over or under Said identified pages, 0061. It is an object of the invention to enable a blind or Visually impaired perSon, as well as a person with reading 0073 retrieving from the electronic copy of the disabilities, to access information printed on a physical physical document, data related to the Selected part document and information related to this printed informa of the document; tion. 0074 presenting said retrieved data visually or 0.062. It is another object of the invention to enable a orally on the user WorkStation. blind or visually impaired person to access information directly from a physical document without using an elec 0075) Further embodiments of the invention are provided tronic reading machine based on a page Scanner and/or an in the appended dependent claims. optical character recognition (OCR). 0.063. It is another object of the invention to enable a BRIEF DESCRIPTION OF THE DRAWINGS blind or visually impaired person to easily Select a part of a 0076. The novel and inventive features believed charac physical document simply by touching (e.g., with the fin teristic of the invention are Set forth in the appended claims. gertip or with a pen) this physical document. The invention itself, however, as well as a preferred mode of 0064. It is a further object of the present invention to use, further objects and advantages thereof, will best be enable a blind or Visually impaired person to take a physical understood by reference to the following detailed descrip document, to open it at any page, to Select with a finger or tion of an illustrative detailed embodiment when read in a pen a part of this page and to hear the text of the Selected conjunction with the accompanying drawings, wherein part. 0.077 FIG. 1 shows a preferred embodiment of the 0065. It is also an object of the present invention to present invention. enable both magnification and electronic reading of a 0078 FIG. 2 shows how, according to the present inven Selected part of a physical document. tion, a user, using a barcode reader, reads the address (e.g., 0.066. It is a further object of the present invention to URL Uniform Resource Locator) of a document encoded on enable a perSon, after having Selected a part of a printed a bar code printed on this document (e.g., at the bottom right document comprising text and images, to hear the text, to corner of the cover) and how information related to this receive descriptions of images, and to access multimedia document (e.g., title, author, etc.) can be retrieved from a information or Services related to Said printed text and Server and read to the user by means of an electronic reading images. System. 0067. It is a further object of the invention to provide a 007.9 FIG. 3 shows how a user opens a physical docu System that, apart from providing to a blind or visually ment (e.g., at the page where a bookmark has been inserted). impaired perSon, an access to information directly from a 0080 FIG. 4 shows how, according to the present inven physical document, can also be used for many other appli tion, a user using a barcode reader, can read a page number cations in the daily life, Such as helping children to read, encoded on a bar code printed at a predefined position on a enabling people with reading difficulties to read, enabling Selected page and how the System decodes and audibly Sighted people to read in the dark, enabling people with a informs the user of the Selected page number. poor vision to read Small print on paper documents. 0081 FIG. 5 shows how a touch foil is placed aligned 0068. It is a further object of the present invention to over a Selected page of a physical document according to the enable individuals familiar with paper documents to con present invention. tinue to use the same documents as they age and their vision may be deteriorating and to Supplement the text of a familiar 0082 FIG. 6 shows how a user selects a part of the physical document by Speech output or display of a more physical document by pressing a first point and a Second easily readable version of the text. point on a touch foil placed aligned over a Selected page. 0.083 FIG. 7 shows the start point and the end point of SUMMARY OF THE INVENTION the part of the physical document Selected by the user, Said 0069. As defined in independent claims, the invention Start point and end point corresponding to the two points relates generally to a method, a System and a computer over the touch foil previously pressed by the user. US 2005/0022.108A1 Jan. 27, 2005

0084 FIG. 8 shows how, according to the present inven 0098 identifying a first page selected by the user in tion, a request for retrieving information related to a part of Said physical document, preferably by reading, by a document is sent to a Server. means of a barcode reader, a page identifier printed 0085 FIG. 9 shows how, according to the present inven on Said first page at a predefined position; tion, data related to the part Selected by the user on the 0099 determining the position of a first point physical document is extracted (in bold) from the electronic pressed (e.g. with a fingertip or a pen) on a touch foil copy of the document stored on the Server. placed and aligned over or under the identified first 0.086 FIG. 10 shows how, according to the present page, Said first point corresponding to the Start point invention, the text corresponding to the Selected part of the of a part Selected in Said identified document by the physical document is downloaded from the Server to the user uSer, WorkStation. 0100 if start point and end point of the selected part are 0087 FIG. 11 shows how, according with the present on the same page: invention, the received text file can be converted to an audio 0101 determining the position of a second point file or can be magnified. pressed (e.g. with a fingertip or a pen) on the touch 0088 FIG. 12 shows the steps of the method of selecting foil placed and aligned over or under the identified a part of a physical document and of providing electronic page of Said document, Said Second point corre reading and Screen magnification of Said Selected part. sponding to the end point of Said Selected part; 0089. The invention itself, as well as a preferred mode of 0102) if start point and end point are not on the same use, objects and advantages thereof, can be understood by page: reference to the following illustrative embodiment described 0.103 identifying a second page selected by the user by the accompanying drawings. in Said physical document, preferably by reading, by means of a barcode reader, a page identifier printed DETAILED DESCRIPTION OF THE on Said Second page at a predefined position; PREFERRED EMBODIMENT 0104 determining the position of a second point 0090 The present invention addresses different problems pressed (e.g. with a fingertip) on the touch foil placed that may arise in reading text, particularly problems that and aligned Over or under the identified Second page affect visually impaired perSons or perSons who cannot See of Said document, Said Second point corresponding to or read correctly (e.g., in low light conditions). For instance: the end point of Said Selected part; 0091 a person driving a vehicle may have some 0105 identifying the part of the identified physical difficulties to read a text; document that has been Selected using the position 0092) another perSon may not have time to read a (e.g. coordinates) of the start point and the end point; teXt, 0106 identifying and locating an electronic copy of 0093 bad lighting or display conditions may make the identified document and information related to difficult or impossible the reading of a text in a the Selected part of the document; printed or displayed form. 0107 retrieving from the electronic copy of the 0094. The present invention allows a blind reader to document, data related to the part of the document receive an audible transcription of a Selected part of a Selected by the user; physical document (for example an audible transcription of 0108) extracting text data from said data and audibly a selected text in book). reading Said text data by means of a text-to-Speech 0.095 The present invention also discloses a method for Software; Selecting a part of a physical document Simply by pressing with a fingertip or a pen a touch foil placed over Said 0109) optionally or alternatively, magnifying said document; for identifying data associated with this Selected retrieved data on the user System Screen; part in a database comprising an electronic copy of the 0110 optionally or alternatively, accessing multime document; for extracting text from Said data and for con dia information or Services related to Said retrieved Verting this text into speech. data. 0096. The present invention is directed to a method for 0111 Synthetic Reading and Screen Magnification of a use in a user System connected to a network, for retrieving Selected Part of a Physical Document from a Server, an electronic copy of a physical document, and information related to Said document, and for playing, 0112 As shown in FIG. 1, the system according to an displaying, reading and/or magnifying on the Screen of this embodiment of the present invention comprises: user System, the retrieved electronic copy and information 0113 a physical, i.e., hard-copy document (101) related to Said document. The method comprises the Steps (e.g., a book) comprising one or a plurality of pages, of: 0097 identifying a physical document selected by a 0114 a physical document interface comprising a user, preferably by reading, by means of a barcode touch foil (102) (to be placed over or underneath a reader, a document identifier printed on Said physical page of this document); document at a predefined position; 0115 a barcode reader (103); US 2005/0022.108A1 Jan. 27, 2005

0116 a user workstation (104), connected to for implementing the functions of this invention, TouchTek4 touchscreens are commonly used in hand-held personal 0117 the touch foil interface (102); information management Systems, PDAS, mobile computing 0118 the barcode reader (103); Systems, automotive, diagnostics and telecom devices, and Internet appliances. TouchTek4 touchscreens are engineered 0119) a communication network (105) (e.g., the to accept more than three million touches to any area of the Internet network); SCCC. 0120 a server (106) (e.g., a Web server). 0127 Barcode Reader 0121) Physical Document 0128. The barcode reader (103), connected to user work Station (104) is used to identify the documents and pages of 0122) The physical document (101) can be of any kind, the documents Selected by the user. One example of barcode for example, a newspaper, a legal document, a geographic reader it is possible to use, is the PenWANDC Computer map, a fiction novel, an academic text book, a technical Ware. The PenWAND is a combination of barcode reader book, a commercial catalog or even any other type of and light pen in one hand-held instrument. This is an ideal engraved, written, or printed Surface. The material of the Solution for applications requiring reading of barcodes and document can be paper, plastic, wood or any other material. For identifying the selected document (101) to the system, Screen Selection. a bar code (107) is printed or attached at a well known 0129. User Workstation position on the physical document (e.g., on the front cover, 0.130. In the embodiment of the invention illustrated in back cover or first page). In the embodiment of the invention FIG. 1, the user workstation (104) is used for carrying out shown in FIG. 1, the URL (i.e., the internet address) of an the following Steps: electronic document is encoded in a bar code (107). This electronic document stored on a server (106) is the copy of 0131 receiving from the barcode reader (103) a a physical document (101). As illustrated in FIG. 3, to code for identifying (107) the document (101) (for identify pages in a document (300), (101) a bar code (301), instance, an address or an URL Uniform Resource (302) is printed or attached at a well known position on each Locator) and the page number (301) selected by the document page (e.g., on the bottom left (301) and bottom uSer, right corners (302) of the open document (300)). Bar codes 0132) receiving from the touch foil (102), (602) the are readby means of a barcode reader (103) connected to the coordinates of the two points (605), (606) touched by user workstation (104). the user over the document (601), said points (the 0123. In an alternate embodiment of the invention, a Start point and the end point) specifying the part of physical document can be specifically produced for the the Selected document page that must be read; purpose of accessing information from a tactile System. 0133) transmitting to a given server (106) means for Compared to the original paper document, this physical identifying on Said server an electronic copy (or document can have a different form, to include, for instance, replica, or representation) (900) of the physical tactile indications (in Braille, for example) related to the Structure and pages of the document. With Such a tactile document (101), (700) and data related to the part of document or book, a blind user can quickly and indepen the physical document (701), (702) selected by the dently navigate in the document, and can easily mark the user; Said identification means comprising: Sections of text he wish to hear. In this embodiment, to Select 0134) the document identification code (107), the same part of text, the Server determines from the points Selected by the user on the physical document, the corre 0135) the page identification code (301) and sponding points in the original paper document. 0136 the coordinates of the two points (605), (606) specifying the part (701), (702) of the physi 0124 Touch Foil cal document (700) selected by the user; 0125 The touch foil (102) may be made of transparent resistive or capacitive films of the type used commonly to 0.137 retrieving from the electronic copy of the manufacture touch Screens. The generated Signal is gener document on the server (106), data (903) corre ally proportional to the coordinates of the point pressed. One sponding to the part (701, 702) of the document example of touch foil it is possible to use is the TouchTek4 (700) selected by the user; (4-wire Analog Resistive Touchscreens) of MICRO TOUCH 0138) extracting text data from Said data; company (TouchTekTM is a trademark of the MICRO 0139 converting this text data to speech (1105) by TOUCH Company). means of a text-to-Speech Software; 0.126 TouchTek4 touchscreens feature hard-coated poly ester topSheets, available in Several Surface finishes. Spacer 0140 optionally, magnifying on the user's display, dots are available in Several dot arrays, optimized for finger, the text data or the electronic copy corresponding to pen and finger, or pen-only input. Electronic control is the selected part (1106) by means of a display provided by a serial controller, or by 4-wire controllers. magnifying Software. TouchTek4's specifications include narrow inactive border 0141 The user workstation (104) is, for example, an areas and compact touch Sensors which allow System Internet appliance, a multimedia Personal Computer (PC), a designers and OEMs to provide the largest uSeable Screen game console, a cell phone . . . . The touch foil (102) area and full mouse emulation without Sacrificing function communicates with the user WorkStation by means of a ality or consuming exceSS power. Apart from being Suited cable, a wire pair, an infrared link, or a wireleSS link. In a US 2005/0022.108A1 Jan. 27, 2005 particular embodiment, the user workstation (104) is con O157 if start point and end point of the selected part are nected to a communication network (105), preferably the on the same page: Internet network and comprises a Web Browser application. 0158) determining (1204) the position of a second point pressed (e.g. with a fingertip or pen) on the 0142 Server touch foil placed and aligned (1203) over or under 0143. The server (106) is primarily the repository where the identified page of Said document, Said Second electronic representations (900) of physical documents point corresponding to the end point of Said Selected (700) are stored. Each electronic representation is associated part, with a physical document (or publication) by means of the 0159) if start point and end point are not on the same barcode printed on this physical document. The electronic page: representation of a document includes an exact copy or 0160 identifying a second page selected by the user replica of the original document. This copy includes, for in Said physical document, preferably by reading, by instance, Scanned images of pages. means of a barcode reader, a page identifier printed 0144. The electronic representation may also include on Said Second page at a predefined position; text, text descriptions of graphical elements (Such as charts, 0161 determining (1204) the position of a second graphs or illustrations). The Server also provides users with point pressed (e.g. with a fingertip or pen) on the additional information Such as: touch foil placed and aligned (1203) over or under the identified Second page of Said document, Said 0145 a speech description (205) of the selected Second point corresponding to the end point of Said document (Such as title, authors, general informa Selected part; tion); and 0162 (1205) sending to a given server a request for 0146 speech instructions related to the selected the Selected document part, Said request comprising document (206) (e.g., for informing the user about an identification of: the position of the barcodes on pages of Selected physical document or publication). 0163) the physical document, 0147 Method for Selecting a Part of a Physical Docu 0164) the page(s), and ments and for Providing an Electronic Reading and Screen 0165) the Selected part of the document; Magnification of this Selected Part 0166 (1206) locating on the server an electronic 0.148. As shown in FIG. 12, the present invention dis copy (or replica) of the Selected physical document; closes a System, method and computer program for: 0167 1207) extracting text data related to the part 0149 selecting a part of a physical document (pref Selected on the physical document; erably a printed publication, like the document 0168 (1208) receiving on the user workstation, the shown in FIG. 1 entitled “Early British Kingdoms"), requested text data; Simply by touching with a fingertip (or pen) over this physical document; 0169 (1209) reading to the user, the received text data using a text-to-Speech Software on the user 0150 identifying in an electronic copy (or replica) WorkStation. of the physical document, the part that has been 0170 FIG. 2 shows how the user selects a physical Selected by the user; document (or publication) (201) (e.g., printed book entitled 0151 extracting text data comprised in the selected “Early British Kingdoms”). By means of any user interface part, and (keyboard, mouse, voice recognition Software and micro phone) or any other reading means (e.g., barcode reader), the 0152 converting extracted text into electronic user enters a code or name (207) for identifying the docu Speech. ment. In the preferred embodiment shown in FIG. 2, the user reads by means of a barcode reader (203) a bar code 0153. The method comprises the steps of: (207) with the address on the Web (e.g.: the URL http:// 0154 (1201) identifying a physical document, said www.virgin.net/170301/) of the electronic copy (or replica physical document comprising one or a plurality of with the same identical format) of the Selected physical pageS, document (201). The bar code (207), used to identify the document, must be printed or attached at a predefined 0155 (1202) selecting and identifying a page of said reserved place on the physical document (e.g., on the front physical document, said page comprising one or a cover, back cover or first page). plurality of printed items, 0171 The bar code gives access, on the server (106), to 0156 determining (1204) the position of a first point information related to the Selected physical document, Such pressed (e.g. with a fingertip or pen) on a touch foil S. placed and aligned (1203) over or under the identi fied first page, Said first point corresponding to the 0172 the title (e.g., “Early British Kingdoms"), Start point of a part Selected in Said identified docu 0173 the author's name (e.g., “David Nash Ford of ment by the user; Binfield, Berkshire, UK), US 2005/0022.108A1 Jan. 27, 2005

0174 the date of the publication (e.g., “28 January 0183 The selection of a part of a physical document 1999), using a touch foil, can be done according to various forms. For example, in a particular embodiment of the invention, if 0175 the ISBN (International Standard Book Num the user touches a Single point on the touch foil and then ber) (e.g., “84-344-0856-2), etc. presses the READ key, this operation is equivalent to a command for reading the full document from this point 0176) This information about the selected physical docu (possibly until the user presses a STOP READ reserved key ment is transmitted from the server (106) to the user work on the user workstation keyboard). Also, if the user Selects station (204) as a text file. This text file is then converted to a first page and indicates a first point on this first page, and electronic voice (205) by means of a text-to-speech software then Selects a Second page and indicates a Second point on operating on the user WorkStation. this Second page, and then presses the READ key, this 0177. The user workstation can also receive from the operation is equivalent to a command for reading the docu server (106) operational instructions (206) for locating page ment from the first point Selected on the first page to the numbers barcodes on the pages of the Selected physical Second point Selected on the Second page. It is now apparent document or publication (e.g., “Page number codes are that other arrangements can be implemented by those skilled located on bottom left and bottom right corners of pages”). in the art for correlating a plurality of points Selected by a These operational instructions are transmitted to the user by user with a part of a physical document. means of the text-to-speech Software operating on the user 0184 FIG. 7 shows in detail two points (701), (702) on WorkStation. a page of a physical document (700). These two points 0.178 FIG. 3 shows how a user opens a physical docu correspond to the points (605), (606) pressed by the user on ment (300) at the page where a bookmark has been inserted the touch foil (602). (e.g., on "Page 16'). This figure also shows how on each page of the document (e.g., “Page 16”, “Page 17), a bar 0185 FIG. 8 shows how the user workstation (804) code (301), (302) with a page number, is printed on a sends a request (807) related to a part (701), (702) of a predefined and fixed position, already known by the user. physical document (700) to a server (806). The request comprises an identification of 0179 FIG. 4 shows how a user selects a page of physical document (401) and how the number of the selected page is 0186 the physical document, identified by scanning by means of barcode reader (403), the 0187 the selected page, and bar code (405) encoding the page number. After decoding the scanned bar code, the user workstation (404) informs the 0188 the coordinates of the part selected by the user (406) by means of an electronic voice, of the selected USC. page number (e.g., “Page sixteen'). 0189 In the example illustrated in FIG. 8, the HTTP 0180 Alternate embodiments for identifying pages of a request: document exists and can be used with the present invention. An example is given by a document having page numbers printed as text. It is possible to identify a page of the document by Scanning on the page the place where the page 0191) Specifies: number is printed. A Scanning device can be integrated with the barcode Scanner described previously. The Scanning 0192 the URL of the physical document (e.g., http:// device can also be used separately like the Quicklink Pen www.virgin.net/170301/), Personal Scanner described in the specifications of the 0193) the page number (e.g., “Page=16”), and present application. 0194 the coordinates of the part selected by the user 0181 FIG. 5 shows how a user places a touch foil (502) (e.g., From: Xf=27, Yf=43; To: Xt=152, Yt=168). over a page of a physical document, aligning the borders of the touch foil and the document using Some conventional 0195) In the example illustrated in FIG. 8, when the means (505) (e.g., by adjusting the upper left corner of the server (806) (e.g., “www.virgin.net”) receives the HTTP touch foil with the upper left corner of the page). request, this request is parsed to find the physical document reference number (e.g., "170301”). This physical document 0182 FIG. 6 shows how, according to a particular reference number (or code) is then used to Search on the embodiment of the present invention, it is possible to define server for the electronic copy (e.g., “170301.PDF) of the a part of a physical document (601). The user presses (e.g., physical document (same format and same content). The with a fingertip or pen) (1) on a first point (605) and then (2) HTTP request is also parsed to find the page of the physical on a second point (606) over the touch foil (602) placed document (e.g., “Page=16”) selected by the user and the aligned over the Selected page (e.g., over “Page 16” of the coordinates Specifying the Selected part of the physical publication entitled “Early British Kingdoms"). When the document (e.g., From: Xf=27, Yf=43; To: Xt=152, Yt=168) user has finished to press the points defining the Selected part on the Server. that he desires to hear and that must be electronically read, she/he (3) then presses on the keyboard of the user work 0196. FIG. 9 illustrate how, in a particular embodiment station (604) a reserved READ key (607), informing the of the invention, the server (806) uses the information System to initiate the task of locating and reading the comprised in the HTTP request (807): selected document part. Coordinates of the points (605), (606) pressed by the user on the touch foil (602) are 0.197 document reference number, transmitted from the touch foil to the user workstation (604). 0198 page number, and US 2005/0022.108A1 Jan. 27, 2005

0199 coordinates of points defining the part of the What is claimed is: document Selected by the user, to locate and extract 1. A method for use in a user System, for accessing from the electronic copy (e.g., "170301.PDF) rep information related to a physical document, Said method lica of the physical document (801), text data (903) comprising the Steps of: (in bold) corresponding to the part of physical docu identifying a physical document; ment (701), (702) selected by the user. The extracted text data is formatted by the server in the form of a identifying and locating an electronic copy of Said iden text file (e.g., “SELECTION.TXT) and is transmit tified document; ted as reply to the request (807) previously received identifying one or a plurality of pages of Said physical from user workstation (804). document and identifying a part of the identified physi cal document using the position of points on Said 0200. It is important to note that different methods can be identified pages, used to determine, from the coordinates of the points selected (701), (702) on the touch foil, the text data (903) retrieving from the electronic copy of the physical docu that must be must be extracted from the electronic copy ment, data related to the Selected part of the document; (from point 901 to point 902). In the example illustrated in presenting Said retrieved data Visually or orally on the FIG. 9, incomplete words are excluded from the head and user System. from the tail of the text String comprised in the Selected part 2. The method according to claim 1, wherein the Step of of the physical document. identifying one or a plurality of pages of Said physical document and identifying a part of the identified physical 0201 The server can also receive from the user worksta document using the position of points on Said identified tion a HTTP request (such as “&format=magnifyOriginal”) pages further comprises pressing Said points on a touch foil to view a magnified image of a part of the original document. Successively placed and aligned over or under Said identified The Server Sends back a reply including an image of the pageS. Selected part of the same format and appearance than the 3. The method according to claim 1, wherein Said physical original document. This image is magnified on the display of document and pages in Said physical document are Selected the user WorkStation. by a user. 4. The method according to claim 2, wherein a point on 0202) The information returned by the server (806) in a touch foil is pressed with a fingertip or a pen. reply to the request (807) received from user workstation 5. The method according to claim 1, wherein the step of (804) can be different than the exact transcription (as a text identifying one or a plurality of pages of Said physical file) of the data printed on the physical document. In fact, document and identifying a Selected part of the identified nothing prevents the server (806), to reply with any kind of physical document using the position of points pressed on a multimedia information (e.g., a combination of a long text touch foil Successively placed and aligned over or under Said description with music or Songs). This multimedia informa identified pages, comprises the further Steps of: tion can be linked (or even hyperlinked) with different parts of the physical document that the user can Select. Therefore, identifying a first page in Said physical document; the invention is not limited to a mechanism for reading (i.e., determining the position of a first point pressed on the for Speaking by means of text-to-speech transcription) text touch foil placed and aligned over or under the iden printed on a physical document to a blind user, but the tified first page, Said first point corresponding to the invention is also directed to a mechanism for accessing from Start point of a part Selected in Said identified docu a physical document, all kinds of multimedia information or ment, services available on the Web FIG. 10 shows how, in reply if Start point and end point of the Selected part are on a to request of a user for accessing information from a Selected Same page: part (701), (702) of a physical document, text data (903) extracted from (or associated with) the Selected part on the determining the position of a Second point pressed on the electronic copy of the document (900), is downloaded touch foil placed and aligned over or under the iden (1007) as a text file (e.g., “SELECTION.TXT") from the tified page of Said document, Said Second point corre server (1006) to the user workstation (1004). sponding to the end point of Said Selected part; 0203 FIG. 11 shows how the text file (e.g., “SELEC if Start point and end point are not on a Same page: TION.TXT), once received by the user workstation (1104), identifying a Second page in Said physical document; is converted into an audio file (.aiff, wav, .au file) by means determining the position of a Second point pressed on the of a text-to-speech software and is played (1105) to the user. touch foil placed and aligned over or under the iden This figure shows also, how the received text is magnified tified Second page of Said document, Said Second point (1106) on the user workstation display by means of a screen corresponding to the end point of Said Selected part. magnifying Software. identifying the Selected part of the identified physical 0204 What has been described is merely illustrative of document using the position of the Start point and the the application of the principles of the present invention. end point. Other arrangements and methods can be implemented by 6. The method according to claim 1, wherein the Step of those skilled in the art without departing from the Spirit and presenting Said retrieved data orally, comprises the further Scope of the present invention. Steps of US 2005/0022.108A1 Jan. 27, 2005

extracting text data from Said data; retrieving Said information and/or Services, converting Said text data into data that can be electroni reading or magnifying or playing or displaying Said cally read. information and/or Services on the user WorkStation. 7. The method according to claim 6, wherein the step of 18. The method according to claim 17, wherein the converting Said text data into data that can be electronically information associated with the physical document, com read, comprises the further Step of: pr1SeS: audibly reading Said text data by means of a text-to a speech description of the physical document, and/or Speech System. 8. The method according to claim 1, wherein the step of Speech instructions related to the physical document. presenting Said retrieved data Visually, comprises the further 19. The method according to claim 18, comprising the Step of preliminary Steps of magnifying the retrieved data on a Screen. creating an electronic copy of the physical document; 9. The method according to claim 8, wherein the step of asSociating information and/or Services with Said elec magnifying the retrieved data on a Screen, comprises the Step tronic copy. of: 20. The method according, to claim 1, wherein Said user System is connected to a communication network compris magnifying on a Screen the electronic copy of the Selected ing one or plurality of Servers, and wherein the electronic part of the physical document. copy of the physical document is located on one of Said 10. The method according to claim 1, wherein the elec plurality of Servers. tronic copy of the document is an exact replica of the 21. The method according to claim 1, wherein the elec physical document. tronic copy of the physical document is located on the user 11. The method according to claim 1, wherein the docu System. ment identifier is an address to access the electronic copy of 22. The method according to claim 1, wherein Said user the physical document. System is connected to a communication network compris 12. The method according to claim 1, wherein the Step of ing one or plurality of Servers, and wherein the information presenting the retrieved data Visually, comprises the Step of and/or Services associated with Said physical document are enhancing on a Screen the electronic copy of the Selected located on one or a plurality of Said Servers. part of the physical document to match the user's 23. The method according to claim 1, wherein the elec preferred reading view. tronic copy of the physical document and the information 13. The method according to claim 1, wherein the step of and/or Services associated with Said physical document are identifying a physical document, comprises the further Step located on the user System. of: 24. The method according to claim 1 wherein: reading, by means of a barcode reader, a document the communication network is an Internet network; identifier printed on Said physical document at a pre defined position. the one or plurality of servers are Web servers; and 14. The method according to claim 1, wherein the Step of the document identifier is an internet address. identifying a page in Said physical document, comprises the 25. The method according to claim 1, wherein said Step of physical document comprises Braille indications. reading, by means of a barcode reader, a page identifier 26. A user System comprising means adapted for carrying printed on Said page at a predefined position. out the Steps of the method according to claim 1. 15. The method according to claim 1, wherein the step of 27. A System comprising: retrieving from the electronic copy of the document, data a user System according to claim 26, optionally connected related to the Selected part of the document; comprises the to a communication network; further steps of: a touch foil to be placed over or under a page of a physical identifying and locating information and/or Services asso document for: ciated with the Selected part of the document; and detecting a pressure exercised over one or a plurality of retrieving Said information and/or Services, point of its Surface; and reading or magnifying or playing or displaying Said determining the coordinates of Said one or plurality of information and/or Services on the user WorkStation. points, and 16. The method according to claim 15, wherein said information associated with the Selected part of the docu a connection between Said touch foil and the user System. ment, comprises: 28. The System according to claim 27 further comprising a bar code reader connected to Said user System for reading a Speech description of graphical data related to the bar codes on the physical document. Selected part of the document. 29. A computer program comprising instructions for car 17. The method according to claim 16, wherein the step rying out the Steps of the method according to claim 1, when of identifying and locating an electronic copy of the iden Said computer program is executed on the user System tified document, comprises the further Steps of: according to claim 26. identifying and locating information and/or Services asso ciated with the physical document; and