US007609410B2 (12) United States Patent (10) Patent N0.: US 7,609,410 B2 Lapstun et a]. (45) Date of Patent: Oct. 27, 2009 (54) MOBILE TELECOMMUNICATION DEVICE 5,051,736 A 9/1991 Bennett et al. WITH INTEGRAL PRINTER MECHANISM 5,465,080 A 11/1995 Liddiard et al. AND SENSING MEANS (75) Inventors: Paul Lapstun, Balmain (AU); Kia Silverbrook, Balmain (AU); Tobin (Continued) Allen King, Balmain (AU) FOREIGN PATENT DOCUMENTS (73) Assignee: Silverbrook Research Pty Ltd, Balmain, New South Wales (AU) EP 0274571 7/1988 ( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 USC 154(b) by 978 days. (Continued) (21) Appl.No.: 10/917,436 OTHER PUBLICATIONS Dymetman, M., and Copperman, M., Intelligent Paper; in Electronic (22) Filed: Aug. 13, 2004 Publishing, Artistic Imaging, and Digital Typography, Proceedings ofEP ’98, Mar/Apr. 1998, SpringerVerlag LNCS 1375, pp. 392-406. (65) Prior Publication Data US 2005/0040350 A1 Feb. 24, 2005 Primary ExamineriDov Popovici Assistant ExamineriThierry L Pham Related US. Application Data (57) ABSTRACT (63) Continuation of application No. 09/722,147, ?led on Nov. 25, 2000, now Pat. No. 6,946,672. (30) Foreign Application Priority Data A mobile telecommunications device is disclosed. The mobile telecommunications device includes an image sensor Dec. 1, 1999 (AU) ................................... .. PQ4392 for sensing coded data from a printed interface whilst the mobile telecommunications device is used to physically inter (51) Int. Cl. act with the printed interface. The mobile telecommunica G06K 15/00 (2006.01) tions device also includes a processor con?gured to decode G06F 3/12 (2006.01) the sensed coded data. The data generated by the processor is (52) US. Cl. ................................... .. 358/118; 358/115 then transmitted to a computer system via a mobile telecom (58) Field of Classi?cation Search ................ .. 358/11, munications network and using a transmitter of the mobile 358/19, 1114118, 401, 179, 472; 235/487, telecommunications device. A receiver of the mobile tele 235/494; 345/84, 173, 179; 382/119, 137, communications device receives response data via the mobile 382/186; 400/61, 70, 76, 88 telecommunications network in response to the data being See application ?le for complete search history. transmitted. An integral printer mechanism of the mobile telecommunications device is con?gured to print another (56) References Cited interface onto print media. The other interface also includes U.S. PATENT DOCUMENTS coded data, but is at least partially based on the response data. 4,864,618 A 9/1989 Wright et al. 4,888,479 A 12/1989 Tamaru 3 Claims, 24 Drawing Sheets 100 US 7,609,410 B2 Page 2 US. PATENT DOCUMENTS 6,152,369 A 11/2000 Wilz 6,330,976 B1 * 12/2001 Dymetman et a1. ....... .. 235/487 5,477,012 A 12/ 1995 Sekenduf 6,964,374 B1 11/2005 Djuknic et a1. 5,652,412 A 7/1997 LaZZouni 5,661,506 A 8/1997 Lazzouni et a1. FOREIGN PATENT DOCUMENTS 5,692,073 A 11/1997 Cass 5,835,577 A 11/1998 Disanto et :11. GB 2306669 5/1997 5,852,286 A 12/1998 Coleman JP 05-040841 5/1997 5,852,434 A 12/1998 Sekendur W0 W0 99/18487 4/1999 5,900,110 A 5/1999 Goodwin et 31. W0 WO 99/49383 A 9/1999 5,995,105 A 11/1999 Reber et :11. W0 WO 99/50787 10/1999 6,076,734 A 6/2000 Dougheity 6,138,915 A 10/2000 Danielson * cited by examiner US. Patent 0a. 27, 2009 Sheet 1 0f 24 US 7,609,410 B2 US. Patent 0a. 27, 2009 Sheet 2 0f 24 US 7,609,410 B2 US. Patent 0a. 27, 2009 Sheet 3 0f 24 US 7,609,410 B2 US. Patent 0a. 27, 2009 Sheet 4 0f 24 US 7,609,410 B2 116 \ ~-___/ 108 ____,/ 170 FIG. 4 US. Patent 0a. 27, 2009 Sheet 5 0f 24 US 7,609,410 B2 A l i QL 1 Q g g | g 102 : / ' 114 I! AN ! Q !! l ! 756 #1 194 555555555555 : 192 55555555555: I L K = | | F/G. 5 US. Patent 0a. 27, 2009 Sheet 6 0f 24 US 7,609,410 B2 176 FIG. 6 US. Patent 0a. 27, 2009 Sheet 7 or 24 US 7,609,410 B2 716 174 218 256 102 752 254 764 162 252 254 205 202 216 204 720 US. Patent 0a. 27, 2009 Sheet 8 0f 24 US 7,609,410 B2 244 US. Patent 0a. 27, 2009 Sheet 9 0f 24 US 7,609,410 B2 US. Patent 0a. 27, 2009 Sheet 10 0f 24 US 7,609,410 B2 272 206 FIG. 70 US. Patent 0a. 27, 2009 Sheet 11 0124 US 7,609,410 B2 FIG. 77 US. Patent 0a. 27, 2009 Sheet 12 0f 24 US 7,609,410 B2 The family of Dashwood had long 204 been set F ' , eir estateK, / was large nce was at Norlan ' tre V200 / / 206 \ FIG. 72 The family of Das 0d had long 700 FIG. 75 US. Patent 0a. 27, 2009 Sheet 13 0f 24 US 7,609,410 B2 The family of Das 0d had long 206 100 FIG. 74 206 _\ and their resic / / Bark, in the o0 / © @ %w 200 700 FIG. 75 US. Patent 0a. 27, 2009 Sheet 14 0f 24 US 7,609,410 B2 The family of Dashwood had long 206 . \ been SGTFMM‘J'QGH‘l estate was largenh nce was at Norlan ltre The family of Dashwood had long 206 . \ been sett, a eir estate mé settled in Sussex. Their nce was arge, and their residencT at No?an rland Park, in the centre tre US. Patent 0a. 27, 2009 Sheet 15 0f 24 US 7,609,410 B2 272 Movie Library 212 \ / // Gone with the The Sound of Wind Music /\/ 270 FIG. 75 / 276 275 212\ Movie W ’ \ . i/ 274 * ’ The Sound of Music ,\/ 272 , /v 210 j 100 FIG. 79 US. Patent Oct. 27, 2009 Sheet 16 0f 24 US 7,609,410 B2 275 Movie Library 216/ FIG. 20 Music Library Jimi Hendrix Live at Woodstock Introduction [2:21] _ 222 Message To Love [7:21] Hear My Train A Comin’ [9:49] Spanish Castle Magic [7:05] Red House [5:24] Lover Man [5:11] R Foxey‘ Lady [5:06] Jam Back At The House [7:44] \/ 220 FIG. 27 US. Patent Oct. 27, 2009 Sheet 17 0f 24 US 7,609,410 B2 Music Library Jimi Hendrix Live at Woodstock Introduction [2:21] Message .To Love [7:21] r-———Hn=I-MH-I=a]n__'_" tle A Magic Comin' [7:05] [9:49] | LoverRed Hous Man‘ 5:24]:11] :\ ~ 224 / Foxey Lad 5:06] W m Back The House [7:44] 226" /\/ 220 700 FIG. 22 Music Library Jimi Hendrix Live at 1 ~ Introduction [2: 224 ~' v 220 700 US. Patent Oct. 27, 2009 Sheet 18 0f 24 US 7,609,410 B2 Bank of Commerce Dear Mr Citizen, Re: Credit card number XXXX XXXX XXXX xxxx Your personal identi?cationnumber (PIN) for this card is XXXXXX k 252 “r 254 my 250 M FIG. 24 Bank of Commerce Dear Mr Citize Ff Re: Credit cardF mber 1234 5678 Your personal i ' tification number (PI for this card is J 345 6 w x 256 F/G. 25 .