US 20080252732A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2008/0252732 A1 Silverbrook et al. (43) Pub. Date: Oct. 16, 2008 (54) IMAGE MANIPULATION METHOD FOR (30) Foreign Application Priority Data CAMERA Jul. 15, 1997 (AU) ....................................... PO7986 (75) Inventors: Kia Silverbrook, Balmain (AU); Jul. 15, 1997 (AU) ....................................... PO7991 Paul Lapstun, Balmain (AU); Simon Robert Walmsley, Balmain Publication Classification (AU) (51) Int. Cl. Correspondence Address: H04N 5/225 (2006.01) SILVER BROOK RESEARCH PTY LTD 393 DARLING STREET (52) U.S. Cl. .............................. 348/207.2: 348/E05.024 BALMAIN 2041 (AU) (57) ABSTRACT (73) Assignee: Silverbrook Research Pty Ltd A handheld camera comprises a sensor adapted to sense an (21) Appl. No.: 12/143,806 image, a camera manager for controlling the sensing of the image, an image processing manager for manipulating the (22) Filed: Jun. 22, 2008 image, a print manager for controlling printing of the manipu lated image, and a guillotine adapted to cut a print media on Related U.S. Application Data which the manipulated image is printed from a print roll. The (63) Continuation of application No. 10/729,159, filed on print manager is operable to activate the guillotine upon Dec. 8, 2003, which is a continuation of application receipt of a signal indicative of an attempt to dispense the No. 09/113,057, filed on Jul. 10, 1998, now Pat. No. print media at a rate greater than that of a print roll drive 6,850,274. system for dispensing the print media. Patent Application Publication Oct. 16, 2008 Sheet 1 of 36 US 2008/0252732 A1 Patent Application Publication Oct. 16, 2008 Sheet 2 of 36 US 2008/0252732 A1 57 56 Y- z-Z 52 OPTIONAL OFTIONAL OKIENTATION Of-TIONAL KEYBOAKD FLASH SENSOK USF3 FOKI DAV 53 FEOGKAM KOM AKEA IMAGE MENAOKY 7O SENSOR ) 64 MBII DKAM 35 OPTIONAL ARTCAM STEKEO 3D CEy IKAL AKEA IMAGE FEOCESSOR 54. SENSOK (ACP) FKINI KOLL COLOK DISPLAY D 44 L11 8 5 PHOTO AKTeENaoe CARD - 166-y\\a - 31 3O GUILLOTINE 41 STATUS LED 6O FAFEk buttonsBUTTON's HD TKANSFOKI 9 AKICAKD MOTOK 36 61 -- s AkTCAKD TATUSCl He MOTOK 54 W- 15 257 62 POWER M V a.M. 2OOM BATTERY MANAGEMEN 5YSTEM | MOTOK -7 CIRCUIT. POWER 53 43 51 63 ALT OFOCUS H MOTOK 59 FIG 2 Patent Application Publication Oct. 16, 2008 Sheet 3 of 36 US 2008/0252732 A1 m r; are. or Authentication live: Sa Seria infra-fed- A - - Chip SuS Keyboard teace (USB) Port interface MYX YXYYXXXX XXXV ed - era - I - 55 54 Patent Application Publication Oct. 16, 2008 Sheet 4 of 36 US 2008/0252732 A1 FIG. 3(a) Patent Application Publication Oct. 16, 2008 Sheet 5 of 36 US 2008/0252732 A1 2X2 FIXEL E3LOCK FKOM 6ENSOR FIG. 4 CONTROL 6IGNALS 6ENSOK FIXELS DISPLAY CACHE CONTROLLEK INTERFACE STATE MACHINE WEKTICAL 6YNC SYNC HOKIZONTAL 6YNC GENERATION TFT ENABLE LOWSPEED E3US FIG. (3 Patent Application Publication Oct. 16, 2008 Sheet 6 of 36 US 2008/0252732 A1 ETC 2:1 IN EACH DIMENSION OKIGINAL INMAGE 116 115 FIG. 7 24O TIME . KEAD FIXEL DATA FKOM CCD FHA6E 1 FHASE 2 FHASE 5 PHASE 4 FIG 3 34 s AETCAR3D & O & 3.3 4. O | | D. DOT 6AM FLED OVER 3X3 FIXEL6 DOT 6AM FLED OVER 4X4 FIXEL6 FIG. 9 Patent Application Publication Oct. 16, 2008 Sheet 7 of 36 US 2008/0252732 A1 l N Q S ls (S) (N ws l S. GS. N2 SS) -is S)S SR (2 Al- Q)N' S --- S C r l) (S) Cy A. Q. A Qis S () R SS &- A Sill if S S< S... SO SSSA Y ld SSN ld: S S Q &S S S is& S. NU/NURL N 1. S *-s Patent Application Publication Oct. 16, 2008 Sheet 8 of 36 US 2008/0252732 A1 22O 221 ENCODED, XORed. 222 6CKAMBLED BIT MAFFED BIT MAP TO BYTE6 ENCODED, XORed. 225 6CKANABLED DATA - O CHECKERE3OARD XOK ENCODED, 6CKANAD3LED DATA 224 -N UN6CKAME31E ENCODED,N UNSCEAME3LED DATA 225 - O REED-60LONMON DECODE KAW DATA 1 226 FIG 11 Patent Application Publication Oct. 16, 2008 Sheet 9 of 36 US 2008/0252732 A1 ¿ž§§§§§§§§§§§§§§§§§§§§ ? ??????????????????????????? §žžžž (lizz)O110>\/1 Patent Application Publication Oct. 16, 2008 Sheet 10 of 36 US 2008/0252732 A1 31 DOTS FIG 13 245 246 KUN LENGTH 254 62 6TART FIXEL 25.25 1 BIT 7 Bf Tes BIT KUN LENGTH /ALUE 25O FIG. 14 Patent Application Publication Oct. 16, 2008 Sheet 11 of 36 US 2008/0252732 A1 OO@ (1/q1)=07VALOC1 ZOÇ (€11giz)ZTEXIA Patent Application Publication Oct. 16, 2008 Sheet 12 of 36 US 2008/0252732 A1 FEEV-1 311 PKEY ROW(DOT) 1 HH-44 - 5 % % CURRENT ROW (DOT) A (3 2 NEXT ROW (DOT) 2521 32O BIT HIs TOKY (3 BITs) (CENTROID FRACTIONAL COMFONENT - O5) / 16 325 EXPECTED FIXELs (2O BITs) 324 ACTUAL FIXELs (2O BITs) FIXELs DIFFERENCE (6 BITs) 526 321 FIG 13 Patent Application Publication Oct. 16, 2008 Sheet 13 of 36 US 2008/0252732 A1 Z@@ ØøœOMHºop| G22. O92) Patent Application Publication Oct. 16, 2008 Sheet 14 of 36 US 2008/0252732 A1 - - - - - - - - - - - - - - - - - - - - - - - - - - - - : DIFFUSE 6INGLE CHANNEL E3ECOMES: FIG. 23 DITHERED SEQUENTIAL 3EAD ITEKATOK DITHERED 6EQUENTIAL KEAD ITEKATOK Patent Application Publication Oct. 16, 2008 Sheet 15 of 36 US 2008/0252732 A1 E3UMP-MAP SEQUENTIAL READ ITEKATOK 1 BLMF-MAF CALCULATE KEAD ITEKATOK 2 E3UMP-MAP 6EOUENTIAL KEAD OUT INMAGE ITEKATOK 25 SEQUENTIAL WEITE ITEEATOR IMAGE CALCULATE SEQUENTIAL 6FECULAR OLT-IMAGE KEAD 6EQUENTIAL |TEKATOK KEAD ITEKATOK CALCULATE AME31ENT 2 AND sLBeEQUENT L - - - - - - - LIGHT6 FIG 21 Patent Application Publication Oct. 16, 2008 Sheet 16 of 36 US 2008/0252732 A1 PAFER FAFEE DIRECTION FKINT HEAD . 3 FKINT HEAD 6EGMENTS IN PRINT HEAD agreerO f SEGAENSEGMENT2 5 SECMENT4. se5 se6 SEGMENT7 125O uM (375 DOTS FER SEGMENT ROW, OR 75O DOT3 FEReEGMENT COLOK) 1 DOT is 16.6/1N1 IN -N- DIAMETER (A 10O uM 662UARE = € 6 6 e e -------- e-1 6 X 6 - 36 DOTS) B can B € 6 6 € 6 -------- 6 (E) (E) (E) (E) -------- 466.6 Luy? (23 DOTS) (G G (9 (9 () -------- 6-2T33.3 uM YELLOW INK 133.3uM (3 DOTs) EACH 6EGMENT CONTAINS (3 KOW6 OF DOT3: ODD AND EVEN CYAN, MAGENTA AND YELLOW FIG. 22 Patent Application Publication Oct. 16, 2008 Sheet 17 of 36 US 2008/0252732 A1 Patent Application Publication Oct. 16, 2008 Sheet 18 of 36 US 2008/0252732 A1 Patent Application Publication Oct. 16, 2008 Sheet 19 of 36 US 2008/0252732 A1 FIG 27 Patent Application Publication Oct. 16, 2008 Sheet 20 of 36 US 2008/0252732 A1 FIG. 23 Patent Application Publication US 2008/0252732 A1 FIG. 29 Patent Application Publication Oct. 16, 2008 Sheet 22 of 36 US 2008/0252732 A1 FIG. 3O Patent Application Publication Oct. 16, 2008 Sheet 23 of 36 US 2008/0252732 A1 E. A. Y sts A.% %; % Patent Application Publication Oct. 16, 2008 Sheet 24 of 36 US 2008/0252732 A1 FIG. 32 Patent Application Publication Oct. 16, 2008 Sheet 25 of 36 US 2008/0252732 A1 32O 321 322 | : \ f w t y cric c c c 325 - 824 \ w-1 -------- *- --- : Y. - FIG 33 Patent Application Publication Oct. 16, 2008 Sheet 26 of 36 US 2008/0252732 A1 \ wra M t) --...-Y--- Q--- (i) s s Exa ----1 S. (S} - -- EEEEEEEEEEEEEEEEEAlth is is sistic t y E: FFFFFF Cy ty Patent Application Publication Oct. 16, 2008 Sheet 27 of 36 US 2008/0252732 A1 Patent Application Publication Oct. 16, 2008 Sheet 28 of 36 US 2008/0252732 A1 Patent Application Publication Oct. 16, 2008 Sheet 29 of 36 US 2008/0252732 A1 s s & s & s Patent Application Publication Oct. 16, 2008 Sheet 30 of 36 US 2008/0252732 A1 Patent Application Publication Oct. 16, 2008 Sheet 31 of 36 US 2008/0252732 A1 >0iOEAAMITA >'OGGEÇOX)| r 6/l (1 OI/O1 Yi Yi NOLOV/2 legy IWWC1 VH Patent Application Publication Oct. 16, 2008 Sheet 32 of 36 US 2008/0252732 A1 OTOO|(107> —. Patent Application Publication Oct. 16, 2008 Sheet 33 of 36 US 2008/0252732 A1 ZEZ 906 Patent Application Publication Oct. 16, 2008 Sheet 34 of 36 US 2008/0252732 A1 77/1);|GETZZON2/\/O Patent Application Publication Oct. 16, 2008 Sheet 35 of 36 US 2008/0252732 A1 (10€[]].V19. (1Q7>0700 Patent Application Publication Oct. 16, 2008 Sheet 36 of 36 US 2008/0252732 A1 US 2008/0252732 A1 Oct. 16, 2008 IMAGE MANIPULATION METHOD FOR 0018 FIG. 12 illustrates an enlargement of the left hand CAMERA corner of a single Artcard; 0019 FIG. 13 illustrates a single target for detection: CROSS REFERENCE TO RELATED 0020 FIG. 14 illustrates the method utilised to detect tar APPLICATION getS. 0001. This application is a Continuation application of (0021 FIG. 15 illustrates the process of centroid drift: U.S. Ser. No. 10/729,159 filed on 8 Dec. 2003 which is a 0022 FIG. 16 shows one form of centroid lookup table: Continuation application of U.S. Ser. No. 09/113,057 filed on 0023 FIG. 17 illustrates the centroid updating process; Jul. 10, 1998. The contents of Ser. Nos. 10/729,159 and 0024 FIG. 18 illustrates a delta processing lookup table 09/113,057 are incorporated herein in entirety by reference. utilised in the preferred embodiment; 0025 FIG. 19 illustrates the process of unscrambling Art FIELD OF THE INVENTION card data; 0026 FIG. 20 illustrates an actual implementation of a 0002 The present disclosure relates to a data processing diffuse calculation; method and apparatus and, in particular, discloses a camera 0027 FIG.