USO08005720B2 (12) United States Patent (10) Patent No.: US 8,005,720 B2 King et al. (45) Date of Patent: *Aug. 23, 2011 (54) APPLYING SCANNED INFORMATION TO No. 11/097,089, filed on Apr. 1, 2005, and a IDENTIFY CONTENT continuation-in-part of application No. 1 1/097.835, filed on Apr. 1, 2005, now Pat. No. 7,831,912, and a (75) Inventors: Martin T. King, Vashon Island, WA (Continued) (US); Dale L. Grover, Ann Arbor, MI (US); Clifford A. Kushler, Lynnwood, (51) Int. Cl. WA (US); James Q. Stafford-Fraser, G06Q 30/00 (2006.01) Cambridge (GB) (52) U.S. Cl. ............... 705/26.1: 705/26: 705/27; 707/3; r ar. 707/4; 707/5; 707/E17.008; 382/305: 715/205 (73) Assignee: Google Inc., Mountain View, CA (US) (58) Field of Classification Search .................... 705/26, 705/27, 26.1: 707/345 E17.008: 382/305 (*) Notice: Subject to any disclaimer, the term of this s s s is a-s 715/205 past llists2, yed under 35 See application file for complete search history. This patent is Subject to a terminal dis- (56) References Cited claimer. U.S. PATENT DOCUMENTS (21) Appl. No.: 11/208,461 3,899,687 A 8, 1975 Jones (Continued) (22) Filed: Aug. 18, 2005 FOREIGN PATENT DOCUMENTS (65) Prior Publication Data EP O424803 5, 1991 US 2006/01 1990O A1 Jun. 8, 2006 (Continued) Related U.S. Application Data OTHER PUBLICATIONS (63) Continuation-in-part of application No. 11/004,637, U.S. Appl. No. 10/676,881, Lee et al. filed on Dec. 3, 2004, now Pat. No. 7,707,039, and a continuation-in-part of application No. 1 1/097.961, (Continued) filed on Apr. 1, 2005, now abandoned, and a continuation-in-part of application No. 1 1/097.093, Primary Examiner —Yogesh C Garg filed on Apr. 1, 2005, now abandoned, and a (74) Attorney, Agent, or Firm — McDonnell Boehnen continuation-in-part of application No. 1 1/098,038, Hulbert & Berghoff LLP filed on Apr. 1, 2005, now Pat. No. 7,599,844, and a continuation-in-part of application No. 1 1/098,014, (57) ABSTRACT filed on Apr. 1, 2005, and a continuation-in-part of Information corresponding to a sentence or less of text is application No. 1 1/097,103, filed on Apr. 1, 2005, now scanned from a rendered document and converted to text. The Pat. No. 7,596.269, and a continuation-in-part of text is communicated to a search engine. Electronic content application No. 1 1/098,043, filed on Apr. 1, 2005, now corresponding to the rendered document from which the text abandoned, and a continuation of application No. was scanned is identified from the search engine results. 11/097.981, filed on Apr. 1, 2005, now Pat. No. 7,606.741, and a continuation-in-part of application 22 Claims, 11 Drawing Sheets SPLAY 422 US 8,005,720 B2 Page 2 Related U.S. Application Data filed on Oct. 1, 2004, provisional application No. 60/617,122, filed on Oct. 7, 2004, provisional applica continuation-in-part of application No. 1 1/098,016, tion No. 60/622,906, filed on Oct. 28, 2004, provisional filed on Apr. 1, 2005, now Pat. No. 7,421,155, and a application No. 60/633,452, filed on Dec. 6, 2004, pro continuation-in-part of application No. 1 1/097,828, visional application No. 60/633,678, filed on Dec. 6, filed on Apr. 1, 2005, now Pat. No. 7,742,953, and a 2004, provisional application No. 60/633,486, filed on continuation-in-part of application No. 1 1/097.833, Dec. 6, 2004, provisional application No. 60/633,453, filed on Apr. 1, 2005, and a continuation-in-part of appli filed on Dec. 6, 2004, provisional application No. cation No. 1 1/097.836, filed on Apr. 1, 2005, now aban 60/634,627, filed on Dec. 9, 2004, provisional applica doned, and a continuation of application No. 1 1/098, tion No. 60/634,739, filed on Dec. 9, 2004, provisional application No. 60/647,684, filed on Jan. 26, 2005, pro 042, filed on Apr. 1, 2005, now Pat. No. 7,593,605, and visional application No. 60/648,746, filed on Jan. 31, a continuation-in-part of application No. 1 1/096.704, 2005, provisional application No. 60/653,372, filed on filed on Apr. 1, 2005, now Pat. No. 7,599,580, and a Feb. 15, 2004, provisional application No. 60/653,663, continuation-in-part of application No. 1 1/110,353, filed on Feb. 16, 2005, provisional application No. filed on Apr. 19, 2005, now Pat. No. 7,702,624, and a 60/653,669, filed on Feb. 16, 2005, provisional applica continuation-in-part of application No. 1 1/131,945, tion No. 60/653,899, filed on Feb. 16, 2005, provisional filed on May 17, 2005, now Pat. No. 7,818,215, and a application No. 60/653,679, filed on Feb. 16, 2005, pro continuation-in-part of application No. 1 1/185.908, visional application No. 60/653,847, filed on Feb. 16, filed on Jul. 19, 2005, now abandoned. 2005, provisional application No. 60/654,379, filed on Feb. 17, 2005, provisional application No. 60/654,368, (60) Provisional application No. 60/602.956, filed on Aug. filed on Feb. 18, 2005, provisional application No. 18, 2004, provisional application No. 60/602,925, filed 60/654,326, filed on Feb. 18, 2005, provisional applica on Aug. 18, 2004, provisional application No. 60/602, tion No. 60/654,196, filed on Feb. 18, 2005, provisional 947, filed on Aug. 18, 2004, provisional application No. application No. 60/655.279, filed on Feb. 22, 2005, pro 60/602,897, filed on Aug. 18, 2004, provisional applica visional application No. 60/655.280, filed on Feb. 22, tion No. 60/602,896, filed on Aug. 18, 2004, provisional 2005, provisional application No. 60/655.987, filed on application No. 60/602,930, filed on Aug. 18, 2004, Feb. 22, 2005, provisional application No. 60/655,697, provisional application No. 60/602,898, filed on Aug. filed on Feb. 22, 2005, provisional application No. 18, 2004, provisional application No. 60/603,466, filed 60/655.281, filed on Feb. 22, 2005, provisional applica on Aug. 19, 2004, provisional application No. 60/603, tion No. 60/657,309, filed on Feb. 28, 2005. 082, filed on Aug. 19, 2004, provisional application No. 60/603,081, filed on Aug. 19, 2004, provisional applica (56) References Cited tion No. 60/603,498, filed on Aug. 20, 2004, provisional application No. 60/603,358, filed on Aug. 20, 2004, U.S. PATENT DOCUMENTS provisional application No. 60/604,103, filed on Aug. 4,052,058 A 10, 1977 Hintz 23, 2004, provisional application No. 60/604,098, filed 4,526,078 A 7, 1985 Chadabe on Aug. 23, 2004, provisional application No. 60/604, 4,538,072 A 8, 1985 Immler et al. 100, filed on Aug. 23, 2004, provisional application No. 4,610,025 A 9, 1986 Blum et al. 4,636,848 A 1/1987 Yamamoto et al. 60/604,102, filed on Aug. 23, 2004, provisional applica 4,713,008 A 12/1987 Stocker et al. tion No. 60/605,229, filed on Aug. 27, 2004, provisional 4,716,804 A 1/1988 Chadabe application No. 60/605,105, filed on Aug. 27, 2004, 4,748,678 A 5/1988 Takeda et al. provisional application No. 60/613.243, filed on Sep. 4,776.464 A 10, 1988 Miller et al. 4,804,949 A 2f1989 Faulkerson 27, 2004, provisional application No. 60/613,628, filed 4,805,099 A 2, 1989 Huber on Sep. 27, 2004, provisional application No. 60/613, 4,829,453 A 5/1989 Katsuta et al. 632, filed on Sep. 27, 2004, provisional application No. 4,829,872 A 5/1989 Topic et al. 60/613,589, filed on Sep. 27, 2004, provisional applica 4,890,230 A 12, 1989 Tanoshima et al. tion No. 60/613.242, filed on Sep. 27, 2004, provisional D306, 162 S 2f1990 Faulkerson et al. 4,901,364 A 2f1990 Faulkerson et al. application No. 60/613,602, filed on Sep. 27, 2004, pro 4.914,709 A 4, 1990 Rudak visional application No. 60/613,340, filed on Sep. 27, 4.941,125 A 7/1990 Boyne 2004, provisional application No. 60/613,634, filed on 4.947,261 A 8, 1990 Ishikawa et al. Sep. 27, 2004, provisional application No. 60/613,461, 4,949,391 A 8, 1990 Faulkerson et al. filed on Sep. 27, 2004, provisional application No. 4,968,877 A 1 1/1990 McAvinney et al. 4,985,863. A 1/1991 Fujisawa et al. 60/613,455, filed on Sep. 27, 2004, provisional applica 4,988,981 A 1/1991 Zimmerman et al. tion No. 60/613,460, filed on Sep. 27, 2004, provisional 5,010,500 A 4, 1991 Makkuni et al. application No. 60/613,400, filed on Sep. 27, 2004, pro 5,012,349 A 4/1991 de Fayet al. visional application No. 60/613.456, filed on Sep. 27, 5,062,143 A 10, 1991 Schmitt 5,083,218 A 1/1992 Takasu et al. 2004, provisional application No. 60/613,341, filed on 5,093,873 A 3, 1992 Takahashi et al. Sep. 27, 2004, provisional application No. 60/613,361, 5,109,439 A 4, 1992 Froessl filed on Sep.