(12) United States Patent (10) Patent No.: US 7,912,828 B2 Bonnet Et Al

US0079 12828B2

(12) United States Patent (10) Patent No.: US 7,912,828 B2 Bonnet et al. (45) Date of Patent: Mar. 22, 2011

(54) PATTERN SEARCHING METHODS AND E2. A 3. 3. Eyes,ucIW et al. APPARATUSES 5,666,552 A 9/1997 Greyson et al. w w 5,687,333 A 1 1/1997 Dobashi et al. (75) Inventors: Olivier Bonnet, Paris (FR); Frédéric De 5,692,032 A 1 1/1997 Seppänen et al. Jaeger, Paris (FR); Toby Paterson, Paris 5,708,845. A 1/1998 Wistendahl et al. (FR) (Continued) (73) Assignee: Apple Inc., Cupertino, CA (US) FOREIGN PATENT DOCUMENTS - EP O 458 563 A2 11/1991 (*) Notice: Subject to any disclaimer, the term of this (Continued) patent is extended or adjusted under 35

(21) Appl. No.: 11/710,182 “Postal Address Detection from Web Documents' Lin et al., IEEE Computer Society, copyright 2005 (hereafter Lin).* (22) Filed: Feb. 23, 2007 (Continued) (65) Prior Publication Data Primary Examiner — Apu M Mofiz US 2008/0243841 A1 Oct. 2, 2008 Assistant Examiner — Cindy Nguyen (74) Attorney, Agent, or Firm — Blakely, Sokoloff, Taylor & (51) 2. "no (2006.01) Zafman LLP G06F 15/16 (2006.01) (57) ABSTRACT GIOL I5/06 (2006.01) A ter-based method for identifvi t (52) U.S. Cl...... 707/706; 704/243; 704/244; 709/246 putercomputer-based text using structures method defining for identifying types of patterns patterns which in com are (58) Field of Classification Search ...... r 707/6, 102: to be identified, wherein a structure comprises one or more 709/246; 704/243, 244 definition items, the method comprising assigning a weight See application file for complete search history. ing to each structure and each definition item; searching the (56) References Cited computer text for a pattern to be identified on the basis of a particular structure, a pattern being provisionally identified if it matches the definition given by said particular structure; in U.S. PATENT DOCUMENTS a provisionally identified pattern, determining those of the 4,791,556 A 12/1988 Vilkaitis 5,034,916 A 7, 1991 Ordish definition items making up said particular structure that have 5,155,806 A 10, 1992 Hoeber et al. been identified in the provisionally identified pattern; com 5,189,.632 A 2/1993 Paajanen et al. bining the weightings of the determined definition items and 5,390,281 A 2f1995 Luciw et al. optionally, the weighting of the particular structure, to a 5.434,777 A 7, 1995 Luciw single quantity; assessing whether the single quantity fulfils a 5,442,742 A 8/1995 Greyson et al. 5,477.447 A 12/1995 Luciw et al. given condition; depending on the result of said assessment, 5,583,921 A 12/1996 Hidaka rejecting or confirming the provisionally identified pattern. 5,608,624 A 3, 1997 Luciw 5,621,903. A 4/1997 Luciw et al. 12 Claims, 10 Drawing Sheets

Examples Of conventional structure definitions 1: Estate codeindstate :="AL""AK". "WY"; zip codeindode := (0-95); postal code e Ilex: CA, 12345 us State code"." (some spaces us zip code)? Ilex 12345 CA US Zip Code (some spaces us state code)? number = 0-9+; E5. wn steelype :="Street"| "Boulevard".; known city some capitalized words; street addressbind} := number bind-number Some Spaces some capitalized words (known street type bind-type)? Comma or spaces postal code? Some spaces city, US 7,912,828 B2 Page 2

U.S. PATENT DOCUMENTS MacWeek Report, Aug. 8, 1996, 2 pgs. 5,790,875 A 8, 1998 Andersin et al. EMailman() Internet Address Detectors, http://www.emailman. 5,794,142 A 8, 1998 Vanttila et al. com/mac?iad.html, Jan. 12, 2004, 3 pgs. 5,815,138 A 9, 1998 Tsubaki et al. MacAddicts at MacWorld, exclusive.gif, 5 pgs. 5,815,142 A 9, 1998 Allard et al. Apple Data Detectors, Dec. 30, 1996, 7 pgs. 5,838,458 A 11, 1998 Tsai Welcome to Apple Data Detectors, Apple Data Detectors, Mar, 4. 5,859,636 A 1, 1999 Pandit 1997, 19 pgs. 5,864,789 A 1/1999 Lieberman et al. Claris for Macintosh, 62 pages 5,900,005 A 5, 1999 Saito Welcome to Apple Data Detectors, Apple Data Detectors, Apr. 8, 5,946,629 A 8/1999 Sawyer et al. 1997, 11 pgs. 5,946,647 A 8, 1999 Miller et al. 5,966,652 A 10, 1999 Coad et al. James Staten, Special Report Apple Looks to the Future, James 5,987,029 A 11/1999 Kotani et al. Staten, Ziff-Davis Publishing, Aug. 7, 1996, 2 pgs. 6,026,233 A 2/2000 Shulman et al. Mike Langberg, Show of Potential Apple Breaks New Ground by 6,034,689 A 3, 2000 White et al. Displaying What's on Its Drawing Board “Innovation Is At the Heart 6,044,250 A 3/2000 Kuramatsu et al. of What We Do”. Aug. 7, 1996, San Jose Mercury News, 2 pgs. 6,049,796 A 4/2000 Siitonen et al. Apple Introduces InternetAddress Detectors, Technology Makes. It 6,125,281 A 9, 2000 Wells et al. Easier to Manage and Perform Actions with Internet Addresses; 6,222,549 B1 4/2001 Hoddie Extends Innovative Capabilities Delivered with Mac OS 8, http:// 6,249,283 B1 6, 2001 Ur www.apple.com/pr/library 1997/q4/970908pr relinternet. 6,262,735 B1 7/2001 Eteläpera html. Sep. 8, 1997, 3 pgs. 6,282,435 B1 8/2001 Wagner et al. The AppleScript Sourcebook—AppleScript Editors, AppleScript 6,323,853 B1 1 1/2001 Hedloy 6,460,058 B2 10/2002 Koppolu et al. Editors, Utilities & Environments, Tools for creating and using 6,608,637 B1 8, 2003 Beaton et al. AppleScript scripts, including editors, application generators, utili 6,622,306 B1 9, 2003 Kamada ties, and command-line, menu and button bar execution environ 6,711,624 B1* 3/2004 Narurkar et al...... T19,321 ments, webmasterCaappleScriptSourcebook.com. http://www. 7.467,181 B2 12/2008 McGowan et al. AppleScriptSourcebook.com/links/applescripteditors.html, Oct. 13, 2002/0194379 A1* 12/2002 Bennett et al...... TO9,246 2002, 6 pgs. 2004/0042591 A1 3/2004 Geppert et al. ADD Depot, http://web.archive.org/web/20000819081818/http:// 2005/00221 15 A1* 1/2005 Baumgartner et al...... 715,513 homepage.mac.com/matthewmiller/add?, 4pgs. 2005, 0125746 A1* 6/2005 Viola et al...... 71.5/853 Thomas Bonura and James R. Miller Drop Zones, An Extension to 2007/0282900 A1* 12/2007 Owens et al...... TO7 104.1 LiveDoc. http://www.acm.org/sigchi/bulletin? 1998.2/bonura.html . 2008/0293383 A1 11/2008 Rastas SIGCHI, vol. 30, No. 2, Apr. 1998, 9 pgs. 2009 OOO6994 A1 1/2009 Forstall et al. Thomas Bonura and James R. Miller.From Documents to Objects, 2009/0235280 A1 9, 2009 Tannier et al. An Overview of LiveDoc, SIGCHI Bulletin vol.30 No. 2, Apr. 1998: 2009,029.2690 A1 11/2009 Culbert From Documents to Objects, SIGCHI, vol. 30, No. 2, Apr. 1998, 11 FOREIGN PATENT DOCUMENTS pg.S. EP O 458 563 B1 11, 1991 Bonnie A. Nardi, James R. Miller, and David J. Wright, Col EP O 698 845 A1 2, 1996 laborative.Programmable Intelligent Agents, Mar. 1998/vol. 41, No. EP O 698 845 B1 1, 2001 3 Communications of the ACM, pp. 96-104. JP 3O46855. A 2, 1991 A Farewell to the Apple Advanced Technology Group, http://www. JP 10040014. A 2, 1998 acm.org/sigchi bulletin? 1998.2/, SIGCHI, vol. 30, No. 2, Apr. 1998, JP 11088.633 A 3, 1999 3 pgs. WO WO95/34998 12/1995 Apple InternetAddress Detectors User's Manual, Aug. 28, 1997, 16 WO WO 97.32439 9, 1997 pg.S. WO WO99, 66747 12/1999 What are Apple Data Detectors?, JRM (ver 4.0),Copyright (C) 1997 WO WO 2008/109835 A2 9, 2008 Apple Computer, Inc., 5 pgs. WO WO 2009/041982 A1 4/2009 The Apple Data Detectors FAQ, JRM (v. 4.0), Copyright (C) 1997 OTHER PUBLICATIONS Apple Computer, Inc., 3 pgs. Example of e-mail, 1 pg. Lerman, Kristina et al. "Automatically Labeling the Inputs and Out Gregory D. Abowd, Anind Dey, Andy M. Wood, Applying Dynamic puts of Web Services.” Proceedings of the National Conference On Integration as a Software Infrastructure for Context-Aware Comput Artificial Intelligence (AAAI-2006), Menlo Park, CA. 2006, 6 pages. ing, 10 pgs. Lerman, Kristina et al. “Populating the Semantic Web.” Proceedings Milind S. Pandit and Sameer Kalbag. The Selection Recognition of the AAAI 2004 Workshop on Advances in Text Extraction and Agent: Instant Access to Relevant Information and Operations, IUI Mining, 2004, 6 pages. 97, Orlando Florida USA, (C) 1997 ACM 0-89791-839-8/96/01, pp. Lerman, Kristina et al. "Wrapper Maintenance: A Machine Learning 47-52 Approach.” Journal of Artificial Intelligence Research, 18 (2003), pp. Gregory D. Abowd, Anind K. Dey, Robert Orr & Jason Brotherton, 149-181. Context-Awareness in Wearable and Ubiquitous Computing, Pro PCT International Search Report and Written Opinion for PCT Inter ceedings of the First International Syrnposium on Wearable Comput national Applin. No. US2008/002263, mailed Aug. 4, 2008 (12 ers (ISWC 97) 0-8186-8192-6/97 (C) 1997 IEEE, 3 pgs. pages). Andrew Wood, Anind Dey, Gregory D. Abowd, CyberDesk: Auto Eudora Mail Pro, “Windows Version 3.0 User Manual”, Sep. 1996, mated Integration of Desktop and Network Services, CHI97. Atlanta pp. 3 total. GA USA.Copyright 1997 ACM 0-g9791-802-9/97/03, 2 pgs. Eudora Mail Pro, “Version 3.0 for Windows User Manual', Jun. Qualcomm, Eudora ProTM for Newton R, Version 1.0 for Newton 2.0 1997, pp. 198 total. and 2.1, pp. 1-22. Eudora Mail Light, “Version 3.1 for Macintosh User Manual”, Apr. Newton, Apple MessagePad Handbook, pp. 1-358. 1997, pp. 190 total. Newton Solutions Guide, Software, Peripherals and Accessories for International Preliminary Report on Patentability and Written Opin Newton PDAs, 64pgs. ion for International PCT No. PCT/US2008/002263, mailed on Sep. James R. Miller and Thomas Bonura. From Documents to Objects an 3, 2009, pp. 8 total. Overview of LiveDoc, SIGCHI Bulletin vol. 30, No. 2 Apr. 1998, pp. Apple Data Detectors 1.0.2. Read Me, 2 pgs. 53-58. Apple InternetAddress Detectors User's Manual, Aug. 28, 1997, pp. James R. Miller and Thomas Bonura Drop Zones an Extension, 1-16. SIGCHI Bullelin vol. 30, No. 2 Apr. 1998, pp. 59-63. US 7,912,828 B2 Page 3

Chris Schmandt, Phoneshell: the Telephone as Computer Terminal, Proceedings of the Third Annual Conference on Autonomous Agents, 10 pgs. ACM, May 1-5, 1999. Hui Wang, David Bell, John Hughs, Piyush Ojha, Neural network Dunn, JM and Stern, EH.Touch-Screen/Graphics Receive Message approach to relevance, IEEE, 1995, pp. 1961-1965. Application, IBMTDB, IPCOMO001 11975D Apr. 1, 1994.TDB v37 Cara Cunningham, Apple kicks off Macworld with talk of revival, n4A 04-94 p. 451-454, Mar. 26, 2005, 5 pgs. new software demos, InfoWorld Electric, Jan. 11, 2004, 2 pgs. Chris O'Malley.Simonizing the PDA, BellSouth's communicative Writing new detectors for AppleData Detectors, Copyright (C) 1997. Simon is a milestone in the evolution of the PDA, http://web.archive. Apple Computer, Inc., 8 pgs. org/web/19990221 174856/byte.com/art/9412/sec1 1/art3.htm, Dec. Welcome to. AppleWeb, 1997, 4pgs. Apple Data Detectors, Apple Inc., 1997, 4pgs. 1994, 7 pgs. Contextual Menu Manager Apple Data Detectors, 6 pgs. Salahshour, A and Williams, ML, Preferred Media Communication Apple Introduces InternetAddress Detectors, http://www.apple.com/ Establishment Mechanism, IBM Technical Disclosure Bulletin, vol. pr/library/1997/q4/97090Sprrel internet.html, 1997, 44pgs. 37 No. 03 Mar. 1994, 3 pgs. Developer's Guide to AppleData Detectors, for version 1.0.2, Apple Gregory D. Abowd, Anind K. Dey, and Andrew Wood, Future Com Computer, Inc., Dec. 1, 1997. 34pgs. puting Environments, Applying Dynamic Integration as a Software AppleData Detectors User's Manual, Copyright (C) 1997 Apple Com Infrastructure for Context-Aware Computing, Cyberdesk, 1998, 17 puter, Inc., 16 pgs. pg.S. Communications of the ACM, Mar. 1998-vol. 41, No. 3, 12 pgs. Gregory D. Abowd, Anind K. Dey, Gregory Abowd, Robert Orr & First International Symposium on Wearable Computers, IEEE, Oct. Jason Brotherton, Future Computing Environments , Context 13-14, 1997, 8 pgs. Awareness in Wearable and Ubiquitous Computing, 1997, 15 pgs. CHI97 Human Factors in Computing Systems, Mar. 22-27, 1997, 9 Anind K. Dey, Gregory D. Abowd, Future Computing pg.S. Environments. PUI Workshop Submission, CyberDesk: The Use of Proceedings of the ACM Symposium on User InterfaceSoftware and Perception in Context-Aware Computing, 5 pgs. Technology, UIST 97, 10th Annual Symposium on User Interface Anind K. Dey, Future Computing Environments, Context-Aware Software and Technology, Oct. 14-17, 1997.9 pgs. Computing: The CyberDesk Project, Mar. 23-25, 1998, 9 pgs. CyberDesk: A Framework for Providing Self-Integrating Ubiquitous http://web. archive.org/web/1998.02 15054229/www.macos8.com/ Software Services, Anind K. Dey, Gregory Abowd, Mike Pinkerton, macos 8. shtml, 3 pgs. Andrew Wood, 10 pgs. Anind K. Dey, Gregory D. Abowd, Mike Pinkerton, and Andrew AppleData Detectors User's Manual, Copyright (C) 1997 Apple Com Wood, Future Computing Environments, CyberDesk: A Framework puter, Inc., 16 pgs. for Providing Self-Integrating Ubiquitous Software, 1997, 18 pgs. Milind S. Pandit, Sameer Kalbag, The Selection Recognition Agent: Apple Introduces Internet Address Detectors, Technology Makes it Instant Access to Relevant Information and Operations, Copyright (C) Easier to Manage and Perform Actions with Internet Addresses; 1997 ACM 0-89791-839-8.96.01. Extends Innovative Internet Capabil Jties Delivered with Mac OS 8. Michael David Pinkerton, Ubiquitous Computing: Extending Access Sep. 8, 1997. 44pgs. to Mobile Data, Georgia Institute of Technology, May 1997, 98 pgs. Newton 1995 Manual, 1 pg. 1997 International Conference on Intelligent User Interfaces.IUI97 Conference Proceedings, ACM, Jan. 6-9, 1997, 14pgs. * cited by examiner U.S. Patent Mar. 22, 2011 Sheet 1 of 10 US 7,912,828 B2

U.S. Patent Mar. 22, 2011 Sheet 2 of 10 US 7,912,828 B2 () VkSNOILOW