USOO84581 05B2 (12) United States Patent (10) Patent No.: US 8.458,105 B2 Nolan et al. (45) Date of Patent: Jun. 4, 2013 (54) METHOD AND APPARATUS FOR 5,215.426 A 6/1993 Bills, Jr. ANALYZING AND INTERRELATING DATA 5,327.254. A 7/1994 Daher 5,689,716 A 11, 1997 Chen 5,694,523 A 12, 1997 Wical (75) Inventors: James J. Nolan, Springfield, VA (US); 5,708,822 A 1, 1998 Wical Mark E. Frymire, Arlington, VA (US); 5,798,786 A 8, 1998 Lareau et al. Andrew F. David, Ft. Belvoir, VA (US) 5,841,895 A 1 1/1998 Huffman 5,884,305 A 3/1999 Kleinberg et al. (73) Assignee: Decisive Analytics Corporation, 5,903,307 A 5/1999 Hwang Arlington, VA (US) 5,930,788 A 7, 1999 Wical glon, 5,953,718 A 9, 1999 Wical 6,009,587 A 1/2000 Beeman (*) Notice: Subject to any disclaimer, the term of this 6,052,657 A 4/2000 Yamron et al. patent is extended or adjusted under 35 6,064,952 A 5/2000 Imanaka et al. U.S.C. 154(b) by 771 days. 6,073,138 A 6/2000 de l'Etraz et al. 6,085,186 A 7/2000 Christianson et al. 6,173,279 B1 1/2001 Levin et al. (21) Appl. No.: 12/548,888 6,181,711 B1 1/2001 Zhang et al. 6,185,531 B1 2/2001 Schwartz et al. (22) Filed: Aug. 27, 2009 6,199,034 B1 3, 2001 Wical (65) Prior Publication Data (Continued) US 2010/0205128A1 Aug. 12, 2010 OTHER PUBLICATIONS Nolan, Jim, "Attacking the Network.” unknown publication, Nov. Related U.S. Application Data 2007. (60) Provisional application No. 61/152,085, filed on Feb. (Continued) 12, 2009. Primary Examiner — Jeffrey A Gaffin (51) Int. Cl. Assistant Examiner — Ola Olude Afolabi G06N3/12 (2006.01) (74) Attorney, Agent, or Firm — Daniel A. Thomson; (52) U.S. Cl. Emerson Thomson Bennett, LLC USPC ............................................................ 7O6/13 (57) ABSTRACT (58) Field of Classification Search USPC ........................... 706/46, 19, 16, 13; 717/110 A method for automatically organizing data into themes, the See application file for complete search history. method including the steps of retrieving electronic data from at least one data source, storing the data in a temporary (56) References Cited storage medium, querying the data in the storage medium using a computer-based query language, identifying themes U.S. PATENT DOCUMENTS within the data stored in the storage medium using a computer 4,423,884 A 1, 1984 Gewers program including an algorithm, and organizing the data 4,488,174 A 12/1984 Mitchell et al. stored in the storage medium into the identified themes. 4,887.212 A 12/1989 Zamora et al. 5,056,021 A 10, 1991 Ausborn 17 Claims, 8 Drawing Sheets PRESIDENTIAL EFT GUANTANAMO BAYWERDC LIBYA GUANTANAMO 2 SEF, TERRORIST ANDKARADZA 2 s SETTLEMEN s a. CHINESE L TERROR ATACKS m ERRORISMN N IRACANNA 2-AUG 3-AUG 4-AJG ATE - THEM1:TRRORISMNRAQANDINDIA - -THEME2:SPORTS . THEME3: OLYMPICSECURITY ----THEME4:FASONNEWS - THEME5:PARISHILTON AD m-THEME6; GUANTANAMOANKARADZCTRIAL -------THEME 7:CHINESETERRORATTACKS -THEME8: ENERGYPRICES —THEME9: BRUCEWINS SUCIDE - THEME 10:2008 BUDGEFICT - -THEE 11:PASORS WIFE ASSAUS FLIGHTATTENANT US 8,458,105 B2 Page 2 U.S. PATENT DOCUMENTS 7,376,893 B2 5/2008 Chen et al. 7,389,225 B1 6/2008 Jensen et al. 6,327,586 12, 2001 Kisiel 7,389,282 B2 6/2008 Maren 6,394,734 5, 2002 Landoll et al. 7401,057 B2 7, 2008 Eder 6,487,545 11, 2002 Wical 7.406,453 B2 7/2008 Mundie et al. 6,505,151 1, 2003 Chou et al. 7,424427 B2 9, 2008 Liu et al. 6,533,822 3, 2003 Kupiec 7.440,622 B2 10/2008 Evans 6,665,656 12, 2003 Carter 7.447,665 B2 11/2008 Murray 6,675, 159 1, 2004 Lin et al. 7,475,008 B2 1/2009 Jensen et al. 6,714,909 3, 2004 Gibbon et al. 2002fOO65856 A1 5, 2002 Kisiel 6,757,008 6, 2004 Smith 2003/02001.92 A1 10, 2003 Bell et al. 6,772,120 8, 2004 Moreno et al. 2004/OO86268 A1 5, 2004 Radha et al. 6,775,677 8, 2004 Ando et al. 2004O161034 A1 8, 2004 Morozov et al. 6,798.447 9, 2004 Katsuki 2005/0022106 A1 1/2005 Kawai et al. 6,803,946 10, 2004 Wakiyama et al. 2005.0102135 A1 5/2005 Goronzy et al. 6,822,855 11, 2004 Pressley, Jr. et al. 2005/0268279 A1* 12/2005 Paulsen et al. ................ 717/110 6,860,702 3, 2005 Banks 2006.0017814 A1 1/2006 Pinto et al. 6,892, 189 5/2005 Quass et al. 2006/0085434 A1 4/2006 Mah et al. 6,901,392 5/2005 Kindo 2006, O1844.83 A1 8, 2006 Clarket al. 6,940,908 9, 2005 Smith 2006/0235811 A1 10, 2006 Fairweather 6,961,954 11/2005 Maybury et al. 2007.0011108 A1 1/2007 Benson et al. 6,970,881 11/2005 Mohan et al. 2007, OO16540 A1 1/2007 Sun et al. 6,978,274 12, 2005 Gallivan et al. 2007/O112714 A1 5/2007 Fairweather 6,986,633 1, 2006 Kellogget al. 2007/0276775 A1 11/2007 Gloor 7,006,568 2, 2006 Gu et al. 2008. O154821 A1 6/2008 Poulin 7,033,127 4, 2006 Ungetheim et al. 2008, 0208901 A1 8, 2008 Friedlander et al. 7,051,022 5, 2006 Faisal 2008, 0208904 A1 8, 2008 Friedlander et al. 7,069,256 6, 2006 Campos 2008/0288425 A1 11/2008 Posse et al. 7,092,927 8, 2006 Clark et al. 2008/0288.430 A1 11/2008 Friedlander et al. 7,110,459 9, 2006 Srinivasan 2009/0024553 A1 1/2009 Angell et al. 7,114,174 9, 2006 Brooks et al. 2009/00832O7 A1 3/2009 Aparicio, IV 7,143,432 11, 2006 Brooks et al. 2009,0276377 A1 11/2009 Dutta et al. 7,155,668 12, 2006 Holland et al. 7,158,983 1/2007 Willse et al. OTHER PUBLICATIONS 7,184.959 2, 2007 Gibbon et al. 7,191,175 3, 2007 Evans Decisive Analytics Corporation, "Attacking the Network: Five Steps 7,194.483 3, 2007 Mohan et al. to Finding and Stopping the TrueTerrorist Threat.” Decisive Analyt 7,197.451 3, 2007 Carter et al. 7,218,022 5/2007 Pfister et al. ics Corporation White Paper, 2008. 7,225, 183 5/2007 Gardner BBN Technologies, “BBN Broadcast Monitoring System.”unknown 7,226,537 6, 2007 Broyer et al. publication, 2009, www.bbn.com. 7,248,286 7/2007 Cho Decisive Analytics Corporation, “Discovering the Activities of Your 7,251,637 7/2007 Caid et al. Enemies in the News Media.” unknown publication, 2008. 7,258,384 8, 2007 Drabik et al. Boswell, Wendy, “Learn More About Podzinger, a Search Engine 7,266,537 9, 2007 Jacobsen et al. That Searches for the Spoken Word.”unknown publication, unknown 7,271,804 9, 2007 Evans date, www.about.com. 7,283,589 10, 2007 Cai et al. Lei, Gunnewiek. With, “Reuse of Motion Processing for Camera 7,290,207 10, 2007 Colbath et al. 7,292,602 11/2007 Liu et al. Stabilization and Coding.” 2006 IEEE International Conference on 7,292,634 11/2007 Yamamoto et al. Multimedia and Expo. 597-600, 2006. 7,292,636 11/2007 Haskell et al. Mohsenian, Rajagopalan, Gonzales, "Single-Pass Constant- and 7,295,831 11/2007 Coleman et al. Variable-Bit-Rate MPEG-2 Video Compression.” IBM Journal of 7,299,191 11/2007 Hamada Research and Development vol.43, Issue 4, pp. 489-509, Jul. 1999. 7,299,289 11/2007 Lorenz et al. Khayam, Syed Ali, “The Discrete Cosine Transform (DCT): Theory 7,301.999 11/2007 Filippini et al. and Application.” unknown publication, Mar. 10, 2003. 7,302,003 11/2007 Battistella Iaks Nagel Institut Fur Algorithmen Und Kognitive Systeme, "Vid 7,302.481 11/2007 Wilson Text.” unknown publication, Feb. 17, 2005. www.cogviys.iaks.uni 7,304,590 12, 2007 Park karlsruhe.de. 7,307,553 12, 2007 Woo et al. SRI International, “Video Text Recognition.” unknown publication, 7,310,110 12, 2007 Grindstaff et al. 2008, www.sri.com. 7,310,371 12, 2007 Cote et al. 7,313,279 12, 2007 Duan et al. D. D. Palmer, P. Bray, M. Reichman, K. Rhodes, N. White, A. 7,313,556 12, 2007 Gallivan et al. Merlino, F. Kubala, “Multilingual Video and Audio News Alerting.” 7,319,999 1, 2008 Evans referenced by Examiner in Office Action for U.S. Appl. No. 7,324,871 1, 2008 Loscalzo et al. 12,648,978. 7,328,209 2, 2008 Das et al. 7.340,466 3, 2008 Odom et al. * cited by examiner U.S. Patent Jun. 4, 2013 Sheet 1 of 8 US 8.458,105 B2 ETIETSHELEWVYJVESEO>{nOSVLV?ANJEn?dTERSELINJO7\\/+ |EEEEEEEE ~ U.S. Patent US 8.458,105 B2 U.S. Patent Jun. 4, 2013 Sheet 8 of 8 US 8.458,105 B2 c{TERSELIHO7\W+SHELEW\/>'VESEOHnOSVIV?AHED,ETIE? US 8,458,105 B2 1. 2 METHOD AND APPARATUS FOR Sources, they must also extract potentially critical knowledge ANALYZING AND INTERRELATING DATA from vast quantities of available open source information. For example, the process of globalization, empowered by I. BACKGROUND the Information Revolution, will require a change of Scale in the intelligence community's (IC) analytical focus. In the A. Field of Invention past, the IC focused on a small number of discrete issues that This application claims priority to U.S.