Tutorial: Knowledge Bases for Web Content Analytics Johannes Hoffart Nicoleta Preda Max Planck Institute for Inf. University of Versailles http://mpi-inf.mpg.de/~weikum http://preda.fr Fabian Suchanek Gerhard Weikum Télécom ParisTech Univ. Max Planck Institute for Inf. http://suchanek.name/ http://mpi-inf.mpg.de/~weikum http://resources.mpi-inf.mpg.de/yago-naga/www2015-tutorial/ As for Fabian… I am a great fan of Elvis Presley! Is Elvis still alive? 2 Bing => YES 3 ask> Ask.com => YES 4 Google => NO 5 Wolfram Alpha 6 Wolfram Alpha: How do they know? "Elvis Presley, the first and greatest American rock-and roll star, died yesterday at the age of 42." 7 A knowledge base Information Content Extraction analytics this knowledge base, YAGO, as an example only "Elvis Presley, the first and greatest American rock-and roll star, died yesterday at the age of 42." 8 Knowledge Bases: a Pragmatic Definition For us, a knowledge base (KB) is a comprehensive semantically organized machine-readable collection of universally relevant or domain-specific entities, classes, and facts (attributes, relations) plus spatial and temporal dimensions plus commonsense properties and rules plus contexts of entities and facts (textual & visual witnesses, descriptors, statistics) plus ….. 9 History of Digital Knowledge Bases Cyc WordNet from humans from algorithms for humans for machines guitarist {player,musician} Wikipedia artist x: human(x) ( y: mother(x,y) 4.5 Mio. English articles z: father(x,z)) 20 Mio. contributors 1985 1990 2000 2005 2010 10 Today's knowledge bases > 60 Bio. subject-predicate-object triples from > 1000 sources + Web tables ReadTheWeb Cyc SUMO BabelNet TextRunner/ ReVerb WikiTaxonomy/ ConceptNet 5 WikiNet 11 Cloud diagram from http://lod-cloud.net/ details> Today's knowledge bases Elvis Presley type American singer taxonomic knowledge Elvis Presley type Baritone American singer subclassOf singer Elvis Presley sang All Shook Up factual knowledge Elvis Presley bornIn Tupelo id11: Elvis Presley marriedTo Priscilla Presley temporal knowledge id11 validDuring [1967, 1977] Elvis Presley „has twin brother“ Jesse Garon emerging knowledge Elvis Presley „possibly has origin“ Cherokee Elvis Presley knownAsCloud diagram„The King from of http://lodR&R“ -cloud.net/terminological knowledge12 Freely available knowledge bases YAGO: yago-knowledge.org Dbpedia: dbpedia.org Freebase / Wikidata: freebase.com, wikidata.org Entitycube: entitycube.research.microsoft.com renlifang.msra.cn NELL: rtw.ml.cmu.edu DeepDive: deepdive.stanford.edu Probase: research.microsoft.com/en-us/projects/probase/ KnowItAll / ReVerb: openie.cs.washington.edu reverb.cs.washington.edu BabelNet: babelnet.org WikiNet: www.h-its.org/english/research/nlp/download/ ConceptNet: conceptnet5.media.mit.edu WordNet: wordnet.princeton.edu Linked Open Data: linkeddata.org 13 Use-Case: Internet Search 14 Google Knowledge Graph (Google Blog: „Things, not Strings“, 16 May 2012) 15 Use Case: Question Answering This town is known as "Sin City" & its downtown is "Glitter Gulch" question classification & decomposition IBM Watson System + KBs Las Vegas [Ferrucci et al., AI Magazine 2010] 16 history> Use Case: Analysis of History https://www.recordedfuture.com/ Turn Web into Knowledge Base more knowledge, analytics, insight knowledge acquisition Web Knowledge Contents intelligent interpretation This Tutorial 1. Introduction 2. Harvesting Classes 3. Harvesting Facts 4. Common Sense Knowledge 5. Knowledge Consolidation 6. Web Content Analytics 7. Wrap-Up.