SRI Seminar The Nepomuk Project & Social Semantic Desktop & current state of the gnowsis
http://nepomuk.semanticdesktop.org [email protected]
Leo Sauermann [email protected] 7.9.2006 persona created using http://www.sp-studio.de/
Semantic Desktop Overview Who am I?
Semantic Desktop Overview Leo Sauermann • Researcher at the Knowledge Management Lab of the DFKI German Research Center for Artificial Intelligence • Austrian, born & studied in Vienna • Created the Gnowsis Semantic Desktop (Diploma Thesis) - 2003 • Preparation for and now working on the Nepomuk project - 2006 • I need the Semantic Desktop to write down notes and its a step to cyberspace++ • Jack Park and I are in the organization committee of the Semantic Desktop Workshop
Semantic Desktop Overview This talk • Writing down information • PIMO – Ontology system • Nepomuk Project • Gnowsis Project • Walkthrough of the system (and wiki) • Input for discussion Nepomuk VS OpenIris/Calo
Semantic Desktop Overview question:
Semantic Desktop Overview How can I write down information?
Semantic Desktop Overview Information: Nepomuk Nepomuk is an EU project . It’s topic is the Social Semantic Desktop . DFKI coordinates .
Semantic Desktop Overview To write down, I need language
Semantic Desktop Overview A language of the Semantic Desktop • Terms • Types Nepomuk • Relation types Nepomuk is an EU project • Relations . It’s topic is the Social Semantic Desktop . DFKI coordinates . • RDF
Semantic Desktop Overview In RDF Nepomuk @prefix leo: Nepomuk is an EU project
Semantic Desktop Overview PIMO is The “Personal Information Model” • To write down information, we use RDF for the data and and RDF/S ontologies for the semantics • A stack of vocabularies and ontologies • used by the – user – creates instances – creates classes & properties (on the fly) – annotates resources – downloads new vocabularies and ontologies – exchanges data with others
Semantic Desktop Overview PIMO vocabularies / ontologies
Rep Lang • PIMO-Basic dfki.de/ont/pim/pimo basic superclasses defines the basic language constructs. Thing SystemItems • PIMO-Upper A domain-independent SemDesk Upper Level ontology defining abstract domain-independent sub-classes of Thing. • Person Role Time Document Organization s PIMO-Mid: t r More concrete sub-classes o
p of upper-classes. The mid-
im level ontology serves to SemDesk Mid-Level y integrate various domain g
domain-independent, adapted to Semantic o ontologies and provides l o
Desktop and Nepomuk t classes for Person, Project, Contract n Company, etc. o Manager Project Offer Message Company
Semantic Desktop Overview PIMO domain ontologies
• Domain ontologies A set of domain ontologies where each describes a concrete domain of interest of the user. Domain Model: Bibtech A • Vocabularies Organizational Structure – GEO Report – Beer Ontology Heiko Car-Ent EPOS Report56 – DOAP • Shared Ontologies – The user’s company and its organizational structure – a shared project – data collection (SUMO, gene ontology)
Semantic Desktop Overview all PIMO ontology layers
Rep Lang basic superclasses Thing SystemItems dfki.de/ont/pim/pimo SemDesk Upper Level sub-classes domain-independent
Person Role Time Document Organization s t r Native Data Vocabularies o p representing extracted data in RDF/S im SemDesk Mid-Level multiple vocabularies y g image foaf domain-independent, adapted to Semantic o vCard l
o Person Image
Desktop and Nepomuk t Contract vEvent dublin core n o Manager Project Offer Message Company
Domain Model: Bibtech A aperture.semanticdesktop.org/data Organizational Structure Report Heiko Car-Ent EPOS Report56
Semantic Desktop Overview Paul‘s PIMO - Personal Information Model
Rep Lang
SemDesk Upper Level Native Data Vocabularies
SemDesk Mid-Level
Domain: Bibtech A Domain: Paul’s company
PIMO of Person:Paul personal information model of one user Imports all other ontologies and defines extensionPs aul Ontology side Native Resources Paul imports Paul File X e-mail2 all of them Report41 Project Z vCard H
Semantic Desktop Overview State of PIMO in Nepomuk • Nepomuk currently works on the Nepomuk Representational Language (NRL). – extensions to RDF/S. Pruned - limited features – inverse prop, Metadata – will be published soon (2006) • upper, mid, and domain ontologies are expressed in NRL – will be published later (Dec 2006?)
Semantic Desktop Overview Ontologies with quality • peer review • formal description • good URLs • written documentation • examples • validation rules
Semantic Desktop Overview Integration: The Social Semantic Desktop
Semantic Desktop Overview From existing structures to PIMO
• Existing data is expressed in RDF – documents, files, e-mails, address book, ... – represented as RDF • Matching & Creation Algorithm “Rebirth Machine” • Personal Information Model – Personal Concepts • Topics • Places • People • Types • Workflow • with relations to files and folders Semantic Desktop Overview Nepomuk Desktop Data Services • Two example implementations: – Aperture – Beagle++ • a service to extract data, a middleware for data integration on the desktop • used to crawl data for desktop search
• description of this standard is due Dec 2006
Semantic Desktop Overview Nepomuk
Semantic Desktop Overview Goal: Build the Social Semantic Desktop Desktop: Help individuals in managing information on their PC Semantic: Make content available to automated processing Social: Enable exchange across individual boundaries
Person Email Event friend Topic acquaintance Person WebSite Document colleague Image
Personal Semantic Web:a semantically enlarged Social protocols NEPOMUK enabled intimate supplement to memory and distributed search peers
Semantic Desktop Overview NEPOMUK will deliver …
• The freely available open-source framework comprises – Standardized interfaces, architecture, ontologies – Plug-in architecture, extendable to suit application needs – Building upon standard semantic web technology • A set of reference implementations covers representative application domains – Consulting, BioScience, Strategic planning, Distributed Community work • A vivid community ensures uptake and extension beyond the project‘s duration – Active scientific community (http://semanticdesktop.org) – Involvement of open source developer communities – Setup of user groups and domain-specific application communities
Semantic Desktop Overview NEPOMUK realizes the basis for manifold exploitation •Commercial Individual exploitation 3 exploitation by concentrates on uptake, adaptation, and commercialization dedicated spin-offs After 3-5 years by tool adaptors & consultation services, i.e. spin-offs •Specific product development •Wide societal impact 2 After 2-3 years Exploit externally
•External application of After first 18 months project results by industrial partners 1 (initial project results are available) •Uptake in the scientific community NEPOMUK Exploit •Wide-scale awareness internally within open source •Internal exploitation community •Initial awareness via open source and scientific communities Collective exploitation will focus on establishing & maintenance of a vivid scientific society Pursuing standardization and platform & prototype development Collective support of standardization efforts (e.g. W3C working group)
Semantic Desktop Overview The NEPOMUK consortium unites industry, research, and representative users
Semantic Desktop Overview NEPOMUK is a three-year Integrated Project within the EU 6th Framework Programme
• Project FP6-027705 NEPOMUK • Duration: 1.1.2006 – 31.12.2008 • EC contribution: 11.5 M€ (Total budget: 17.1 M€)
• For further information, please contact – Project website: http://nepomuk.semanticdesktop.org – E-mail: [email protected] – Coordinator: Dr. Ansgar Bernardi Erwin-Schrödinger-Str. 67663 Kaiserslautern Germany Tel. +49-631-205-3583
Semantic Desktop Overview gnowsis prototype
Semantic Desktop Overview Gnowsis is a prototype of predecessor projects • service oriented architecture • integrates various applications • semantic wiki • continous development, Java, Sesame2, Jena, ontologies, PIMO • beta 0.9.1 version
• walkthrough
Semantic Desktop Overview Semantic Applications
PIMO Editor Personal Wiki Application Plugins Desktop Applications
Web 2.0 Interfaces
Domain Gnowsis Ontologies Sesame2 Server Repository Aperture Outlook Crawlers Clustering Ont. Matching PIMO Store Outlook Tagging Gui invocation Resource Store
Configuration Store Files filesystem Crawler Desktop Search Service Store e-mail Lucene Index e-mail server
Semantic Desktop Overview PIMO is filled • automatically from data
aperture.sf.net (check it out!) Data Paul‘s files & e-mails
PIMO Store RDF Database
matching to adapter ontology to RDF
Semantic Desktop Overview
Aperture.
Semantic Desktop Overview Aperture • A java framework for getting data and metadata • extracts full-text content • and metadata • from various file formats • and structured data sources – IMAP – Outlook – flickr.com
Semantic Desktop Overview
Semantic Desktop Overview related work
Semantic Desktop Overview Semantic Desktop Overview Features of IRIS
Semantic Desktop Overview Iris Layers
Semantic Desktop Overview Clustering email is colored - each word colored to indicate cluster. general sense of how this email relates to one or more projects.
Semantic Desktop Overview Similarities to Nepomuk • cognitive Assistant (CALO) - similar goal • all AI that is possible: – LSA, DSA, clustering, NLP … • focus on PIM • annotations, RDF, Ontologies
IRIS: Integrate. Relate. Infer. Share. Adam Cheyer and Jack Park and Richard Giuli SemantiPc rDoecsekteopd iOnvgesrv oiefw the 1st Workshop on The Semantic Desktop 2005 Differences to Nepomuk? Nepomuk has • service oriented architecture • peer to peer and social exchange • consortium, review and standardization process OpenIRIS has • tested and useful AI scenarios • a working prototype • a core team on-site (=effective) ???
Semantic Desktop Overview Science Fiction
KM group UI group great KM system fancy Semantic UI
EAI group adapters
p2p collaboration Web Services group great protocol
Semantic Desktop Overview Summary • writing down information • PIMO – Ontology system • nepomuk Project • gnowsis Project • walkthrough of gnowsis Lets discuss: • Nepomuk VS OpenIris/Calo
Semantic Desktop Overview Thanks, Questions?
You listening
Jack Park organizing today’s seminar Nepomuk people sharing the idea Gunnar Grimnes sharing the work Ansgar Bernardi managing me
BMBF funding parts of this IST funding most of this Ingrid Brunner (wife) Loving Me Jesus Loving Me+
Semantic Desktop Overview Application: Drop Box
• Helps filing information • uses PIMO structures PIMO of Paul concepts and folders doc: Project:Epos • uses DOCS for text similarity … EPOS … = EPOS, DFKI, Maus, … • Knows the users model and is trained by using it • process flow – files are stored into a Drop-Box folder – files are text-analysed and possible target folders are suggested – Drop-Box user interface shows – user selects a folder, classify – files are moved and classified • not used, but obvious: OBS – current context
Semantic Desktop Overview Weird Experiments with gnowsis: alternative user interfaces
Ultima Online
Foafnaut
Fenfire
Semantic Desktop Overview Context Assistance • Sidebar • can be switched off • shows current context – documents – people – projects – topics • changes dynamically • use: open related information, pro-active, non-obtrusive assistance system
Semantic Desktop Overview Application: Drop Box
• Helps filing information • uses PIMO structures PIMO of Paul concepts and folders doc: Project:Epos • uses DOCS for text similarity … EPOS … = EPOS, DFKI, Maus, … • Knows the users model and is trained by using it • process flow – files are stored into a Drop-Box folder – files are text-analysed and possible target folders are suggested – Drop-Box user interface shows – user selects a folder, classify – files are moved and classified • not used, but obvious: OBS – current context
Semantic Desktop Overview Semantic Search
• search over EPOS data (PIMO) • can be personalized using rules SPARQL queries • example # found something? -> infer other representations via SPARQL (?hit retrieve:item ?x) -> querySparql('CONSTRUCT { ?x pimbasic:hasOtherRepresentation ?y } ')
# found a project? -> also show members (?hit retrieve:item ?project), (?project rdf:type org:Project) -> querySparql('CONSTRUCT { ?project org:containsMember ?m. }). • Innovation – search result expansion using SPARQL – customized rules for search – only when word “x” is searched, include these results, etc
Semantic Desktop Overview search
Semantic Desktop Overview Context Service • Plugins gather user actions • Elicitation of task concepts • Notification of GUI
PIM Basic
PIM Upper Bayesian Network Wf Task Wf Task PIM Mid DFKI KM
TaCo PIMMaus
UA UA UA
Domain Domain
NOP NOP NOP NOP NOP
Paul Semantic Desktop Overview The nepomuk project
• Different research institutes are working on a vision titled "Semantic Desktop", a semantically enhanced desktop computer that allows us to access semantic web data and desktop data in a uniform way. The European Union Integrated Project NEPOMUK (http://nepomuk.semanticdesktop.org) started in 2006 and intends to realize and deploy a comprehensive solution – methods, data structures, and a set of tools – for extending the personal computer into a collaborative environment, which improves the state of art in online collaboration and personal data management and augments the intellect of people by providing and organizing information created by single or group efforts. NEPOMUK brings together researchers, industrial software developers, and representative industrial users. In this talk you will get an introduction on the theory behind the Semantic Desktop, ontologies, databases, user interfaces and projects that work on this topic. Details about the current open-source implementations are presented and a demo is given. The lecture will finish with a discussion, where similarities and differences to the OpenIRIS project by SRI will be an important question.
Semantic Desktop Overview Semantic Desktop Overview Semantic Desktop Overview