Structuring Medical Records with Apache Stanbol

Total Page:16

File Type:pdf, Size:1020Kb

Structuring Medical Records with Apache Stanbol Structuring Medical Records with Apache Stanbol Rafa Haro, Senior Software Engineer, Athento Antonio Pérez Morales, Senior Software Engineer, Ixxus • Committer, PMC Member @ Apache Stanbol, Apache ManifoldCF • Topics: Document Analysis, NLP, Machine Learning, Semantic Technologies, ECM • Committer @ Apache Stanbol, Apache ManifoldCF • Topics: ECM, Semantic Search, ETL, Machine Learning Apache Stanbol provides a set of reusable components for semantic content management. It extends existing CMSs with a number of semantic services. Traditional Semantic CMS Software Architecture for Semantically Enabled CM and ECM systems Apache Stanbol Story • Started within FP7 European Project IKS (Interactive Knowledge Stack. 2009 - 2012) • IKS project brought together an Open Source Community for Defining and Building Platforms in the Semantic CMS Space • Incubated in November 2010 • Successfully promoted within CMS and ECM industry through IKS Early Adopters Program • Graduated to Top-Level Apache Project in October 2012 What is a Semantic CMS? Traditional CMS Semantic CMS Atomic Unit: Document Atomic Unit: Entity Properties as meta-data Semantic meta-data (key-value schemas) (RDF) Keyword Search Semantic Search Document Management Knowledge Management Document Types Entity Management Document Workflow Ontologies Source: What Apache Stanbol Can Do for You?. Fabian Christ. ApacheCon Europe 2012 Key Points • Designed to bring Semantic Technologies to existing CMS • Non-intrusive set of RESTful ‘Semantic’ Services • Extremely Modular: Use only the modules you need • Main Features: • Multilingual Content Enhancement: Structure Content through Semantic Metadata • Knowledge Bases Management • Knowledge Models and Reasoning • Semantic Indexing and Search Stanbol Components • Stanbol components provide: Page: 6 • RESTful API Service-Oriented View • Java APIs and OSGi services VIE - User Interface Layer VIE VIE • Stanbol components do NOTWidgets depend on each other • however they can be easily combinedApache S ttoanb ol Service Layer Apache Apache Apache Apache Stanbol Stanbol Stanbol Stanbol Enhancer EntityHub Ontology Manager Reasoners Apache Apache Apache Stanbol Stanbol Stanbol Rules ContentHub FactStore Stanbol Enhancement Engines Apache Stanbol Apache Stanbol CMS Adapter Component Layer www.iks-project.eu Copyright IKS Consortium Stanbol Components (II) • Enhancer: Extracts Knowledge from unstructured parsed content • EntityHub: Manage Domain Entities and Topics (Knowledge Bases) • ContentHub: Semantic Indexing / Search over your - semantic enhanced - Content • CMS Adapter: Sync. your CMS with Apache Stanbol (JCR/CMIS) • Ontology Manager: Manage you formal Domain Knowledge • Reasoners & Rules: Apply Domain Knowledge to improve / validate extracted Information. Refactor / refine knowledge to align it to public schemas such as schema.org Built on Top of Apache…. • Apache Felix as OSGi environment • Apache Sling launchers and OSGi Tools • Apache Maven for building • Apache Clerezza as RDF Framework • Apache Jena as TripleStore • Apache Solr for Knowledge Bases Management • Apache Tika for converting input • Apache OpenNLP for NLP Processing Integration Scenarios • Stand-Alone Server (Stanbol Launchers) • Web Application (Servlet-Container) • Embedded within an OSGi environment Source: What Apache Stanbol Can Do for You?. Fabian Christ. ApacheCon Europe 2012 Project Current Status Apache Stanbol IKS Project Ending Apache Stanbol Apache Stanbol Incubation Graduation 0.9.0-incubating (Dec 2012) 0.12.0 1.0.0 (Nov 2010) (October 2012) (Aug 2012) (March 2014) (October 2016) Contributions (commits) to Trunk Since Incubation Project Current Status (II) • 22 PMC Members (Last Addition Jul 2016) • 26 Committers (Last Addition May 2015) • 3-5 active committers last 2 years • [email protected]: 228 subscribers • Activity has been gradually decreasing • 3 major releases Source: Apache Stanbol Committee Report Helper (https://reporter.apache.org/?stanbol) Stanbol Enhancer RDF Stanbol Enhancer (II) Stanbol Enhancer (III) Stanbol Enhancement Chains • Define how Content is processed by the Enhancer through an ExecutionPlan • Different Implementations: • ListChain: in order sequential enhancement engines execution. Parallel Execution of engines not supported • WeightedChain: ExecutionPlan is calculated using the engines order metadata. Parallel Execution of engines allowed • API: • /enhancer: executes the default chain • /enhancer/chain/{chain-name}: executes a concrete named chain • /enhancer/engine/{engine-name}: executes a concrete named engine Current Enhancement Engines • Preprocessing • Tika Engine • content type detection • text extraction from several document formats • metadata extraction from several document formats • Natural Language Processing • Language Detection (different implementations) • Sentence Detection (OpenNLP, SmartCN, REST) • Tokenizer (OpenNLP, SmartCN, REST) • POS Tagging (OpenNLP, REST) • Chunking (OpenNLP, REST) • NER (OpenNLP, OpenCalais, REST) • Entity Linking • Named Entity Linking • EntityHub Linking Engine • FST (Lucene Finit State Transducer) Linking Engine • Entity Co-mention • Commercial Engines (OpenCalais, Zemanta, CELI…) • Sentiment Analysis • Disambiguation • DBPedia Spotlight • Solr MLT based • PostProcessing: • Dereferencing Stanbol EntityHub Stanbol EntityHub (II) • Manage Multiple Entity Sources (Knowledge Bases) • Allows Fast Entity-Lookup using Apache Solr • Referenced Site (Remote LD + Local Caches) Vs Managed Site (Entity CRUD Api over manually configured Sites) • API: • Query for Entities (used by Entity Linking Engines) curl -X POST -d "name=lyon&limit=10" \ http://localhost:8080/entityhub/site/dbpedia/find • CRUD for Managed Sites friend-names = foaf:knows/foaf:name • LDPath support for: • Graph Path Retrieval (Used for dereferencing) • Schema Translation schema:name = rdfs:label[@en]; • Simple Reasoning Use Case: Hexin Project - Structuring Medical Records • R&D Project for Sergas (Galician Public Health Office) • Clinical Data Analysis Platform for supporting: • Clinical Assistance • Epidemiology studies • Medical Research • Big Data approach for analyzing both structured historical clinical data and unstructured medical records • Medical Records are written in Spanish and Galician Hexin: Architecture Event Detection New Case Process Reference Cases Detection Process BIG DATA (HDFS + PatientId HIVE) Date BI Structured Events Semantic Events Symptoms: Rules • Cough URX • Unrest ETL Data Source Cassandra Unrest Cough Fever>38 Patient Validation Analysis Hexin: Semantic Tagging Hexin: Objective “Paciente diabético desde los 5 años y con EPOC moderada grado 2 de la GOLD” Hexin:Solution Design • Structure Medical Records using Apache Stanbol Enhancer • Custom Ontology: • Symptoms • Diseases • Diagnosis Tests • Family and Personal History • Custom Enhancement Chain: • Language Detection > NLP > Entity Linking > Negation Detection > Fact Extraction Hexin: Ontology Hexin: Ontology Indexing • For supporting the Entity Linking process against Hexin Ontology, an EntityHub site must be created • 2 options: • ManagedSite: full CRUD storage <-> DYNAMIC • ReferencedSite: READ-ONLY remote site + local index • Stanbol EntityHub Indexing Tool: hexin:* • RDF —> JenaTDB —> Solr Index hexin:label > rdfs:label • Configure Custom Namespaces, Mappings and Properties • Generates an OSGi Bundle with the Yard and YardSite default configurations • Copy the index to Stanbol /datafiles folder and install the bundle using Apache Felix OSGi Web Console Hexin: Enhancement Chain Lang. Detect. OpenNLP-Sent. OpenNLP-Token OpenNLP-POS OpenNLP-Chunker Hexin Linking Fact Extract. Negex Custom Hexin Engine. Implemented for the project Entity Linking Engine. Available in Stanbol with a Custom Configuration for this use case NLP Engines. Available in Stanbol. Default Configuration Pre-Processing Engine. Available in Stanbol Hexin: Linking Hexin: Linking (II) Hexin: Custom Engines @Component @Service OSGi bundle public class MyEngine implements EnhancementEngine { Maven build MANIFEST.MF @Activate public void activate(ComponentContext c) { OSGi // initialize, configure, ... metadata } maven-bundle- plugin registered by OSGi public int canEnhance(ContentItem item) { adds OSGI metadata if(...item matches our expectations...) { MyEngine return ENHANCE_SYNCHRONOUS; Service } else { return CANNOT_ENHANCE; maven-scr-plugin } adds services metadata } public void computeEnhancements(ContentItem item) { // run the engine and add results to item’s Install in // RDF graph based on the item’s InputStream Stanbol } no restart } needed NLP at Apache Stanbol NLP at Apache Stanbol (II) • Browsable Map with Spans • Spans sorted by Natural Order Stanbol is an Amazing Tool • Iterator based API that allows Token concurrent Modifications Chunk • Annotations supported at Spans Level Sentence • POS Annotation • PosTag Span Types: tag (e.g. NE) • Token lexical category (e.g. Noun) • Chunk • Phrase Annotation (chunks) • Sentence • Text Section • PhraseTag tag (e.g. NP) • Analyzed Text lexical-category (e.g. NounPhrase) • Sentiment Annotation • SentimentTag:: Double Hexin Custom Engine: Negex • Context/Negex: Algorithm for Negation Detection • Based on Triggers-Terms + Regex public abstract class AbstractNegexDetector implements NegexDetector { @Override public Set<IRI> detectNegations(String language, Graph metadata, AnalysedText at) throws NegexException{} protected abstract boolean isNegated(String language, String concept, String sentence); } Chapman WW, Bridewell
Recommended publications
  • Creating Dashboards and Data Stories Within the Data & Analytics Framework (DAF)
    Creating dashboards and data stories within the Data & Analytics Framework (DAF) Michele Petitoc, Francesca Fallucchia,b and De Luca Ernesto Williama,b a DIII, Guglielmo Marconi University, Via Plinio 44, 00193 Roma RM, Italy E-mail: [email protected], [email protected] b DIFI, Georg Eckert Institute Braunschweig, Celler Str. 3, 38114 Braunschweig, German E-mail: [email protected], [email protected] c DIFI, Università̀ di Pisa, Lungarno Antonio Pacinotti 43, 56126, Pisa PI, Italy E-mail: [email protected] Abstract. In recent years, many data visualization tools have appeared on the market that can potentially guarantee citizens and users of the Public Administration (PA) the ability to create dashboards and data stories with just a few clicks, using open and unopened data from the PA. The Data Analytics Framework (DAF), a project of the Italian government launched at the end of 2017 and currently being tested, integrates data based on the semantic web, data analysis tools and open source business intelli- gence products that promise to solve the problems that prevented the PA to exploit its enormous data potential. The DAF favors the spread of linked open data (LOD) thanks to the integration of OntoPiA, a network of controlled ontologies and vocabularies that allows us to describe the concepts we find in datasets, such as "sex", "organization", "people", "addresses", "points of inter- est", "events" etc. This paper contributes to the enhancement of the project by introducing the process of creating a dashboard in the DAF in 5 steps, starting from the dataset search on the data portal, to the creation phase of the real dashboard through Superset and the related data story.
    [Show full text]
  • ECM Platforms: the Next Generation of Enterprise Content Management
    ECM Platforms: The Next Generation of Enterprise Content Management The Evolution of ECM: Platform Oriented, Flexible, Architected for the Cloud and Designed for Technologists Over the last decade, content technology, use and expectations have signicantly evolved - redening the requirements for architects, project managers and developers responsible for implementing ECM solutions. Emerging best practices suggest that a well-designed ECM platform supports solution development and deployment in a manner that is predictable, sustainable and aordable. This white paper explores these content technology changes, and explains the value and benets to business and technical adopters of embracing a new generation of ECM platform technology. Eric Barroca, Roland Benedetti - August 12, 2011 © Copyright 2011 - 2012 Nuxeo. All Rights Reserved. www.nuxeo.com Taking a Platform Approach to Building Content Centric Applications Contents Executive Summary_______________________________________________________4 Scope and Goals__________________________________________________________4 Target Audience__________________________________________________________4 Defining Enterprise Content and Enterprise Content Management_______________5 What Is Enterprise Content Management?_____________________________________5 What Is Enterprise Content?_________________________________________________6 Drivers for ECM Adoption___________________________________________________6 Enterprise Content Trends__________________________________________________8 ECM: It's not Just
    [Show full text]
  • State of the Art Technologies and Architectures for EMPOWER
    Deliverable D3.1.1 State of the Art Technologies and Architectures for EMPOWER Project title: Support of Patient Empowerment by an intelligent self- management pathway for patients Project acronym: EMPOWER Project identifier: FP7-ICT-2011-288209 Project instrument: STREP Web link: www.empower-fp7.eu Dissemination level: PU (public) Contractual delivery: 2012-06-30 Actual delivery: 2012-06-28 Leading partner: HMGU The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement No 288209, EMPOWER Project. FP7-288209 EMPOWER Document History Version Date Changes From Review HMGU, V0.1 2012-02-29 Initial Document All Partners SRFG V0.2 2012-05-15 Content added All Partners All Partners V0.4 2012-05-25 Comments SRFG All Partners MOH, SRFG, V0.5 2012-06-14 Content added All Partners GOIN HMGU, V0.6 2012-06-19 Content added All Partners ICOM HMGU, V0.7 2012-06-22 Content added SRFG, MOH, All Partners GOIN, USI V1.0 2012-06-27 Final revision All Partners - EMPOWER Consortium Contacts Beneficiary Name Phone E-Mail SRFG Manuela Plößnig +43 662 2288 402 [email protected] HMGU Claudia Hildebrand +49 89 3187 4182 [email protected] GOIN Siegfried Jedamzik +49 8 41956161 [email protected] USI Peter J. Schulz +41586664724 [email protected] SRDC Asuman Dogac +90 312 210 13 93 [email protected] ICOM Ilias Lamprinos +302106677953 [email protected] MOH Ali Kemal Caylan +903125851907 [email protected] d311_empower_technologies-and-architectures-v10.docx 2 / 136 FP7-288209 EMPOWER Table of Contents 1 Summary .......................................................................................................................
    [Show full text]
  • Full-Graph-Limited-Mvn-Deps.Pdf
    org.jboss.cl.jboss-cl-2.0.9.GA org.jboss.cl.jboss-cl-parent-2.2.1.GA org.jboss.cl.jboss-classloader-N/A org.jboss.cl.jboss-classloading-vfs-N/A org.jboss.cl.jboss-classloading-N/A org.primefaces.extensions.master-pom-1.0.0 org.sonatype.mercury.mercury-mp3-1.0-alpha-1 org.primefaces.themes.overcast-${primefaces.theme.version} org.primefaces.themes.dark-hive-${primefaces.theme.version}org.primefaces.themes.humanity-${primefaces.theme.version}org.primefaces.themes.le-frog-${primefaces.theme.version} org.primefaces.themes.south-street-${primefaces.theme.version}org.primefaces.themes.sunny-${primefaces.theme.version}org.primefaces.themes.hot-sneaks-${primefaces.theme.version}org.primefaces.themes.cupertino-${primefaces.theme.version} org.primefaces.themes.trontastic-${primefaces.theme.version}org.primefaces.themes.excite-bike-${primefaces.theme.version} org.apache.maven.mercury.mercury-external-N/A org.primefaces.themes.redmond-${primefaces.theme.version}org.primefaces.themes.afterwork-${primefaces.theme.version}org.primefaces.themes.glass-x-${primefaces.theme.version}org.primefaces.themes.home-${primefaces.theme.version} org.primefaces.themes.black-tie-${primefaces.theme.version}org.primefaces.themes.eggplant-${primefaces.theme.version} org.apache.maven.mercury.mercury-repo-remote-m2-N/Aorg.apache.maven.mercury.mercury-md-sat-N/A org.primefaces.themes.ui-lightness-${primefaces.theme.version}org.primefaces.themes.midnight-${primefaces.theme.version}org.primefaces.themes.mint-choc-${primefaces.theme.version}org.primefaces.themes.afternoon-${primefaces.theme.version}org.primefaces.themes.dot-luv-${primefaces.theme.version}org.primefaces.themes.smoothness-${primefaces.theme.version}org.primefaces.themes.swanky-purse-${primefaces.theme.version}
    [Show full text]
  • Kyriakakisalexandros2019.Pdf
    TECHNOLOGICAL EDUCATIONAL INSTITUTE OF CRETE SCHOOL OF ENGINEERING DEPARTMENT OF INFORMATICS ENGINEERING THESIS ONTOLOGY-BASED SEARCH ENGINE WITH SPEECH RECOGNITION ALEXANDROS KYRIAKAKIS SUPERVISOR PROFESSOR MANOLIS TSIKNAKIS HERAKLION FEBRUARY 2019 Kyriakakis Alexandros Copyright ALEXANDROS KYRIAKAKIS 2019 Formal Declaration: We assure you that we are authors of this bachelor thesis and that the assistance we received during its preparation is fully recognized and it is stated in the thesis. Also, we have stated all the sources which we made use of data, ideas or words from, either in their exact form or changed. We also assure you that this thesis was prepared by us personally for the curriculum of the Department of Informatics Engineering of TEI of Crete. Υπεύθυνη Δήλωση: Βεβαιώνουμε ότι είμαστε συγγραφείς αυτής της πτυχιακής εργασίας και ότι κάθε βοήθεια την οποία είχαμε για την προετοιμασία της, είναι πλήρως αναγνωρισμένη και αναφέρεται στην πτυχιακή εργασία. Επίσης έχουμε αναφέρει τις όποιες πηγές από τις οποίες κάναμε χρήση δεδομένων, ιδεών ή λέξεων, είτε αυτές αναφέρονται ακριβώς είτε παραφρασμένες. Επίσης βεβαιώνουμε ότι αυτή η πτυχιακή εργασία προετοιμάστηκε από εμάς προσωπικά ειδικά για τις απαιτήσεις του προγράμματος σπουδών του Τμήματος Μηχανικών Πληροφορικής του Τ.Ε.Ι. Κρήτης. 2 Ontology-based search engine with speech recognition Abstract Searching for data throughout the internet is not always an easy task. The reason for that is that the internet is flooded with data and the most common searching techniques often fail to provide the best possible results for the users’ needs. Therefore, researchers have for years been trying to find alternative ways of searching. Through that research, searching techniques based on semantic technologies have emerged.
    [Show full text]
  • Developer Documentation
    Developer Documentation Nuxeo Platform 5.5 Table of Contents 1. Technical Documentation Center . 4 1.1 Overview and Architecture . 5 1.2 Overview . 6 1.3 Architecture . 9 1.3.1 Architecture overview . 9 1.3.2 About the content repository . 12 1.3.2.1 VCS Architecture . 21 1.3.3 Platform features quick overview . 30 1.3.4 Component model overview . 32 1.3.5 API and connectors . 36 1.3.6 UI frameworks . 39 1.3.7 Deployment options . 42 1.3.8 Performance management for the Nuxeo Platform . 47 1.4 Customization and Development . 53 1.4.1 Learning to customize Nuxeo EP . 54 1.4.2 Document types . 55 1.4.3 Document, form and listing views . 62 1.4.3.1 Layouts (forms and views) . 62 1.4.3.1.1 Manage layouts . 63 1.4.3.1.2 Document layouts . 70 1.4.3.1.3 Layout display . 71 1.4.3.1.4 Standard widget types . 72 1.4.3.1.5 Custom templates . 73 1.4.3.1.6 Custom widget types . 85 1.4.3.1.7 Generic layout usage . 93 1.4.3.2 Content views . 93 1.4.3.2.1 Custom Page Providers . 100 1.4.3.2.2 Page Providers without Content Views . 101 1.4.3.3 Views on documents . 102 1.4.4 Versioning . 104 1.4.5 User Actions (links, buttons, icons, tabs) . 105 1.4.6 Events and Listeners . 108 1.4.6.1 Scheduling periodic events . 113 1.4.7 Tagging .
    [Show full text]
  • Code Smell Prediction Employing Machine Learning Meets Emerging Java Language Constructs"
    Appendix to the paper "Code smell prediction employing machine learning meets emerging Java language constructs" Hanna Grodzicka, Michał Kawa, Zofia Łakomiak, Arkadiusz Ziobrowski, Lech Madeyski (B) The Appendix includes two tables containing the dataset used in the paper "Code smell prediction employing machine learning meets emerging Java lan- guage constructs". The first table contains information about 792 projects selected for R package reproducer [Madeyski and Kitchenham(2019)]. Projects were the base dataset for cre- ating the dataset used in the study (Table I). The second table contains information about 281 projects filtered by Java version from build tool Maven (Table II) which were directly used in the paper. TABLE I: Base projects used to create the new dataset # Orgasation Project name GitHub link Commit hash Build tool Java version 1 adobe aem-core-wcm- www.github.com/adobe/ 1d1f1d70844c9e07cd694f028e87f85d926aba94 other or lack of unknown components aem-core-wcm-components 2 adobe S3Mock www.github.com/adobe/ 5aa299c2b6d0f0fd00f8d03fda560502270afb82 MAVEN 8 S3Mock 3 alexa alexa-skills- www.github.com/alexa/ bf1e9ccc50d1f3f8408f887f70197ee288fd4bd9 MAVEN 8 kit-sdk-for- alexa-skills-kit-sdk- java for-java 4 alibaba ARouter www.github.com/alibaba/ 93b328569bbdbf75e4aa87f0ecf48c69600591b2 GRADLE unknown ARouter 5 alibaba atlas www.github.com/alibaba/ e8c7b3f1ff14b2a1df64321c6992b796cae7d732 GRADLE unknown atlas 6 alibaba canal www.github.com/alibaba/ 08167c95c767fd3c9879584c0230820a8476a7a7 MAVEN 7 canal 7 alibaba cobar www.github.com/alibaba/
    [Show full text]
  • Data Quality Centric Application Framework for Big Data
    ALLDATA 2016 : The Second International Conference on Big Data, Small Data, Linked Data and Open Data (includes KESA 2016) Data Quality Centric Application Framework for Big Data Venkat N. Gudivada∗, Dhana Rao y, and William I. Grosky z ∗Department of Computer Science, East Carolina University, USA yDepartment of Biology, East Carolina University, USA zDepartment of Computer and Information Science, University of Michigan - Dearborn, USA email: [email protected], [email protected], and [email protected] Abstract—Risks associated with data quality in Big and load (ETL) process and analyze large datasets. Pig Data have wide ranging adverse implications. Current re- generates MapReduce jobs that perform the dataflows search in Big Data primarily focuses on the proverbial and thus provides a high level abstract interface to harvesting of low hanging fruit and applications are de- veloped using the Hadoop Ecosystem. In this paper, we MapReduce. The Pig Latin enhances the Pig through a discuss the risks and attendant consequences emanating programming language extension. It provides common from data quality in Big Data. We propose a data quality data manipulation operations such as grouping, joining, centric framework for Big Data applications and describe an and filtering. Hive is a tool for enabling data summa- approach to implementing it. rization, ad hoc query execution, and analysis of large Keywords—Big Data; Data Quality; Data Analytics; Application Framework. datasets stored in HDFS-compatible file systems. In other words, Hive serves as a SQL-based data warehouse for the Hadoop Ecosystem. I. Introduction The other widely used tools in the Hadoop Ecosys- Big Data, which has emerged in the last five years, tem include Cascading, Scalding, and Cascalog.
    [Show full text]
  • How the Apache Community Upgrades Dependencies: an Evolutionary Study?
    Empirical Software Engineering manuscript No. (will be inserted by the editor) How the Apache Community Upgrades Dependencies: An Evolutionary Study? Gabriele Bavota Gerardo Canfora · · Massimiliano Di Penta Rocco Oliveto · · Sebastiano Panichella the date of receipt and acceptance should be inserted later Abstract Software ecosystems consist of multiple software projects, often in- terrelated by means of dependency relations. When one project undergoes changes, other projects may decide to upgrade their dependency. For exam- ple, a project could use a new version of a component from another project because the latter has been enhanced or subject to some bug-fixing activities. In this paper we study the evolution of dependencies between projects in the Java subset of the Apache ecosystem, consisting of 147 projects, for a period of 14 years, resulting in 1,964 releases. Specifically, we investigate (i) how de- pendencies between projects evolve over time when the ecosystem grows, (ii) what are the product and process factors that can likely trigger dependency upgrades, (iii) how developers discuss the needs and risks of such upgrades, ? This paper is an extended version of the paper: “Gabriele Bavota, Gerardo Canfora, Massimiliano Di Penta, Rocco Oliveto, Sebastiano Panichella: The Evolution of Project Inter-dependencies in a Software Ecosystem: The Case of Apache. 2013 IEEE International Conference on Software Maintenance, ICSM 2013, Eindhoven, The Netherlands, September 22-28, 2013: 280-289, IEEE” Gabriele Bavota Dept of Engineering, University of Sannio, Benevento (BN), Italy E-mail: [email protected] Gerardo Canfora Dept of Engineering, University of Sannio, Benevento (BN), Italy E-mail: [email protected] Massimiliano Di Penta Dept of Engineering, University of Sannio, Benevento (BN), Italy E-mail: [email protected] Rocco Oliveto Dept.
    [Show full text]
  • Fusepool P3 Summary Y1
    Coordination Fusepool P3 (609696) www.fusepool.eu getfp3.com Thomas Gehrig Bern University of Applied Sciences BUAS Berner Fachhochschule BFH CH-3005 Bern www.wirtschaft.bfh.ch [email protected] +41 79 760 06 06 FUSEPOOL P3 SUMMARY Y1 1 Project context and objectives The goal of Fusepool P3 project is to make publishing and processing of open data as linked data easy. For this purpose Fusepool P3 develops a set of software components that integrate seamlessly by well- defined APIs basing on Linked Data Best Practices and the Linked Data Platform standard. To ensure longevity of the code and the APIs developed within Fusepool the software is designed so that the individual components can be used not only as parts of the overall software, but also individually. The architecture is not tied to a particular runtime environment but bases exclusively on web standards. This allows components to be implemented using any language and framework. As a consequence of this the focus of the platform is not to build a central application into which the components are added as plugins but mainly specifying generic APIs to allow the interaction of loosely coupled modules. The platform is what emerges from components communicating with generic RESTful RDF APIs. This focus on standards and loose coupling will provide the extensibility to cover both the current as well as future end-users needs. This is because new developers as well as new platforms and tools can be integrated very quickly. The Fusepool P3 project partners Provincia Autonoma di Trento (PAT) and Regione Toscana (RET) have been publishing open data and are supporting the development of applications and services in the tourism domain for several months.
    [Show full text]
  • Fusepool Linked Datapool for Technology Intelligence
    Fusepool Linked Datapool for Technology Intelligence Michael Kaschesky1*, Reto Bachmann-Gmür1, Guillaume Bouchard5, Stephane Gamard3, Anton Heijs4, Michael Luggen1, Tamás Prajczer2, and Luigi Selmi1 1 Bern University of Applied Sciences, E-Government Institute, Bern, Switzerland {firstname.lastname}@bfh.ch 2 Geox KFT, Budapest, Hungary [email protected] 3Searchbox SA, Lausanne, Switzerland [email protected] 4Treparel Information Solutions B.V., Delft, Netherlands [email protected] 5Xerox Research Europe, Machine-Learning Group, Meylan, France [email protected] Abstract. Fusepool applications for technology intelligence merge open data from millions of patents, publications, and research tenders making it available as keyword-searchable linked data. The open-source Fusepool data and soft- ware infrastructure separates the data, its processors, and the user interfaces from each other enabling users to transform and enrich their own data as linked data for searching and interlinking internal and external sources. Fusepool inte- grates many Apache projects and makes it easy for developers to build new apps using the ready-made OSGi Fusepool archetypes. The JavaScript client provides a semantic REST endpoint to be used alongside the SPARQL end- point. Fusepool data undergoes a series of data extraction and refinement steps that remove ambiguity and make data reusable. As a result, the exploitation by app developers and the management of data becomes more efficient. Keywords: technology intelligence, semantic search, linked data, fusepool 1 Introduction Fusepool provides an open-source integrated data and software infrastructure that separates the data, its processors, and the user interfaces from each other. The Fuse- pool end user applications (e.g. PartnerMatch, PatentExplorer, FundingFinder, UserFeedback, PublicationExplorer, and ExpertMatch) integrate large amounts of diverse and heterogeneous information sources from different owners (e.g.
    [Show full text]
  • If You Have the Content, Then Apache Has the Technology!
    If you have the Content, then Apache has the Technology! A whistle-stop tour of the Apache content related projects Nick Burch CTO Quanticate Apache Projects • 154 Top Level Projects • 33 Incubating Projects • 46 “Content Related” Projects • 8 “Content Related” Incubating Projects (that excludes another ~30 fringe ones!) Picking the “most interesting” ones 36 Projects in 45 minutes With time for questions... This is not a comprehensive guide! Active Committer - ~3 of these projects Committer - ~6 of these projects User - ~12 of these projects Interested - ~24 of these projects My experience levels / knowledge will vary from project to project! Different Technologies • Transforming and Reading • Text and Language Analysis • RDF and Structured • Data Management and Processing • Serving Content • Hosted Content But not: Storing Content What can we get in 45 mins? • A quick overview of each project • Roughly how they fit together / cluster into related areas • When talks on the project are happening at ApacheCon • The project's URL, so you can look them up and find out more! • What interests me in the project Transforming and Reading Content Apache PDFBox http://pdfbox.apache.org/ • Read, Write, Create and Edit PDFs • Create PDFs from text • Fill in PDF forms • Extract text and formatting (Lucene, Tika etc) • Edit existing files, add images, add text etc • Continues to improve with each release! Apache POI http://poi.apache.org/ • File format reader and writer for Microsoft office file formats • Support binary & ooxml formats • Strong read
    [Show full text]