DOCSLIB.ORG

Domain Independent Natural Language Processing—A Case Study for Hospital Readmission with COPD

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Domain Independent Natural Language Processing—A Case Study for Hospital Readmission with COPD 2014 IEEE 14th International Conference on Bioinformatics and Bioengineering Domain Independent Natural Language Processing – A Case Study for Hospital Readmission with COPD Ankur Agarwal, Ph.D. Sirish Malpura Florida Atlantic University Florida Atlantic University Boca Raton, Florida Boca Raton, Florida [email protected] [email protected] Ravi S Behara, Ph.D. Vivek Tyagi Florida Atlantic University Florida Atlantic University Boca Raton, Florida Boca Raton, Florida [email protected] [email protected] Abstract—Natural language processing is a field of computer science, which focuses on interactions between computers and phenomena based on actual examples of these phenomena human (natural) languages. The human languages are provided by the text input without adding significant linguistic ambiguous unlike Computer languages, which make its analysis or world knowledge. Machine learning based NLP solutions and processing difficult. Most of the data present these days is in use this approach. unstructured form (such as: Accident reports, Patient discharge summary, Criminal records etc), which makes it hard for Connectionist Approach: Connectionist approach computers to understand for further use and analysis. This develops generalized models from examples of linguistic unstructured text needs to be converted into structured form by phenomena. However, connectionist models combine clearly defining the sentence boundaries, word boundaries and statistical learning with various theories of representation – context dependent character boundaries for further analysis. This paper proposes a component-based domain-independent thus the connectionist representations allow transformation, text analysis system for processing of the natural language known inference, and manipulation of logic formulae. [1] as Domain-independent Natural Language Processing System (DINLP). Further the paper discusses the system capability and Connectionist NLP approach is newer compared to its application in the area of bioinformatics through the case symbolic and statistical approaches. Connectionist NLP work study first appeared in the 1960’s. For a long time, symbolic approaches dominated the field however, in the 1980’s, statistical approaches regained popularity as a result of the Keywords— Chronic Obstructive Pulmonary Disease; Natural availability of critical computational resources and the need to Language Processing; Term Extraction deal with broad, real-world contexts. Connectionist approaches also recovered from earlier criticism by demonstrating the utility of neural networks in NLP. [2] I. INTRODUCTION Natural language processing approaches fall roughly into Natural language processing can be used in various four categories: symbolic, statistical, connectionist, and application such as translation between languages, dialogues hybrid. systems (such as Customer Care) and the most important Symbolic Approach: Symbolic approaches are based on being information extraction (IE). The main goal information explicit representation of facts about language through well- extraction is to transform unstructured text into structured understood knowledge representation schemes and associated (database) representations that can be searched and browsed in algorithms. They perform deep analysis of linguistic flexible ways. phenomena. Natural language processing includes following tasks. Statistical Approach: Statistical approaches employ Some of these tasks can server as real-world application and various mathematical techniques and often use large text input others might be sub-tasks for other tasks. to develop approximate generalized models of linguistic 978-1-4799-7502-0/14 $31.00 © 2014 IEEE 399 DOI 10.1109/BIBE.2014.57 Information Extraction – IE is the process of converting NLP is also being applied in fields such as Automated unstructured text into structures or semi-structured form. The Customer Care service. The other applications of NLP include unstructured text can be translated to standard databases, generating SQL queries from plain text based on synonymous which can be queried by users. [3] words, [17] the flight schedule query system, [18] improving Information Retrieval – IR is the process of determining communications in e-democracy, [19] intrusion detection, [20] information resources, which are relevant to a query from a text encryption, [21] ontology based natural language collection of resources such as text files, images, videos etc. processing for in-store shopping, [22] and software The most proper form of information-seeking behavior is requirements specification analysis [23] etc. considered as Information Retrieval. [4] Relationship Extraction – It is the process of detecting semantic relationships between a set of articles. The co- In DINLP, Apache UIMA, cTAKES is being used and modified for the needs of domain-independent natural occurrence of term or their synonyms can be treated as an language processing and term extraction system. The indicator of relationship between to artifacts. [5] background for this paper can be divided into three categories Co-reference Resolution – Co-reference resolution plays a broadly: Apache UIMA, Apache cTAKES and Text analysis. very important role in information extractions. It is the process Below is the diagram showing the relationship between Text of marking up two expressions with the same entity. [6] e.g. Analysis, cTAKES and UIMA. Timi is very nice boy, he is very hard working. In this sentence, Timi and hei refers to same person. There are different types of distinctions that can be made out of co- cTAKES (Clinical Text Analysis and Knowledge references: Anaphora, Cataphora, Split antecedents, and Co- Extraction Syetem) is a text analysis system developed by referring noun phrases. Mayo Clinic now being maintained by Apache. It uses Named Entity Recognition - Named Entity Recognition is Apache’s UIMA (Unstructured Information management a process of marking up different parts/atoms of a sentence to Architecture) for converting the unstructured text to structured their respective entities e.g Person Name, Quantity, and Size form. The DINLP uses cTAKES for all the text analysis and etc. It has been regarded as an efficient strategy to capture knowledge extraction. relevant entities for answering different queries. [7] Part-of-speech tagging – Part-of-speech tagging is the process of tagging each word with its respective part-of- speeches. The part-of-speech tagging is often ambiguous due to different forms of words. The problem of part-of-speech disambiguation can only be solved after solving other problems associated with natural language understanding. [8] Syntactic Parsing – It is the process of analyzing a sentence by determining the structure of its constituent parts. A parse tree is formed in the process of syntactical parsing. The syntactic parsing plays a very important role in semantic role labeling. [9] Sentiment Analysis - It is also called as Opinion mining. Sentiment analysis is the process of extracting the subjective information from a piece of text. It is the analysis where the information extracted can be the tone of the author, the inferences that can be made out of that text. [10] Other tasks may include: Word sense disambiguation, word segmentation, topic segmentation, sentence breaking, morphological segmentation, Discourse analysis, stemming etc. Fig. 1. Relationship between components of DINLP II. LITERATURE REVIEW Text Analysis: The text-based materials are very important The Natural language processing has variety of source of valuable information and knowledge. There are applications in real world applications. The Natural language varying pieces of text which can be treated as Information processing is being used extensively in bio-medical field. The source such as: Discharge Summaries for Health Care, National Library of Medicine’s MetaMap program is being Accident reports for Road Safety etc. [24] All the sources used extensively for text-mining and creates a standard for provide experiment results/summaries as free text which is indexing of bio-medical terms. [11] There are many other easily readable by human, but complex for computers to researches which are related to work in bio-medical text understand. [25] The important components of a general text mining, such as - cause of death [12], health score [13], analysis system are: Information retrieval [26], Natural smoking status [14][15][16]. 400 language processing [27], Named Entity recognition [28], Co- techniques aiming at information extraction from the clinical reference [29], Relationship Extraction [30], and Sentiment narrative. The system is being used to process and extract analysis. The text-analysis is being used in Bio-medical text information from free-text clinical notes for PAD(Peripheral mining, social media monitoring, National Security and Artery disease). It consists of loosely coupled components and Enterprise business intelligence etc. each component has unique capabilities and responsibilities. III. METHODOLOGY The system liberally borrows some of the components from the Apache UIMA framework and Apache cTAKES. This section will give a detailed overview of what has been taken from cTAKES and UIMA with information about all components which are modified to suit domain-independent needs. The Apache UIMA framework is the core of this system. It is built on top of all the components such as their Annotators, type system and Analysis Engines. Below is the overall process flow of this system which is made
Load more

Recommended publications
  • BENTO: a Visual Platform for Building Clinical NLP Pipelines Based on Codalab
    BENTO: A Visual Platform for Building Clinical NLP Pipelines Based on CodaLab Yonghao Jin, Fei Li and Hong Yu Department of Computer Science, University of Massachusetts Lowell, MA, USA Abstract CodaLab1 is an open-source web-based plat- form for collaborative computational research. Although CodaLab has gained popularity in the research community, its interface has lim- ited support for creating reusable tools that can be easily applied to new datasets and composed into pipelines. In clinical domain, natural language processing (NLP) on med- ical notes generally involves multiple steps, like tokenization, named entity recognition, etc. Since these steps require different tools Figure 1: The architecture of BENTO. The BENTO which are usually scattered in different publi- back end stores the description files of various tools cations, it is not easy for researchers to use (e.g., pre-trained NLP models), processes static con- them to process their own datasets. In this pa- tents of the application and handles compilation of the per, we present BENTO, a workflow manage- user-defined pipelines. The CodaLab back end stores ment platform with a graphic user interface the datasets (bundles) and executes computational jobs. (GUI) that is built on top of CodaLab, to fa- The two back end servers are brought behind a single cilitate the process of building clinical NLP domain name using a reverse proxy server. pipelines. BENTO comes with a number of clinical NLP tools that have been pre-trained using medical notes and expert annotations this problem, researchers have developed CodaLab and can be readily used for various clinical as an open-source platform for researchers and soft- NLP tasks.
    [Show full text]
  • Download Thesis
    This electronic thesis or dissertation has been downloaded from the King’s Research Portal at https://kclpure.kcl.ac.uk/portal/ Big data approaches to investigating Child Mental Health disorder outcomes Downs, Jonathan Muir Awarding institution: King's College London The copyright of this thesis rests with the author and no quotation from it or information derived from it may be published without proper acknowledgement. END USER LICENCE AGREEMENT Unless another licence is stated on the immediately following page this work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International licence. https://creativecommons.org/licenses/by-nc-nd/4.0/ You are free to copy, distribute and transmit the work Under the following conditions: Attribution: You must attribute the work in the manner specified by the author (but not in any way that suggests that they endorse you or your use of the work). Non Commercial: You may not use this work for commercial purposes. No Derivative Works - You may not alter, transform, or build upon this work. Any of these conditions can be waived if you receive permission from the author. Your fair dealings and other rights are in no way affected by the above. Take down policy If you believe that this document breaches copyright please contact [email protected] providing details, and we will remove access to the work immediately and investigate your claim. Download date: 07. Oct. 2021 BIG DATA APPROACHES TO INVESTIGATING CHILD MENTAL HEALTH DISORDER OUTCOMES JOHNNY DOWNS Thesis submitted for the degree of Doctor of Philosophy September 2017 Department of Psychological Medicine Institute of Psychiatry, Psychology & Neuroscience King’s College London ABSTRACT Background: In the UK, administrative data resources continue to expand across publically funded youth-orientated health, education and social services.
    [Show full text]
  • Deliverable 2.4 Development of Supervised Categorization Models
    Project Acronym:ICTUSnet Project code: SOE2/P1/E0623 E2.4 DEVELOPMENT OF SUPERVISED CATEGORIZATION MODELS, TOPIC MODELLING AND EXTRACTION OF CLINICAL INFORMATION COMPUTING. Due date: 30/04/2020 WP2. WPActual Development submission date: and30/ 04integration/2021 of 'Machine Responsible partner: BSC Version: Learning' algorithms04 Status: Final Dissemination level: Public / Consortium Project funded by the Interreg Sudoe Programme through the European Regional Development Fund (ERDF) Project Acronym: ICTUSnet Project code: SOE2/P1/E0623 Deliverable description: This deliverable describes the methodology used in WP2 to develop the SUPERVISED CATEGORIZATION MODELS, TOPIC MODELLING AND EXTRACTION OF CLINICAL INFORMATION using deep learning techniques. The results obtained by the deep learning models are remarkable, reaching 91% F1 on average. Revision history Version Date Comments Partner 01 12/2020 First version BSC 02 02/2021 Second version BSC 03 04/2021 Final version BSC Authors Name Partner Marta Villegas Montserrat BSC Aitor González Agirre BSC Joan Llop BSC Siamak Barzegar BSC Contributors Name Partner ICTUSnet: E2.4Development of supervised categorization models, topic modelling and extraction of clinical information via cognitive computing. 30/04/2021 02 Page 2 of 65 Project Acronym: ICTUSnet Project code: SOE2/P1/E0623 ABBREVIATIONS AND ACRONYMS HUSE Hospital Universitario Son Espases XML Extensible Markup Language HER Electronic Health Record TTR Type Token Ratio BRAT Brat Rapid Annotation Tool F1 F1 score IAA Inter-Annotator Agreement NER Named Entity Recognition NERC Named Entity Recognition and Classification ICTUSnet: E2.4Development of supervised categorization models, topic modelling and extraction of clinical information via cognitive computing. 30/04/2021 02 Page 3 of 65 Project Acronym: ICTUSnet Project code: SOE2/P1/E0623 TABLE OF CONTENTS INRODUCTION .............................................................................................................
    [Show full text]
  • Code Smell Prediction Employing Machine Learning Meets Emerging Java Language Constructs"
    Appendix to the paper "Code smell prediction employing machine learning meets emerging Java language constructs" Hanna Grodzicka, Michał Kawa, Zofia Łakomiak, Arkadiusz Ziobrowski, Lech Madeyski (B) The Appendix includes two tables containing the dataset used in the paper "Code smell prediction employing machine learning meets emerging Java lan- guage constructs". The first table contains information about 792 projects selected for R package reproducer [Madeyski and Kitchenham(2019)]. Projects were the base dataset for cre- ating the dataset used in the study (Table I). The second table contains information about 281 projects filtered by Java version from build tool Maven (Table II) which were directly used in the paper. TABLE I: Base projects used to create the new dataset # Orgasation Project name GitHub link Commit hash Build tool Java version 1 adobe aem-core-wcm- www.github.com/adobe/ 1d1f1d70844c9e07cd694f028e87f85d926aba94 other or lack of unknown components aem-core-wcm-components 2 adobe S3Mock www.github.com/adobe/ 5aa299c2b6d0f0fd00f8d03fda560502270afb82 MAVEN 8 S3Mock 3 alexa alexa-skills- www.github.com/alexa/ bf1e9ccc50d1f3f8408f887f70197ee288fd4bd9 MAVEN 8 kit-sdk-for- alexa-skills-kit-sdk- java for-java 4 alibaba ARouter www.github.com/alibaba/ 93b328569bbdbf75e4aa87f0ecf48c69600591b2 GRADLE unknown ARouter 5 alibaba atlas www.github.com/alibaba/ e8c7b3f1ff14b2a1df64321c6992b796cae7d732 GRADLE unknown atlas 6 alibaba canal www.github.com/alibaba/ 08167c95c767fd3c9879584c0230820a8476a7a7 MAVEN 7 canal 7 alibaba cobar www.github.com/alibaba/
    [Show full text]
  • Proceedings of the Workshop on NLP for Medicine and Biology Associated with RANLP 2013, Pages 1–8, Hissar, Bulgaria, 13 September 2013
    NLP for Medicine and Biology 2013 Proceedings of the Workshop on NLP for Medicine and Biology associated with The 9th International Conference on Recent Advances in Natural Language Processing (RANLP 2013) 13 September, 2013 Hissar, Bulgaria WORKSHOP ON NLP FOR MEDICINE AND BIOLOGY ASSOCIATED WITH THE INTERNATIONAL CONFERENCE RECENT ADVANCES IN NATURAL LANGUAGE PROCESSING’2013 PROCEEDINGS Hissar, Bulgaria 13 September 2013 ISBN 978-954-452-024-3 Designed and Printed by INCOMA Ltd. Shoumen, BULGARIA ii Preface Biomedical NLP deals with the processing of healthcare-related text—clinical documents created by physicians and other healthcare providers at the point of care, scientific publications in the areas of biology and medicine, and consumer healthcare text such as social media blogs. Recent years have seen dramatic changes in the types and amount of data available to researchers in this field. Where most research on publications in the past has dealt with the abstracts of journal articles, we now have access to the full texts of journal articles via PubMedCentral. Where research on clinical documents has been hampered by a lack of availability of data, we now have access to large bodies of data through the auspices of the Cincinnati Children’s Hospital NLP Challenge, the i2b2 shared tasks (www.i2b2.org), the TREC Electronic Medical Records track, the US-funded Strategic Health Advanced Research Projects Area 4 (www.sharpn.org) and the Shared Annotated Resources (ShARe; https://sites.google.com/site/shareclefehealth/taskdescription; www.clinicalnlpannotations.org) project. Meanwhile, the number of abstracts in PubMed continues to grow exponentially. Text in the form of blogs created by patients discussing various healthcare topics has emerged as another data source, with a new perspective on healthrelated issues.
    [Show full text]
  • Clinical Annotation Research Kit (CLARK): Computable Phenotyping Using Machine Learning
    JMIR MEDICAL INFORMATICS Pfaff et al Viewpoint Clinical Annotation Research Kit (CLARK): Computable Phenotyping Using Machine Learning Emily R Pfaff1, MS; Miles Crosskey2, PhD; Kenneth Morton2, PhD; Ashok Krishnamurthy3, PhD 1North Carolina Translational and Clinical Sciences Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States 2CoVar Applied Technologies, Durham, NC, United States 3Renaissance Computing Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States Corresponding Author: Emily R Pfaff, MS North Carolina Translational and Clinical Sciences Institute University of North Carolina at Chapel Hill 160 N Medical Drive Chapel Hill, NC, United States Phone: 1 919 843 4712 Email: [email protected] Abstract Computable phenotypes are algorithms that translate clinical features into code that can be run against electronic health record (EHR) data to define patient cohorts. However, computable phenotypes that only make use of structured EHR data do not capture the full richness of a patient's medical record. While natural language processing (NLP) methods have shown success in extracting clinical features from text, the use of such tools has generally been limited to research groups with substantial NLP expertise. Our goal was to develop an open-source phenotyping software, Clinical Annotation Research Kit (CLARK), that would enable clinical and translational researchers to use machine learning±based NLP for computable phenotyping without requiring deep informatics expertise. CLARK enables nonexpert users to mine text using machine learning classifiers by specifying features for the software to match in clinical notes. Once the features are defined, the user-friendly CLARK interface allows the user to choose from a variety of standard machine learning algorithms (linear support vector machine, Gaussian Naïve Bayes, decision tree, and random forest), cross-validation methods, and the number of folds (cross-validation splits) to be used in evaluation of the classifier.
    [Show full text]
  • Clinical Concept Extraction for Document-Level Coding
    Clinical Concept Extraction for Document-Level Coding Sarah Wiegreffe1, Edward Choi1∗, Sherry Yan2, Jimeng Sun1, Jacob Eisenstein1 1Georgia Institute of Technology 2Sutter Health ∗ Current Affiliation: Google Inc [email protected], [email protected], [email protected], [email protected], [email protected] Abstract Clinical concept extraction tools abstract over The text of clinical notes can be a valuable the noise inherent in surface representations of source of patient information and clinical as- clinical text by linking raw text to standardized sessments. Historically, the primary approach concepts in clinical ontologies. The Apache clin- for exploiting clinical notes has been informa- ical Text Analysis Knowledge Extraction System tion extraction: linking spans of text to con- (cTAKES, Savova et al., 2010) is the most widely- cepts in a detailed domain ontology. How- used such tool, with over 1000 citations. Based on ever, recent work has demonstrated the poten- rules and non-neural machine learning methods and tial of supervised machine learning to extract engineered for almost a decade, cTAKES provides document-level codes directly from the raw text of clinical notes. We propose to bridge an easily-obtainable source of human-encoded do- the gap between the two approaches with two main knowledge, although it cannot leverage deep novel syntheses: (1) treating extracted con- learning to make document-level predictions. cepts as features, which are used to supple- Our goal in this paper is to maximize the predic- ment or replace the text of the note; (2) treating tive power of clinical notes by bridging the gap labels extracted concepts as , which are used to between information extraction and deep learn- learn a better representation of the text.
    [Show full text]
  • A Spanish EHR Semantic Search Engine
    TIDA: A Spanish EHR semantic search engine Roberto Costumero1, Consuelo Gonzalo1, and Ernestina Menasalvas1 Universidad Politecnica´ de Madrid - Centro de Tecnolog´ıa Biomedica, Madrid, Spain roberto.costumero, consuelo.Gonzalo, [email protected] Abstract. Electronic Health Records (EHR) and the constant adoption of In- formation Technologies in healthcare have dramatically increased the amount of unstructured data stored. The extraction of key information from this data will bring better caregivers decisions and an improvement in patients’ treatments. With more than 495 million people talking Spanish, the need to adapt algorithms and technologies used in EHR knowledge extraction in English speaking coun- tries, leads to the development of different frameworks. Thus, we present TIDA, a Spanish EHR semantic search engine, to give support to Spanish speaking medi- cal centers and hospitals to convert pure raw data into information understandable for cognitive systems. This paper presents the results of TIDA’s Spanish EHR free-text treatment component with the adaptation of negation and context detec- tion algorithms applied in a semantic search engine with a database with more than 30,000 clinical notes. Keywords: Natural Language Processing, Electronic Health Records, Negation Detection 1 Introduction The adoption and effective use of information technologies in healthcare (in particu- larly the Electronic Health Record - EHR) has been hindered for decades. The leading English speaking countries have brought new technologies to build health decision- making systems in the last years such as Natural Language Processing (NLP), Negation and context detection algorithms, frameworks like Mayo’s cTAKES [1], terminology systems as the Unified Medical Language System (UMLS) [2] or actual systems such as IBM WatsonTM[3].
    [Show full text]
  • Testsmelldescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries
    Bachelor Thesis January 31, 2018 TestSmellDescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries Ivan Taraca of Pfullendorf, Germany (13-751-896) supervised by Prof. Dr. Harald C. Gall Dr. Sebastiano Panichella software evolution & architecture lab Bachelor Thesis TestSmellDescriber Enabling Developers’ Awareness on Test Quality with Test Smell Summaries Ivan Taraca software evolution & architecture lab Bachelor Thesis Author: Ivan Taraca, [email protected] URL: http://bit.ly/2DUiZrC Project period: 20.10.2018 - 31.01.2018 Software Evolution & Architecture Lab Department of Informatics, University of Zurich Acknowledgements First of all, I like to thank Dr. Harald Gall for giving me the opportunity to write this thesis at the Software Evolution & Architecture Lab. Special thanks goes out to Dr. Sebastiano Panichella for his instructions, guidance and help during the making of this thesis, without whom this would not have been possible. I would also like to express my gratitude to Dr. Fabio Polomba, Dr. Yann-Gaël Guéhéneuc and Dr. Nikolaos Tsantalis for providing me access to their research and always being available for questions. Last, but not least, do I want to thank my parents, sisters and nephews for the support and love they’ve given all those years. Abstract With the importance of software in today’s society, malfunctioning software can not only lead to disrupting our day-to-day lives, but also large monetary damages. A lot of time and effort goes into the development of test suites to ensure the quality and accuracy of software. But how do we elevate the quality of test code? This thesis presents TestSmellDescriber, a tool with the ability to generate descriptions detailing potential problems in test cases, which are collected by conducting a Test Smell analysis.
    [Show full text]
  • Natural Language Processing: Integration of Automatic and Manual Analysis
    Natural Language Processing: Integration of Automatic and Manual Analysis Natürliche Sprachverarbeitung: Integration automatischer und manueller Analyse Zur Erlangung des akademischen Grades Doktor-Ingenieur (Dr.-Ing.) genehmigte Dissertation von Dipl.-Inform. Richard Eckart de Castilho aus Bensheim 2014 - Fachbereich Informatik — Darmstadt — D 17 Natural Language Processing: Integration of Automatic and Manual Analysis Natürliche Sprachverarbeitung: Integration automatischer und manueller Analyse Genehmigte Dissertation von Dipl.-Inform. Richard Eckart de Castilho aus Bensheim 1. Gutachten: Prof. Dr. Iryna Gurevych, Technische Universität Darmstadt 2. Gutachten: Prof. Dr. Andreas Henrich, Otto-Friedrich-Universität Bamberg 3. Gutachten: Prof. Christopher D. Manning, PhD., Stanford University Tag der Einreichung: 16. Dezember 2013 Tag der Prüfung: 10. Februar 2014 Darmstadt — D 17 Produkte oder Dienstleistungen auf welche in diesem Dokument verwiesen wird können Handels- marken oder eingetragene Handelsmarken der jeweiligen Rechteinhaber seine. Weder der Autor noch der Verlag erheben Ansprüche darauf. Products and services that are referred to in this work may be either trademarks and/or regis- tered trademarks of their respective owners. The author and the publishers make no claim to these trademarks. Bitte zitieren Sie dieses Dokument als: URN: urn:nbn:de:tuda-tuprints-41517 URL: http://tuprints.ulb.tu-darmstadt.de/id/eprint/4151 Dieses Dokument wird bereitgestellt von tuprints, E-Publishing-Service der TU Darmstadt http://tuprints.ulb.tu-darmstadt.de [email protected] Die Veröffentlichung steht unter folgender Creative Commons Lizenz: Namensnennung – Keine kommerzielle Nutzung – Keine Bearbeitung 3.0 Deutschland http://creativecommons.org/licenses/by-nc-nd/3.0/de/ To my family. Erklärung zur Dissertation Hiermit versichere ich, die vorliegende Dissertation ohne Hilfe Dritter nur mit den angegebenen Quellen und Hilfsmitteln angefertigt zu haben.
    [Show full text]
  • Apache Solr: a Practical Approach to Enterprise Search Teaches You How to Build an Enterprise Search Engine Using Apache Solr
    Shahi BOOKS FOR PROFESSIONALS BY PROFESSIONALS® THE EXPERTS VOICE® IN ENTERPRISE SEARCH Apache Solr Apache Solr Apache Solr: A Practical Approach to Enterprise Search teaches you how to build an enterprise search engine using Apache Solr. You’ll soon learn how to index and search your documents; ingest data from varied sources; pre-process, transform and enrich your data; and build the processing pipeline. You will understand the concepts and internals of Apache Solr and tune the results for your Apache Solr client’s search needs. The book explains each essential concept—backed by practical and industry examples—to help you attain expert-level knowledge. The book, which assumes a basic knowledge of Java, starts with an introduction to Solr, followed by steps to setting it up, indexing your first set of documents, and searching them. It A Practical Approach to Enterprise Search then covers the end-to-end process of data ingestion from varied sources, pre-processing the data, transformation and enrichment of data, building the processing pipeline, query parsing, — and scoring the document. It also teaches you how to make your system intelligent and able to learn through feedback loops. Dikshant Shahi After covering out-of-the-box features, Solr expert Dikshant Shahi dives into ways you can customize Solr for your business and its specific requirements, along with ways to plug in your own components. Most important, you will learn to handle user queries and retrieve meaningful results. The book explains how each user query is different and how to address them differently to get the best result.
    [Show full text]
  • Interoperability Landscaping Report December 28, 2015
    Ref. Ares(2016)2259176 - 13/05/2016 Interoperability Landscaping Report December 28, 2015 Deliverable Code: D5.1 Version: 3 – Intermediary Dissemination level: PUBLIC H2020-EINFRA-2014-2015 / H2020-EINFRA-2014-2 Topic: EINFRA-1-2014 Managing, preserving and computing with big research data Research & Innovation action Grant Agreement 654021 Interoperability Landscaping Report Document Description D5.1 – Interoperability Landscaping Report WP5 – Interoperability Framework WP participating organizations: ARC, UNIMAN, UKP-TUDA, INRA, EMBL-EBI, AK, LIBER, UvA, OU, EPFL, CNIO, USFD, GESIS, GRNET, Frontiers, UoS Contractual Delivery Date: 12/2015 Actual Delivery Date: 12/2015 Nature: Report Version: 1.0 (Draft) Public Deliverable Preparation slip Name Organization Date Authors Listed in the document Edited by Piotr Przybyła UNIMAN 20/12/2015 Matthew Shardlow UNIMAN Reviewed by John McNaught UNIMAN 20/12/2015 Natalia Manola ARC 22/12/2015 Approved by Natalia Manola ARC 16/1/2016 For delivery Mike Hatzopoulos ARC Document change record Issue Item Reason for Change Author Organization V0.1 Draft version Initial document structure Piotr Przybyła, UNIMAN Matthew Shardlow V0.2 Draft version Included initial content Piotr Przybyła, UNIMAN Matthew Shardlow V1.0 First delivery Applied corrections and Piotr Przybyła, UNIMAN added discussion Matthew Shardlow Public Page 1 of 112 Interoperability Landscaping Report Table of Contents 1. INTRODUCTION 8 2. REPOSITORIES 11 2.1 DESCRIPTION OF RESOURCES 11 2.1.1 METADATA SCHEMAS & PROFILES 12 2.1.2 VOCABULARIES AND ONTOLOGIES FOR DESCRIBING SPECIFIC INFORMATION TYPES 19 2.1.3 MECHANISMS USED FOR THE IDENTIFICATION OF RESOURCES 20 2.1.4 SUMMARY 20 2.2 REGISTRIES/REPOSITORIES OF RESOURCES 21 3.
    [Show full text]