DOCSLIB.ORG

Darko Anicic Event Processing and Stream Reasoning with ETALIS

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Darko Anicic Event Processing and Stream Reasoning with ETALIS Darko Anicic Event Processing and Stream Reasoning with ETALIS Zur Erlangung des akademischen Grades eines Doktors der Wirtschaftswissenschaften (Dr. rer. pol.) von der Fakultät für Wirtschaftswissenschaften des Karlsruher Instituts für Technologie (KIT) genehmigte Dissertation. Event Processing and Stream Reasoning with ETALIS Dipl.-Ing. Darko Aniciˇ c´ Referent: Prof. Dr. Rudi Studer Korreferent: Prof. Dr. Opher Etzion Prüfer: Prof. Dr. Detlef Seese Vorsitzender der Prüfungskommission: Prof. Dr. Andreas Geyer-Schulz Tag der mündlichen Prüfung: 09. November 2011. Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB) Fakultät Wirtschaftswissenschaften Karlsruher Institut für Technologie (KIT) Karlsruhe 2011 i To Vedrana and Andre Abstract Event Processing (EP) is concerned with detection of situations under time constraints that are of a particular business interest. We face today a paradigm shift toward the real time information processing, and EP has therefore spawned significant attention in science and technology. Due to omnipresence of events, EP is becoming a central as- pect of new distributed systems such as cloud computing and grid systems, mobile and sensor-based systems, as well as a number of application areas including financial ser- vices, business intelligence, social and collaborative networking, click stream analysis and many others. However, there are a number of issues to be considered in order to enable effective event-based computation. A language for describing event patterns needs to feature a well-defined semantics. It also needs to be rich enough to express important classes of event patterns. Pattern matching should be supported in both, query-driven and event- driven modes. A number of other event operations, such as event aggregation, filtering, translation, enrichment and splitting, should be supported too. Since EP is a real time processing task, an EP language needs to feature an efficient execution model. Finally, processing only events is not sufficient in many applications. To detect complex situa- tions of interest, EP needs to be enhanced by background knowledge. This knowledge captures the domain of interest. Its purpose is to be evaluated during detection of events in order to on the fly enrich events with relevant background information; to detect more complex situations; to reason about events and propose certain intelligent recommen- dations; or to accomplish event classification, clustering, filtering and so forth. The ETALIS Language for Events (ELE) is a declarative rule-based language for EP. It supports the above mentioned features, and goes beyond the state of the art by providing stream reasoning capabilities. In this thesis, we first review related literature and extract requirements for modern EP systems. Then we present ELE as a novel expressive formalism that fulfils these requirements. Further on, we show how deductive stream reasoning capabilities of ELE, together with its EP capabilities, have the potential to provide powerful real time intelligence. We give a few extensions of the core ELE. A number of examples and use case scenarios are developed to show the power of the proposed EP framework. We provide a prototype implementation of the language, and present evaluation results for implemented scenarios. Finally, we summarise the results of this thesis and outline our view of the emerging future work. Acknowledgements On my journey to complete this thesis many people have contributed. Foremost, I would like to sincerely thank to my supervisor, Prof. Dr. Rudi Studer, who gave me the opportunity to work in his research group and continuously supported my work. Prof. Dr. Rudi Studer has created a unique research environment that made my research both possible and enjoyable. I am grateful to Dr. Opher Etzion who was willing to serve as a second reviewer of this work. I wish to sincerely thank him also for inviting me to participate in many initiatives and collaborations within the event processing community – most notably the joint work on The Event Processing Manifesto, and participation in the implementation of Fast Flower Delivery use case in ETALIS. I am indebted to my supervisor, Dr. Nenad Stojanovic, for his unmeasurable enthusiasm and inspiration throughout my PhD studies. Ha gave me the necessary freedom to pursue my ideas, and has continuously encouraged me to always further my work. The work presented in this thesis would not be possible without my colleagues Dr. Sebastian Rudolph, Dr. Paul Fodor, Jia Ding, Ahmed Khalil Hafsi and Vesko Georgiev. Without Sebastian this thesis would not have the same level of technical profoundness. Since the time I started the work on ETALIS, Paul has been providing immeasurable help in implementation of ETALIS. Jia Ding, Ahmed Khalil Hafsi and Vesko Georgiev have also greatly contributed to successful development and testing of ETALIS. I would like to thank all the (former and present) colleagues in the Rudiverse for pro- viding such a friendly working atmosphere. I specially need to thank my colleagues from the iCEP group: Sinan Sen, Roland Stühmer, Jun Ma, Yongchun Xu and Dominik Riemer. Roland Stühmer has also generously helped with the early work on ETALIS. My parents and sister receive my sincerest gratitude and love for giving me continuous support and encouragement in my work. I thank my wife for giving me inspiration and energy throughout the time it has taken to complete this thesis. Darko Aniciˇ c´ Karlsruhe, June 2011 Contents List of Figures xiii List of Tables xv List of Algorithms xvii I Introduction 1 1 Thesis Overview 3 1.1 Introduction ................................ 3 1.2 Shifting Event Processing Toward More Intelligent Event Processing . 5 1.3 Shifting Reasoning Toward Stream Reasoning .............. 7 1.4 Aims and Objectives ........................... 11 1.5 Thesis Organization ............................ 14 1.6 Relation to Previous Publications ..................... 15 2 Introduction to Event Processing 17 2.1 What is an Event? ............................. 17 2.2 Event Programming Principles ...................... 18 2.2.1 Events as a Means to Declare Changes .............. 19 2.2.2 Information Push Versus Information Pull ............ 19 2.3 Event Processing Architecture ...................... 20 3 Introduction to Logic Programming 25 3.1 Background of Logic Programming ................... 25 3.2 The Logic in Logic Programs ....................... 26 3.2.1 Syntax of Definite Programs ................... 26 3.2.2 Semantics of Definite Programs ................. 30 3.3 The Control in Logic Programs ...................... 33 3.3.1 Immediate Consequence Operator ................ 34 3.3.2 SLD Resolution .......................... 35 4 State of the Art 39 4.1 Active Databases ............................. 39 viii Contents 4.2 Event Processing Systems ........................ 42 4.3 Approaches for Retraction in Event Processing ............. 46 4.4 Approaches for Out-of-Order Event Processing ............. 49 4.5 Logic-Based Approaches in Event Processing .............. 50 4.6 Semantic-Based Approaches ....................... 52 4.6.1 Temporal RDF .......................... 52 4.6.2 Stream Reasoning Approaches .................. 53 II ETALIS Language for Events 55 5 Logic-Based Event Processing: Design Principles and Requirements 57 5.1 Formal Declarative Semantics ...................... 57 5.2 Point-Based Versus Interval-Based Temporal Semantics ......... 59 5.3 Seamless Integration of Events with Queries and Domain Knowledge ............................ 60 5.3.1 Query Processing ......................... 60 5.3.2 Knowledge Processing ...................... 60 5.4 Event-Driven Incremental Reasoning ................... 61 5.5 Expressivity ................................ 61 5.6 Set at a Time Versus Event at a Time Processing ............. 62 5.7 Simplicity and Ease-of-Use ........................ 63 5.8 Extensibility ................................ 65 6 ETALIS: A Rule-Based Language for Event Processing and Reasoning 67 6.1 Introduction ................................ 67 6.2 Syntax of the Language .......................... 69 6.3 Declarative Semantics of the Language .................. 73 6.3.1 Complexity Properties ...................... 75 6.4 Examples ................................. 75 6.4.1 An Example Application ..................... 77 7 Operational Semantics of the Language 79 7.1 Overview ................................. 79 7.2 Execution Model for ETALIS ....................... 80 7.2.1 Sequence ............................. 80 7.2.2 Conjunction ............................ 84 7.2.3 Concurrency ........................... 87 7.2.4 Disjunction ............................ 87 7.2.5 Negation ............................. 88 7.2.6 Interval-Based Operations .................... 88 7.2.6.1 Duration ........................ 88 7.2.6.2 Start .......................... 89 7.2.6.3 Equal .......................... 89 7.2.6.4 Finish ......................... 89 Contents ix 7.2.6.5 Meet .......................... 90 7.3 Iterative and Aggregative Patterns .................... 90 7.3.1 From Event Rules to Event Iterative Rules ............ 90 7.3.1.1 An Example Application with Iterative Rules ..... 91 7.3.2 Implementation of Aggregative Patterns ............. 92 7.4 Consumption Policies ........................... 96 7.4.1 Consumption Policies Defined on Time Points ......... 97 7.4.2 Consumption Policies Defined on Time Intervals ........ 98 8 The Event Processing Network in ETALIS 101 8.1 Filtering
Load more

Recommended publications
  • Distributed Complex Event Processing in Multiclouds
    Distributed Complex Event Processing in Multiclouds Vassilis Stefanidis1, Yiannis Verginadis1, Ioannis Patiniotakis1 and Gregoris Mentzas1 1 Institute of Communications and Computer Systems, National Technical University of Ath- ens, Greece {stefanidis, jverg, ipatini, gmentzas}@mail.ntua.gr Abstract. The last few years, the generation of vast amounts of heterogeneous data with different velocity and veracity and the requirement to process them, has significantly challenged the computational capacity and efficiency of the modern infrastructural resources. The propagation of Big Data among different pro- cessing and storage architectures, has amplified the need for adequate and cost- efficient infrastructures to host them. An overabundance of cloud service offer- ings is currently available and is being rapidly adopted by small and medium enterprises based on its many benefits to traditional computing models. However, at the same time the Big Data computing requirements pose new research chal- lenges that question the adoption of single cloud provider resources. Nowadays, we discuss the emerging data-intensive applications that necessitate the wide adoption of multicloud deployment models, in order to use all the advantages of cloud computing. A key tool for managing such multicloud applications and guarantying their quality of service, even in extreme scenarios of workload fluc- tuations, are adequate distributed monitoring mechanisms. In this work, we dis- cuss a distributed complex event processing architecture that follows automati- cally the big data application deployment in order to efficiently monitor its health status and detect reconfiguration opportunities. This proposal is examined against an illustrative scenario and is preliminary evaluated for revealing its performance results. Keywords: Distributed CEP, Cloud Monitoring, Multiclouds, Big Data.
    [Show full text]
  • Requirements and State of the Art Overview on Flexible Event Processing
    ICT, STREP FERARI ICT-FP7-619491 Flexible Event pRocessing for big dAta aRchItectures Collaborative Project D4.1 Requirements and state of the art overview of flexible event processing 01.02.2013 – 31.01.2014(preparation period) Contractual Date of Delivery: 31.01.2015 Actual Date of Delivery: 31.01.2015 Author(s): Fabiana Fournier and Inna Skarbovsky Institution: IBM Workpackage: Flexible Event Processing Security: PU Nature: R Total number of pages: 48 Project funded by the European Community under the Information and Communication Technologies Programme Contract ICT-FP7-619491 Project coordinator name Michael Mock Revision: 1 Project coordinator organisation name Fraunhofer Institute for Intelligent Analysis and Information Systems (IAIS) Schloss Birlinghoven, 53754 Sankt Augustin, Germany URL: http://www.iais.fraunhofer.de Abstract The goal of the FERARI (Flexible Event pRocessing for big dAta aRchItectures) project is to pave the way for efficient real-time Big Data technologies of the future. The proposed framework aims at enabling business users to express complex analytics tasks through a high-level declarative language that supports distributed complex event processing as an integral part of the system architecture. Work package 4 “Flexible Event Processing” deals with all the developments around event processing technologies in order to achieve this goal. In order to be flexible, event processing engines need to tackle the two following requirements in a satisfactory way: • The easy adaptability to non-functional requirements, specially, the way the tool copes with scalability issues in a distributed environment. • The easy definition and maintenance of the event-driven logic. The task of work package 4 is to provide a model and methodology to cope with these limitations.
    [Show full text]
  • Complex Event Processing As a Service in Multi-Cloud Environments
    Western University Scholarship@Western Electronic Thesis and Dissertation Repository August 2016 Complex Event Processing as a Service in Multi-Cloud Environments Wilson A. Higashino The University of Western Ontario Supervisor Dr. Miriam A. M. Capretz The University of Western Ontario Graduate Program in Electrical and Computer Engineering A thesis submitted in partial fulfillment of the equirr ements for the degree in Doctor of Philosophy © Wilson A. Higashino 2016 Follow this and additional works at: https://ir.lib.uwo.ca/etd Part of the Databases and Information Systems Commons Recommended Citation Higashino, Wilson A., "Complex Event Processing as a Service in Multi-Cloud Environments" (2016). Electronic Thesis and Dissertation Repository. 4016. https://ir.lib.uwo.ca/etd/4016 This Dissertation/Thesis is brought to you for free and open access by Scholarship@Western. It has been accepted for inclusion in Electronic Thesis and Dissertation Repository by an authorized administrator of Scholarship@Western. For more information, please contact [email protected]. Abstract The rise of mobile technologies and the Internet of Things, combined with advances in Web technologies, have created a new Big Data world in which the volume and velocity of data gen- eration have achieved an unprecedented scale. As a technology created to process continuous streams of data, Complex Event Processing (CEP) has been often related to Big Data and used as a tool to obtain real-time insights. However, despite this recent surge of interest, the CEP market is still dominated by solutions that are costly and inflexible or too low-level and hard to operate. To address these problems, this research proposes the creation of a CEP system that can be o↵ered as a service and used over the Internet.
    [Show full text]
  • Join Query Optimization Techniques for Complex Event Processing Applications
    Join Query Optimization Techniques for Complex Event Processing Applications Ilya Kolchinsky Assaf Schuster Technion, Israel Institute of Technology Technion, Israel Institute of Technology Haifa 32000 Israel Haifa 32000 Israel [email protected] [email protected] ABSTRACT Keywords Complex event processing (CEP) is a prominent technology Stream Processing, Complex Event Processing, Lazy Eval- used in many modern applications for monitoring and track- uation, Query Optimization ing events of interest in massive data streams. CEP engines inspect real-time information ows and attempt to detect 1. INTRODUCTION combinations of occurrences matching predened patterns. Complex event processing has become increasingly im- This is done by combining basic data items, also called portant for applications in which arbitrarily complex pat- primitive events, according to a pattern detection plan, terns must be eciently detected over high-speed streams in a manner similar to the execution of multi-join queries of events. Online nance, security monitoring, and fraud in traditional data management systems. Despite this sim- detection are among the many examples. Pattern detection ilarity, little work has been done on utilizing existing join generally consists of collecting primitive events and combin- optimization methods to improve the performance of CEP- ing them into potential (partial) matches using some type based systems. of detection model. As more events are added to a partial In this paper, we provide the rst theoretical and experi- match, a full pattern match is eventually formed and re- mental study of the relationship between these two research ported. Popular CEP mechanisms include nondeterministic areas. We formally prove that the CEP Plan Generation nite automata (NFAs) [5, 18, 51], nite state machines [6, problem is equivalent to the Join Query Plan Generation 45], trees [36], and event processing networks [21, 42].
    [Show full text]
  • From Complex Event Processing to Simple Event Processing
    From Complex Event Processing to Simple Event Processing Sylvain Hallé1 Abstract Many problems in Computer Science can be framed as the computation of queries over sequences, or “streams” of data units called events. The field of Complex Event Processing (CEP) relates to the techniques and tools developed to efficiently process these queries. However, most CEP systems developed so far have concentrated on relatively narrow types of queries, which consist of sliding windows, aggregation functions, and simple sequential patterns computed over events that have a fixed tuple structure. Many of them boast throughput, but in counterpart, they are difficult to setup and cumbersome to extend with user-defined elements. This paper describes a variety of use cases taken from real-world scenarios that present features seldom considered in classical CEP problems. It also provides a broad review of current solutions, that includes tools and techniques going beyond typical surveys on CEP. From a critical analysis of these solutions, design principles for a new type of event stream processing system are exposed. The paper proposes a simple, generic and extensible framework for the processing of event streams of diverse types; it describes in detail a stream processing engine, called BeepBeep, that implements these principles. BeepBeep’s modular architecture, which borrows concepts from many other systems, is complemented with an extensible query language, called eSQL. The end result is an open, versatile, and reasonably efficient query engine that can be used in situations that go beyond the capabilities of existing systems. Keywords: event processing, software testing, query languages, runtime verification 1. Introduction taken from domains as varied as bug detection in video games and network intrusion detection.
    [Show full text]
  • BPMN Extension for Business Process Monitoring
    BPMN Extension forBusiness Process Monitoring∗ Anne Baumgrass, Nico Herzberg, Andreas Meyer,Mathias Weske Hasso Plattner Institute at the University of Potsdam Prof.-Dr.-Helmert-Str.2–3, D-14482 Potsdam, Germany {Anne.Baumgrass,Nico.Herzberg,Andreas.Meyer, Mathias.Weske}@hpi.de Abstract: The execution of business processes generates alot of data representing happenings (also called events) that may be utilized for process monitoring and analysis. This, however, is not supported by typical Business Process Management Systems (BPMSs). Especially,inmanual executing business process environments, i.e., not drivenbyaBPMS,the correlation of events to processes for monitoring and analysis is not trivial. At design-time, ProcessEvent Monitoring Points are usedinprocess models to specify the locations, where particular events are expected. Therewith, occurring events can be assigned to aprocess during run-time. In this paper,weintroduce an extension to BPMN,which implements this connection between process models and events. We showapplicability of this extension by applying it to alogistics scenario taken from an EU project. 1Introduction Nowadays, the availability and creation of process-relevant information in terms of events1 increases substantially,e.g. through the Internet of Things, Big Data as well as newand faster in-memory and data streaming technologies. Furthermore, sensors such as GPS receivers, RFID chips, transponders, detectors, cameras, or satellites enable the depiction of the current status of processes. Although the amount of events would lead to afine-grained monitoring, mining, and decision support for business processes, alarge number of business processes controlled by a BPMS operate without them. Especially,monitoring events of business processes not controlled by asingle system and across enterprise boundaries is valuable for gaining insights about business process execution [Luc02, Luc11], e.g., to ensure abusiness process is executed as expected.
    [Show full text]
  • A COMPLEX EVENT PROCESSING SYSTEM for MONITORING of MANUFACTURING SYSTEMS Master of Science Thesis
    JORGE A. GARCIA IZAGUIRRE MONTEMAYOR A COMPLEX EVENT PROCESSING SYSTEM FOR MONITORING OF MANUFACTURING SYSTEMS Master of Science Thesis Examiner: Professor José L. M. Lastra Examiner and topic approved in the Automation, Mechanical and Materials Engineering Faculty Council meeting on 7 Mar 2012 I Abstract TAMPERE UNIVERSITY OF TECHNOLOGY Master’s Degree Programme in Information Technology GARCIA IZAGUIRRE MONTEMAYOR, JORGE A.: A Complex Event Processing system for monitoring of manufacturing systems Master of Science Thesis, 84 pages, 12 Appendix pages February 2012 Major: Factory Automation Examiner: Prof. José Luis Martínez Lastra Keywords: complex event processing, event-driven architecture, service oriented architecture, production engineering, web services, factory automation, OPC-UA, DPWS Future manufacturing systems will require to process large amounts of complex data due to a rising demand on visibility and vertical integration of factory floor devices with higher level systems. Systems contained in higher layers of the business model are rapidly moving towards a Service Oriented Architecture, inducing a tendency to push Web Technologies down to the factory floor level. Evidence of this trend is the addition of Web Services at the device level with Device Profile for Web Services and the transition of OPC based on COM/DCOM communication to OPC- UA based on Web Services. DPWS and OPC-UA are becoming nowadays the preferred options to provide on a device level, service-oriented solutions capable to extend with an Event Driven Architecture into manufacturing systems. This thesis provides an implementation of a factory shop floor monitor based on Complex Event Processing for event-driven manufacturing processes. Factory shop monitors are particularly used to inform the workshop personnel via alarms, notifications and, visual aids about the performance and status of a manufacturing process.
    [Show full text]
  • Integration and Exploitation of Sensor Data in Smart Cities Through Event-Driven Applications
    sensors Article Integration and Exploitation of Sensor Data in Smart Cities through Event-Driven Applications Manuel Garcia Alvarez * , Javier Morales and Menno-Jan Kraak Geo-information Processing Department, ITC Faculty, University of Twente, Hengelosestraat 99, 7514 AE Enschede, The Netherlands; [email protected] (J.M.); [email protected] (M.-J.K.) * Correspondence: [email protected]; Tel.: +31-53-487-4444 Received: 3 February 2019; Accepted: 14 March 2019; Published: 19 March 2019 Abstract: Smart cities are urban environments where Internet of Things (IoT) devices provide a continuous source of data about urban phenomena such as traffic and air pollution. The exploitation of the spatial properties of data enables situation and context awareness. However, the integration and analysis of data from IoT sensing devices remain a crucial challenge for the development of IoT applications in smart cities. Existing approaches provide no or limited ability to perform spatial data analysis, even when spatial information plays a significant role in decision making across many disciplines. This work proposes a generic approach to enabling spatiotemporal capabilities in information services for smart cities. We adopted a multidisciplinary approach to achieving data integration and real-time processing, and developed a reference architecture for the development of event-driven applications. This type of applications seamlessly integrates IoT sensing devices, complex event processing, and spatiotemporal analytics through a processing workflow for the detection of geographic events. Through the implementation and testing of a system prototype, built upon an existing sensor network, we demonstrated the feasibility, performance, and scalability of event-driven applications to achieve real-time processing capabilities and detect geographic events.
    [Show full text]
  • Data Streams, Complex Events, and BI Seth Grimes Alta Plana Corporation +1 301-270-0795
    Data Streams, Complex Events, and BI Seth Grimes Alta Plana Corporation +1 301-270-0795 -- http://altaplana.com International Data Warehouse & Business Intelligence Summit 2008 June 11-13, 2008 Agenda BI at the speed of thought → Analytics at the speed of data: the business case. Technologies and Solutions for real-time data and real-time analytics. Evaluating and implementing: Best Practices, strategy, and resources. Data Streams, Complex Events, and BI 3 Data Streams I worked for 3 years for NASA... Programming simulations of satellites that would map the earth‟s gravity field. Data involved simulated orbit altitude, inclination, duration, and the accuracy and measurement rate of instruments. http://media.skyandtelescope.com Instruments captured acceleration with 6 degrees of freedom – 3 spatial dimensions plus “attitude”: roll, pitch & yaw. I also worked on magnetic-field mapping where satellites would be ranged by ground-based lasers. Copyright © 2008 Alta Plana Corporation International BI-DW Summit Data Streams, Complex Events, and BI 4 Data Streams Then I worked for 5 years for the U.S. National Highway Traffic Safety Administration... Vehicle crash tests (at that time) included up to 80-90 sensors on vehicles and dummies, 8000x/second data rate. Data was correlated to video. http://www.nhtsa.dot.gov/ Analyses were off-line. Copyright © 2008 Alta Plana Corporation International BI-DW Summit Data Streams, Complex Events, and BI 5 Data Streams I then worked with economic data, especially time series... Observations are at calendar frequencies: yearly, monthly, weekly, etc. Econometric models link disparate data and enable forecasting. Copyright © 2008 Alta Plana Corporation International BI-DW Summit Data Streams, Complex Events, and BI 6 Data Streams Data streams come from many sources.
    [Show full text]
  • Join Query Optimization Techniques for Complex Event Processing Applications
    Join Query Optimization Techniques for Complex Event Processing Applications Ilya Kolchinsky Assaf Schuster Technion, Israel Institute of Technology Technion, Israel Institute of Technology Haifa 32000 Israel Haifa 32000 Israel [email protected] [email protected] ABSTRACT Keywords Complex event processing (CEP) is a prominent technology Stream Processing, Complex Event Processing, Lazy Eval- used in many modern applications for monitoring and track- uation, Query Optimization ing events of interest in massive data streams. CEP engines inspect real-time information ows and attempt to detect 1. INTRODUCTION combinations of occurrences matching predened patterns. Complex event processing has become increasingly im- This is done by combining basic data items, also called portant for applications in which arbitrarily complex pat- primitive events, according to a pattern detection plan, terns must be eciently detected over high-speed streams in a manner similar to the execution of multi-join queries of events. Online nance, security monitoring, and fraud in traditional data management systems. Despite this sim- detection are among the many examples. Pattern detection ilarity, little work has been done on utilizing existing join generally consists of collecting primitive events and combin- optimization methods to improve the performance of CEP- ing them into potential (partial) matches using some type based systems. of detection model. As more events are added to a partial In this paper, we provide the rst theoretical and experi- match, a full pattern match is eventually formed and re- mental study of the relationship between these two research ported. Popular CEP mechanisms include nondeterministic areas. We formally prove that the CEP Plan Generation nite automata (NFAs) [5, 18, 51], nite state machines [6, problem is equivalent to the Join Query Plan Generation 45], trees [36], and event processing networks [21, 42].
    [Show full text]
  • Complex Event Processing for Self-Optimizing Cellular Networks
    sensors Article Complex Event Processing for Self-Optimizing Cellular Networks Isabel de-la-Bandera 1,* , Matías Toril 1 , Salvador Luna-Ramírez 1 , Víctor Buenestado 1 and José María Ruiz-Avilés 2 1 Campus Teatinos, University of Málaga, 29071 Málaga, Spain; [email protected] (M.T.); [email protected] (S.L.-R.); [email protected] (V.B.) 2 Ericsson, Parque Tecnológico de Andalucía, 29590 Málaga, Spain; [email protected] * Correspondence: [email protected] Received: 25 February 2020; Accepted: 27 March 2020; Published: 30 March 2020 Abstract: In a cellular network, signaling and data messages exchanged between network elements are an extremely valuable information for network optimization. The consideration of different types of information allows to improve the optimization results. However, the huge amount of information has made it very difficult for operators to process all the available information. To cope with this issue, in this paper, a methodology for processing cell and user connection traces to optimize a live cellular network is presented. The aim is to generate new performance indicators different from those supplied by manufacturers, taking advantage of the ability of complex event processing tools to correlate events of different nature. For illustrative purposes, an example of how a new performance indicator is created from real traces by complex event processing is given. Keywords: big data; complex event processing; LTE; mobile network; trace 1. Introduction Mobile communications have experienced an unprecedented evolution that has led to a rapid increase in the number of mobile users and services. To cope with these changes, new radio access technologies and network architectures have been developed, which has increased the size and complexity of mobile networks.
    [Show full text]
  • Enhancing Stream Processing and Complex Event Processing Systems Abderrahmen Kammoun
    Enhancing Stream Processing and Complex Event Processing Systems Abderrahmen Kammoun To cite this version: Abderrahmen Kammoun. Enhancing Stream Processing and Complex Event Processing Systems. Net- working and Internet Architecture [cs.NI]. Université de Lyon, 2019. English. NNT : 2019LYSES012. tel-02468246 HAL Id: tel-02468246 https://tel.archives-ouvertes.fr/tel-02468246 Submitted on 5 Feb 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. No d’ordre NNT: 2019LYSE012 THESE DE DOCTORAT DE L’UNIVERSITE DE LYON opérée au sein de L’UNIVERSITE JEAN MONNET Ecole Doctoral N o 488 Sciences, Ingénierie et Santé Spécialité de doctorat: Discipline : Informatique Soutenue publiquement le 08/07/2019, par: Abderrahmen Kammoun Enhancing Stream Processing and Complex Event Processing Systems Devant le jury composé de : Jean-Marc Petit, PR, Institut National des Sciences Appliquées de Lyon, Rapporteur Yann Busnel, PR, École Nationale Supérieure Mines-Télécom Atlantique Bretagne Pays de la Loire, Rapporteur Frédérique Laforest, PR, Institut National des Sciences Appliquées de Lyon, Examinatrice Jacques Fayolle, PR, Université Jean Monnet, Directeur de thèse Kamal Singh, MCF, Université Jean Monnet, Co-Directeur Je dédie cette thèse : À mon père Habib Kammoun.
    [Show full text]