Distributed Data Stream Processing and Edge Computing

Total Page:16

File Type:pdf, Size:1020Kb

Distributed Data Stream Processing and Edge Computing Distributed Data Stream Processing and Edge Computing: A Survey on Resource Elasticity and Future Directions Marcos Dias de Assuncao, Alexandre da Silva Veith, Rajkumar Buyya To cite this version: Marcos Dias de Assuncao, Alexandre da Silva Veith, Rajkumar Buyya. Distributed Data Stream Pro- cessing and Edge Computing: A Survey on Resource Elasticity and Future Directions. Journal of Net- work and Computer Applications (JNCA), Elsevier, 2018, 103, pp.1-17. 10.1016/j.jnca.2017.12.001. hal-01653842 HAL Id: hal-01653842 https://hal.inria.fr/hal-01653842 Submitted on 2 Dec 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed Data Stream Processing and Edge Computing: A Survey on Resource Elasticity and Future Directions Marcos Dias de Assunc¸ao˜ a,∗, Alexandre da Silva Veitha, Rajkumar Buyyab aInria, LIP, ENS Lyon, France bThe University of Melbourne, Australia Abstract Under several emerging application scenarios, such as in smart cities, operational monitoring of large infrastructure, wearable assistance, and Internet of Things, continuous data streams must be processed under very short delays. Several solutions, including multiple software engines, have been developed for processing unbounded data streams in a scalable and efficient manner. More recently, architecture has been proposed to use edge computing for data stream processing. This paper surveys state of the art on stream processing engines and mechanisms for exploiting resource elasticity features of cloud computing in stream processing. Resource elasticity allows for an application or service to scale out/in according to fluctuating demands. Although such features have been extensively investigated for enterprise applications, stream processing poses challenges on achieving elastic systems that can make efficient resource management decisions based on current load. Elasticity becomes even more challenging in highly distributed environments comprising edge and cloud computing resources. This work examines some of these challenges and discusses solutions proposed in the literature to address them. Keywords: Big Data, Stream processing, Resource elasticity, Cloud computing 1. Introduction streams to detect patterns, identify failures [6], and gain insights. The increasing availability of sensors, mobile phones, Several stream processing frameworks and tools have and other devices has led to an explosion in the volume, been proposed for carrying out analytical tasks in a variety and velocity of data generated and that requires scalable and efficient manner. Many tools employ a analysis of some type. As society becomes more inter- dataflow approach where incoming data results in data connected, organisations are producing vast amounts of streams that are redirected through a directed graph data as result of instrumented business processes, mon- of operators placed on distributed hosts that execute itoring of user activity [1,2], wearable assistance [3], algebra-like operations or user-defined functions. Some website tracking, sensors, finance, accounting, large- frameworks, on the other hand, discretise incoming scale scientific experiments, among other reasons. This data streams by temporarily storing arriving data during data deluge is often termed as big data due to the chal- small time windows and then performing micro-batch lenges it poses to existing infrastructure regarding, for processing whereby triggering distributed computations instance, data transfer, storage, and processing [4]. on the previously stored data. The second approach A large part of this big data is most valuable when aims at improving the scalability and fault-tolerance of it is analysed quickly, as it is generated. Under sev- distributed stream processing tools by handling strag- eral emerging application scenarios, such as in smart gler tasks and faults more efficiently. cities, operational monitoring of large infrastructure, Also to improve scalability, many stream processing and Internet of Things (IoT) [5], continuous data frameworks have been deployed on clouds [7], aiming streams must be processed under very short delays. In to benefit from characteristics such as resource elastic- several domains, there is a need for processing data ity. Elasticity, when properly exploited, refers to the ability of a cloud to allow a service to allocate additional ∗Corresponding author: assuncao@acm.org resources or release idle capacity on demand to match Preprint submitted to Elsevier November 30, 2017 the application workload. Although efforts have been future directions on the topic and finally, Section8 con- made towards making stream-processing more elastic, cludes the paper. many issues remain unaddressed. There are challenges regarding the placement of stream processing tasks on 2. Background and Architecture available resources, identification of bottlenecks, and application adaptation. These challenges are exacer- This section describes background on stream- bated when services are part of a larger infrastructure processing systems for big-data. It first discusses how that comprises multiple execution models (e.g. lambda layered real-time architecture is often organised and architecture, workflows or resource-management bind- then presents a historical summary of how such systems ings for high-level programming abstractions [8,9]) or have evolved over time. hybrid environments comprising both cloud and edge computing resources [10, 11]. 2.1. Online Data Processing Architecture More recently, software frameworks [12, 13] and ar- Architecture for online1 data analysis is generally chitectures have been proposed for carrying out data multi-tiered systems that comprise many loosely cou- stream processing using constrained resources located pled components [15, 16, 17]. While the reasons for at the edge of the Internet. This scenario introduces structuring architecture in this way may vary, the main additional challenges regarding application scheduling, goals include improving maintainability, scalability, and resource elasticity, and programming models. This arti- availability. Figure1 provides an overview of com- cle surveys stream-processing solutions and approaches ponents often found in a stream-processing architec- for deploying data stream processing on cloud comput- ture. Although an actual system might not have all these ing and edge environments. By so doing, it makes the components, the goal here is to describe how a stream following contributions: processing architecture may look like and position the stream processing solutions discussed later. • It reviews multiple generations of data stream pro- The Data Sources (Figure1) that require timely pro- cessing frameworks, describing their architectural cessing and analysis include Web analytics, infrastruc- and execution models. ture operational monitoring, online advertising, social media, and IoT. Most Data Collection is performed by • It analyses and classifies existing work on exploit- tools that run close to where the data and that commu- ing elasticity to adapt resource allocation to match nicate the data via TCP/IP connections, UDP, or long- the demands of stream processing services. Previ- range communication [18]. Solutions such as JavaScript ous work has surveyed stream processing solutions Object Notation (JSON) are used as a data-interchange without a focus on how resource elasticity is ad- format. For more structured data, wire protocols such dressed [14]. The present work provides a more in- as Apache Thrift [19] and Protocol Buffers [20], can be depth analysis of existing solutions and discusses employed. Other messaging protocols have been pro- how they attempt to achieve resource elasticity. posed for IoT, some of which are based on HTTP [5]. • It discusses ongoing efforts on resource elasticity Most data collection activities are executed at the edges for data stream processing and their deployment on of a network, and some level of data aggregation is often edge computing environments, and outlines future performed via, for instance Message Queue Telemetry directions on the topic. Transport (MQTT), before data is passed through to be processed and analysed. The rest of this paper is organised as follows. Section An online data-processing architecture can comprise 2 provides background information on big-data ecosys- multiple tiers of collection and processing, with the con- tems and architecture for online data processing. Sec- nection between these tiers made on an ad-hoc basis. tion3 describes existing engines and other software so- To allow for more modular systems, and to enable each lutions for data stream processing whereas Section4 tier to grow at different paces and hence accommo- discusses managed cloud solutions for stream process- date changes, the connection is at times made by mes- ing. In Section5 we elaborate on how existing work sage brokers and queuing systems such as Apache Ac- tries to tackle aspects of resource elasticity for data tiveMQ [21], RabbitMQ [22] and Kestrel [23], publish- stream processing. Section6 discusses
Recommended publications
  • Big Data Stream Analysis: a Systematic Literature Review
    Kolajo et al. J Big Data (2019) 6:47 https://doi.org/10.1186/s40537-019-0210-7 SURVEY PAPER Open Access Big data stream analysis: a systematic literature review Taiwo Kolajo1,2* , Olawande Daramola3 and Ayodele Adebiyi1,4 *Correspondence: taiwo.kolajo@stu.cu.edu.ng; Abstract taiwo.kolajo@fulokoja.edu.ng Recently, big data streams have become ubiquitous due to the fact that a number of 1 Department of Computer and Information Sciences, applications generate a huge amount of data at a great velocity. This made it difcult Covenant University, Ota, for existing data mining tools, technologies, methods, and techniques to be applied Nigeria directly on big data streams due to the inherent dynamic characteristics of big data. In Full list of author information is available at the end of the this paper, a systematic review of big data streams analysis which employed a rigorous article and methodical approach to look at the trends of big data stream tools and technolo- gies as well as methods and techniques employed in analysing big data streams. It provides a global view of big data stream tools and technologies and its comparisons. Three major databases, Scopus, ScienceDirect and EBSCO, which indexes journals and conferences that are promoted by entities such as IEEE, ACM, SpringerLink, and Elsevier were explored as data sources. Out of the initial 2295 papers that resulted from the frst search string, 47 papers were found to be relevant to our research questions after implementing the inclusion and exclusion criteria. The study found that scalability, privacy and load balancing issues as well as empirical analysis of big data streams and technologies are still open for further research eforts.
    [Show full text]
  • Real-Time Analytics for Fast Evolving Social Graphs
    Real-time Analytics for Fast Evolving Social Graphs Charith Wickramaarachchi1, Alok Kumbhare1, Marc Frincu2, Charalampos Chelmis2, and Viktor K. Prasanna2 1Dept. of Computer Science, University of Southern California, Los Angeles, California 90089 2Dept. of Electrical Engineering, University of Southern California, Los Angeles, California 90089 Email: kumbhare@usc.edu, cwickram@usc.edu, frincu@usc.edu, chelmis@usc.edu, prasanna@usc.edu Abstract—Existing Big Data streams coming from social second have been observed. In Facebook’s case we notice and other connected sensor networks exhibit intrinsic inter- an average of 41,000 posts per second or about 2.4Mb dependency enabling unique challenges to scalable graph ana- of data each second. Processing this huge amount of fast lytics. Data from these graphs is usually collected in different geographically located data servers making it suitable for streaming data to extract useful knowledge in real-time is distributed processing on clouds. While numerous solutions for challenging and requires besides efficient graph updates, large scale static graph analysis have been proposed, addressing scalable methods for performing incremental analytics in in real-time the dynamics of social interactions requires novel order to reduce the complexity of the data-driven algorithms. approaches that leverage incremental stream processing and Existing graph processing methods have focused either graph analytics on elastic clouds. We propose a scalable solution based on our stream pro- on large shared memory approaches where the graph is cessing engine, Floe, on top of which we perform real-time streamed and processed in-memory [6], or on batch pro- data processing and graph updates to enable low latency graph cessing techniques for distributed computing where periodic analytics on large evolving social networks.
    [Show full text]
  • Dzone-Guide-To-Big-Data.Pdf
    THE 2018 DZONE GUIDE TO Big Data STREAM PROCESSING, STATISTICS, & SCALABILITY VOLUME V BROUGHT TO YOU IN PARTNERSHIP WITH THE DZONE GUIDE TO BIG DATA: STREAM PROCESSING, STATISTICS, AND SCALABILITY Dear Reader, Table of Contents I first heard the term “Big Data” almost a decade ago. At that time, it Executive Summary looked like it was nothing new, and our databases would just be up- BY MATT WERNER_______________________________ 3 graded to handle some more data. No big deal. But soon, it became Key Research Findings clear that traditional databases were not designed to handle Big Data. BY G. RYAN SPAIN _______________________________ 4 The term “Big Data” has more dimensions than just “some more data.” It encompasses both structured and unstructured data, fast moving Take Big Data to the Next Level with Blockchain Networks BY ARJUNA CHALA ______________________________ 6 and historical data. Now, with these elements added to the data, some of the other problems such as data contextualization, data validity, Solving Data Integration at Stitch Fix noise, and abnormality in the data became more prominent. Since BY LIZ BENNETT _______________________________ 10 then, Big Data technologies has gone through several phases of devel- Checklist: Ten Tips for Ensuring Your Next Data Analytics opment and transformation, and they are gradually maturing. A term Project is a Success BY WOLF RUZICKA, ______________________________ that was considered as a fad and a technology ecosystem that was 13 considered a luxury are slowly establishing themselves as necessary Infographic: Big Data Realization with Sanitation ______ needs for today’s business activities. Big Data is the new competitive 14 advantage and it matters for our businesses.
    [Show full text]
  • Optimizing Timeliness, Accuracy, and Cost in Geo-Distributed Data-Intensive Computing Systems
    Optimizing Timeliness, Accuracy, and Cost in Geo-Distributed Data-Intensive Computing Systems A DISSERTATION SUBMITTED TO THE FACULTY OF THE GRADUATE SCHOOL OF THE UNIVERSITY OF MINNESOTA BY Benjamin Heintz IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF Doctor of Philosophy Professor Abhishek Chandra December, 2016 c Benjamin Heintz 2016 ALL RIGHTS RESERVED Acknowledgements I would like to thank Chenyu Wang for developing and running the experiments in Chapter 3, and Ravali Kandur for her assistance deploying Apache Storm on PlanetLab. The work presented here was supported in part by NSF Grants CNS-0643505, CNS- 0519894, CNS-1413998, and IIS-0916425, by an IBM Faculty Award, and by a University of Minnesota Doctoral Dissertation Fellowship. About six years ago, I set my sights on an M.S. degree in Computer Science. As I was beginning to plan for what I thought would be a brief career as a graduate student, I met with Prof. Jaideep Srivastava to discuss possible summer research. I am incredibly thankful that, instead of talking about which summer projects I could work on, he encouraged me to aim higher and pursue a Ph.D. I owe a tremendous debt of gratitude to my collaborators, especially Prof. Jon Weiss- man, Prof. Ramesh K. Sitaraman, and my advisor, Prof. Abhishek Chandra. If I have developed even a small fraction of their ability to see the details without losing track of the big picture, to write well, and most of all to be persistent, then the last five years will have been worth it. I am particularly grateful for my advisor's endless patience and unshakable calm.
    [Show full text]
  • Big Data Analytics Options on AWS
    Big Data Analytics Options on AWS December 2018 This paper has been archived. For the latest technical information, see https://docs.aws.amazon.com/whitepapers/latest/big-data- analytics-options/welcome.html Archived © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Notices This document is provided for informational purposes only. It represents AWS’s current product offerings and practices as of the date of issue of this document, which are subject to change without notice. Customers are responsible for making their own independent assessment of the information in this document and any use of AWS’s products or services, each of which is provided “as is” without warranty of any kind, whether express or implied. This document does not create any warranties, representations, contractual commitments, conditions or assurances from AWS, its affiliates, suppliers or licensors. The responsibilities and liabilities of AWS to its customers are controlled by AWS agreements, and this document is not part of, nor does it modify, any agreement between AWS and its customers. Archived Contents Introduction 5 The AWS Advantage in Big Data Analytics 5 Amazon Kinesis 7 AWS Lambda 11 Amazon EMR 14 AWS Glue 20 Amazon Machine Learning 22 Amazon DynamoDB 25 Amazon Redshift 29 Amazon Elasticsearch Service 33 Amazon QuickSight 37 Amazon EC2 40 Amazon Athena 42 Solving Big Data Problems on AWS 45 Example 1: Queries against an Amazon S3 Data Lake 47 Example 2: Capturing and Analyzing Sensor Data 49 Example 3: Sentiment Analysis of Social
    [Show full text]
  • Big Data Analytics Options on AWS AWS Whitepaper Big Data Analytics Options on AWS AWS Whitepaper
    Big Data Analytics Options on AWS AWS Whitepaper Big Data Analytics Options on AWS AWS Whitepaper Big Data Analytics Options on AWS: AWS Whitepaper Copyright © Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress may not be used in connection with any product or service that is not Amazon's, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon. Big Data Analytics Options on AWS AWS Whitepaper Table of Contents Abstract ............................................................................................................................................ 1 Introduction ...................................................................................................................................... 2 The AWS advantage in big data analytics .............................................................................................. 3 Amazon Kinesis .......................................................................................................................... 4 Ideal usage patterns ........................................................................................................... 5 Cost model ........................................................................................................................ 5 Performance .....................................................................................................................
    [Show full text]
  • S2CE: a Hybrid Cloud and Edge Orchestrator for Mining Exascale
    S2CE: A Hybrid Cloud and Edge Orchestrator for Mining Exascale Distributed Streams Nicolas Kourtellis Herodotos Herodotou Maciej Grzenda nicolas.kourtellis@telefonica.com herodotos.herodotou@cut.ac.cy m.grzenda@mini.pw.edu.pl Telefonica Research Cyprus University of Technology Warsaw University of Technology Barcelona, Spain Limassol, Cyprus Warsaw, Poland Piotr Wawrzyniak Albert Bifet 800383@edu.p.lodz.pl albert.bifet@telecom-paris.fr Lodz University of Technology LTCI, Telecom Paris, IP-Paris Lodz, Poland Paris, France ABSTRACT 1 INTRODUCTION The explosive increase in volume, velocity, variety, and veracity In the future Internet era, with hundreds of billions of devices, of data generated by distributed and heterogeneous nodes such as principle factors dominating the continuous utility of the Internet IoT and other devices, continuously challenge the state of art in big will be: 1) the massive population of devices and their intelligent data processing platforms and mining techniques. Consequently, it agents, 2) the big, fast, and diverse data produced from them and reveals an urgent need to address the ever-growing gap between their users, and 3) the need for large-scale, adaptive infrastructures this expected exascale data generation and the extraction of insights to process and extract knowledge from these exascale data in or- from these data. To address this need, this paper proposes Stream der to help make critical, data-driven decisions. Intelligent agents to Cloud & Edge (S2CE), a first of its kind, optimized, multi-cloud already exist in different forms, and are well embedded in various and edge orchestrator, easily configurable, scalable, and extensible. ways in our everyday lives, either as passive data collectors, or S2CE will enable machine and deep learning over voluminous and active producers.
    [Show full text]
  • A Buyer's Guide to Streaming Data Integration for Google Cloud Platform
    A Buyer’s Guide to Streaming Data Integration For Google Cloud Platform A Buyer’s Guide to Streaming Data Integration For Google Cloud Platform Table of Contents CHAPTER 1: Setting the Stage for Digital Transformation . 2 The Digital Transformation Game-Changer.......................................................2 Why Streaming Data Integration is Necessary ....................................................4 What’s In This eBook . 4 CHAPTER 2: How SDI Fits Into A Modern Data Architecture......................................6 Cloud Equation ................................................................................7 The Change Data Capture Solution ..............................................................7 Designing for the Future .......................................................................8 CHAPTER 3: The Business Value of Streaming Data Integration.................................10 Game-Changing Technology . .11 Streaming’s Broad Business Impact ............................................................12 The Role of SDI ...............................................................................13 SDI in Practice . .14 SDI and the Cloud ............................................................................15 CHAPTER 4: 1 + 1 = 3: Streaming Data Integration and the Google Cloud Platform...............19 Multi-Cloud and Multi-Engine . .19 CHAPTER 5: Building the Business Case for SDI ................................................22 Start With the Low-Hanging Fruit ...............................................................22
    [Show full text]
  • Distributed Supervised Sentiment Analysis of Tweets
    Distributed Supervised Sentiment Analysis of Tweets: Integrating Machine Learning and Streaming Analytics for Big Data Challenges in Communication and Audience Research Análisis distribuido y supervisado de sentimientos en Twitter: Integrando aprendizaje automático y analítica en tiempo real para retos de dimensión big data en investigación de comunicación y audiencias Carlos Arcila Calderón University of Salamanca carcila@usal.es (ESPAÑA) Félix Ortega Mohedano University of Salamanca fortega@usal.es (ESPAÑA) Mateo Álvarez University Rey Juan Carlos mateyoalvarez@gmail.com (ESPAÑA) Miguel Vicente Mariño University of Valladolid miguelvm@soc.uva.es (ESPAÑA) Recibido: 25.01 2018 Aceptado: 20.12.2018 EMPIRIA. Revista de Metodología de Ciencias Sociales. N.o 42 enero-abril, 2019, pp. 113-136. ISSN: 1139-5737, DOI/empiria.42.2019.23254 114 C.ARCILA, F.ORTEGA, M.ÁLVAREZ Y M. VICENTE ANÁLISIS DISTRIBUIDO... RESUMEN El análisis a gran escala de tweets en tiempo real utilizando el análisis de sentimiento supervisado representa una oportunidad única para la investigación de comunicación y audiencias. El poner juntos los enfoques de aprendizaje au- tomático y de analítica en tiempo real en un entorno distribuido puede ayudar a los investigadores a obtener datos valiosos de Twitter con el fin de clasificar de forma inmediata mensajes en función de su contexto, sin restricciones de tiempo o almacenamiento, mejorando los diseños transversales, longitudinales y experimentales con nuevas fuentes de datos. A pesar de que los investiga- dores de comunicación y audiencias ya han comenzado a utilizar los métodos computacionales en sus rutinas, la mayoría desconocen el uso de las tecnologías de computo distribuido para afrontar retos de dimensión big data.
    [Show full text]
  • Streaming Infrastructure and Natural Language Modeling with Application to Streaming Big Data Yuheng Du Clemson University, Yuheng.Du.Hust@Gmail.Com
    Clemson University TigerPrints All Dissertations Dissertations May 2019 Streaming Infrastructure and Natural Language Modeling with Application to Streaming Big Data Yuheng Du Clemson University, yuheng.du.hust@gmail.com Follow this and additional works at: https://tigerprints.clemson.edu/all_dissertations Recommended Citation Du, Yuheng, "Streaming Infrastructure and Natural Language Modeling with Application to Streaming Big Data" (2019). All Dissertations. 2329. https://tigerprints.clemson.edu/all_dissertations/2329 This Dissertation is brought to you for free and open access by the Dissertations at TigerPrints. It has been accepted for inclusion in All Dissertations by an authorized administrator of TigerPrints. For more information, please contact kokeefe@clemson.edu. Streaming Infrastructure and Natural Language Modeling with Application to Streaming Big Data A Dissertation Presented to the Graduate School of Clemson University In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy Computer Science by Yuheng Du May 2019 Accepted by: Dr. Amy Apon, Committee Chair Dr. Alexander Herzog Dr. Mashrur Chowdhury Dr. Andre Luckow Dr. Ilya Safro Abstract Streaming data are produced in great velocity and diverse variety. The vision of this research is to build an end-to-end system that handles the collection, curation and analysis of streaming data. The streaming data used in this thesis contain both numeric type data and text type data. First, in the field of data collection, we design and evaluate a data delivery framework that handles the real- time nature of streaming data. In this component, we use streaming data in automotive domain since it is suitable for testing and evaluating our data delivery system.
    [Show full text]
  • Process Mining with Streaming Data
    Process mining with streaming data Citation for published version (APA): van Zelst, S. J. (2019). Process mining with streaming data. Technische Universiteit Eindhoven. Document status and date: Published: 14/03/2019 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: openaccess@tue.nl providing details and we will investigate your claim.
    [Show full text]
  • Efficient Stream Data Management
    From Big Data to Fast Data: Efficient Stream Data Management Alexandru Costan To cite this version: Alexandru Costan. From Big Data to Fast Data: Efficient Stream Data Management. Distributed, Parallel, and Cluster Computing [cs.DC]. ENS Rennes, 2019. tel-02059437v2 HAL Id: tel-02059437 https://hal.archives-ouvertes.fr/tel-02059437v2 Submitted on 14 Mar 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. École doctorale MathSTIC HABILITATION À DIRIGER DES RECHERCHES Discipline: INFORMATIQUE présentée devant l’École Normale Supérieure de Rennes sous le sceau de l’Université Bretagne Loire par Alexandru Costan préparée à IRISA Institut de Recherche en Informatique et Systèmes Aléatoires Soutenue à Bruz, le 14 mars 2019, devant le jury composé de: Rosa Badia / rapporteuse Directrice de recherche, Barcelona Supercomputing Center, Espagne From Big Data Luc Bougé / examinateur Professeur des universités, ENS Rennes, France to Fast Data: Valentin Cristea / examinateur Professeur des universités, Université Politehnica de Efficient Stream Bucarest, Roumanie Christian Pérez / rapporteur Data Management Directeur de recherche, Inria, France Michael Schöttner / rapporteur Professeur des universités, Université de Düsseldorf, Allemagne Patrick Valduriez / examinateur Directeur de recherche, Inria, France 3 Abstract This manuscript provides a synthetic overview of my research journey since my PhD de- fense.
    [Show full text]