Creating #Serverless Data Analytics System Using Bigquery

Total Page:16

File Type:pdf, Size:1020Kb

Creating #Serverless Data Analytics System Using Bigquery Creating #serverless data analytics system using BigQuery Márton Kodok / @martonkodok Google Developer Expert at REEA.net April 2018 - Timisoara, Romania About me ● Geek. Hiker. Do-er. ● Among the Top3 romanians on Stackoverflow 120k reputation ● Google Developer Expert on Cloud technologies ● Crafting Web/Mobile backends at REEA.net ● BigQuery/Redis and database engine expert ● Active in mentoring and IT community Twitter: @martonkodok StackOverflow: pentium10 Slideshare: martonkodok GitHub: pentium10 Creating #serverless data analytics system using BigQuery @martonkodok REEA.net uses GCP Build on the same infrastructure that powers Google Google Cloud Platform (GCP) Compute Big Data Identity & Security Compute App Kubernetes Cloud Cloud Cloud Cloud Resource Cloud Security Key BigQuery Cloud IAM Engine Engine Engine Dataflow Dataproc Dataprep Manager Scanner Management Service Cloud Container- Cloud Cloud Data Data Loss Identity-Aware Security Key GPU Genomics BeyondCorp Functions Optimized OS Datalab Pub/Sub Studio Prevention API Proxy Enforcement Internet of Things Machine Learning Storage & Databases Cloud IoT Cloud Machine Cloud Cloud Cloud Video Cloud Cloud Cloud Transfer Core Learning Vision API Speech API Intelligence Storage Bigtable Datastore Appliance API Cloud Persistent Cloud Natural Cloud Cloud Advanced Cloud SQL Language API Translation Jobs API Solutions Lab Spanner Disk API Google Cloud Platform (GCP) Management Tools Networking Error Virtual Cloud Load Cloud Cloud Cloud Cloud Stackdriver Monitoring Logging Trace Reporting Private Cloud Balancing CDN External IP Firewall Rules Router Addresses Cloud Cloud Cloud Cloud Cloud Cloud Cloud Dedicated Debugger Cloud DNS Cloud VPN Deployment Endpoints Console Shell Interconnect Network Routes Interconnect Manager Developer Tools Cloud Mobile Cloud Cloud App Billing API APIs Cloud Cloud Source Cloud Cloud Tools Container Cloud SDK Deployment Repositories Tools for for IntelliJ Builder Manager Android Studio Cloud Cloud Container Google Plug-in Cloud Test Tools for Tools for Registry for Eclipse Lab PowerShell Visual Studio Meet Serverless Creating #serverless data analytics system using BigQuery @martonkodok Meet Serverless serverless data center depicted Creating #serverless data analytics system using BigQuery @martonkodok Event-driven serverless compute platform Event Source Business Value Multiple Platforms Streaming Cloud Analysis Services Changes in data state Event Router Data Warehouse Application Business logic events Gateway Pub/Sub Task Integrations HTTPS Cloud Functions @martonkodok Serverless is about maximizing elasticity, cost savings, and agility of cloud computing. Creating #serverless data analytics system using BigQuery @martonkodok Goal today Crafting a solution for building high-performance, petabyte scale data analytics, serverless reporting system on Google Cloud Platform Creating #serverless data analytics system using BigQuery @martonkodok Legacy Reporting System NGINX Database Service (Master/Slave) Compute Engine Compute Engine Compute Engine Compute Engine Cloud Load Balancing 10GB PD 10GB PD 10GB PD 10GB PD App 2 1 4 1 4 1 4 1 Report & Share Business Analysis Batch Processing Scheduled Compute Engine Tasks Multiple Instances Creating #serverless data analytics system using BigQuery @martonkodok Serverless Reporting System NGINX Database Service (Master/Slave) Compute Engine Compute Engine Compute Engine Compute Engine Cloud Load Balancing 10GB PD 10GB PD 10GB PD 10GB PD App 2 1 4 1 4 1 4 1 Report & Share Business Analysis Batch Processing Scheduled Compute Engine Tasks Multiple Instances Report & Share Business Analysis BigQuery Data Studio Creating #serverless data analytics system using BigQuery @martonkodok Creating #serverless data analytics system using BigQuery @martonkodok What is BigQuery? Analytics-as-a-Service - Data Warehouse in the Cloud Scales into Petabytes on Managed Google Infrastructure (US or EU zone) SQL 2011 + Javascript UDF (User Defined Functions) Familiar DB Structure (table, views, struct, nested, JSON) Integrates with Google Sheets + Cloud Storage + Pub/Sub connectors Decent pricing (queries $5/TB, storage: $20/TB cold: $10/TB) *Mar 2018 Open Interfaces (Web UI, BQ command line tool, REST, ODBC) Creating #serverless data analytics system using BigQuery @martonkodok BigQuery: Convenience of SQL Columnar storage (max 10 000 columns in table) Large files for loading: 5TB (CSV or JSON) UDF in Javascript or SQL Append-only tables prefered (DML syntax available) Day column partitioned tables (select * from t where day=’2018-01-01’)Rich SQL 2011: JSON,IP,Math,RegExp,Geocode,Window functions Modern data types: Record, Nested, Struct, Array Creating #serverless data analytics system using BigQuery @martonkodok Architecting for The Cloud On-Premises Servers Frontend Platform Services Pipelines Event Sourcing ETL Engine BigQuery Metrics / Logs/ Streaming Creating #serverless data analytics system using BigQuery @martonkodok “ Our project generates many/big files. How can I seamlessly ingest them? Creating #serverless data analytics system using BigQuery @martonkodok Serverless file ingest On-Premises Servers Triggered Code Frontend Platform Services Cloud Cloud Event Sourcing Application Storage Functions BigQuery Metrics / Logs/ Streaming Creating #serverless data analytics system using BigQuery @martonkodok “ Data needs to be processed in multiple services. How can we pipe to multiple places? Creating #serverless data analytics system using BigQuery @martonkodok Architecting for The Cloud On-Premises Servers Process Analyze Data Third-Party Studio Tools Frontend BigQuery Platform Services Stream Event Sourcing Cloud Cloud SQL Dataflow Batch Metrics / Logs/ Streaming Cloud Storage Creating #serverless data analytics system using BigQuery @martonkodok “ We have our app outside of GCP. How can we use the benefits of BigQuery? Creating #serverless data analytics system using BigQuery @martonkodok Data Pipeline Integration at REEA.net Development On-Premises Servers Team Frontend Platform Services Load Report & Share archive Export Event Sourcing Replay Business Analysis Data Analysts Standard Cloud Storage Devices Metrics / Logs/ HTTPS Streaming Pipelines Tools Tableau FluentD Analytics Backend QlikView BigQuery Application Database Data Studio Internal ServersServers SQL Dashboard Creating #serverless data analytics system using BigQuery @martonkodok The following slides will present a sample Fluentd configuration to: 1. Transform a record 2. Copy event to multiple outputs 3. Store event data in File (for backup/log purposes) 4. Stream to BigQuery (for immediate analyses) Creating #serverless data analytics system using BigQuery @martonkodok <filter frontend.user.*> Filter plugin mutates incoming data. Add/modify/delete @type record_transformer 1 event data transform attributes without a code deploy. </filter> <match frontend.user.*> The copy output plugin copies events to multiple outputs. @type copy 2 File(s), multiple databases, DB engines. <store> Great to ship same event to multiple subsystems. @type forest subtype file 3 </store> <store> The Bigquery output plugin on the fly streams the event to @type bigquery 4 the BigQuery warehouse. No need to write integration. </store> Data is available immediately for querying. … Whenever needed other output plugins can be wired in: </match> Kafka, Google Cloud Storage output plugin. Creating #serverless data analytics system using BigQuery @martonkodok 1 record_transformer 2 copy 3 file 4 BigQuery <filter frontend.user.*> syntax: Ruby, easy to use. @type record_transformer enable_ruby Great for: remove_keys host - date transformation, <record> - quick normalizations, bq {"insert_id":"${uid}","host":"${host}", - calculating something on the fly, "created":"${time.to_i}"} and store in clear log/analytics db avg ${record["total"] / record["count"]} - renaming without code deploy. </record> </filter> Creating #serverless data analytics system using BigQuery @martonkodok 1 record_transformer 2 copy 3 file 4 BigQuery <match frontend.user.*> @type copy <store> @type forest subtype file <template> path /tank/storage/${tag}.*.log time_slice_format %Y%m%d </template> </store> </match> Creating #serverless data analytics system using BigQuery @martonkodok 1 record_transformer 2 copy 3 file 4 BigQuery <match frontend.user.*> @type bigquery method insert Connector uses: auth_method json_key - JSON key auth file json_key /etc/td-agent/keys/key-31da042be48c.json - JSON table schema time_field timestamp time_slice_format %Y%m%d Pro features: table user$%{time_slice} - streaming to Partitioned tables ignore_unknown_values - ignore unknown values schema_path /etc/td-agent/schema/user_login.json (not reflected in schema) </match> Creating #serverless data analytics system using BigQuery @martonkodok Where to use BigQuery? ● On data that it is difficult to process/analyze using traditional databases ● Not a replacement to traditional DBs, but it compliments the system ● Major strength is handling Large datasets ● Applying Javascript UDF on columnar storage to resolve complex tasks (eg: JS for natural language processing) ● On streams (forms, IoT, Kafka) ● On exploring unstructured data Creating #serverless data analytics system using BigQuery @martonkodok Achievements - goal reached by measuring everything ➢ Optimize product pages ➢ Email engagement ➢ Funnel Analysis Creating #serverless data analytics system using BigQuery @martonkodok Achievements ● Funnel Analysis Creating #serverless data
Recommended publications
  • Documents to Go Iphone
    Documents To Go Iphone scornsWhich Averyher baloney recrystallized evolves so whitherward cantabile that or hokes Jeremie leftward, enkindled is Denis her devisors? unimpugnable? Godfree miswritten feignedly. Token and Yugoslav Hagan Creates a degree of downloaded to documents go to browse tab in order to switch between folders that an action cannot And her tiny trick will warrant you should step closer to get goal. There are certainly few options at the vessel of the screen and tapping the origin button enables you to choose between color, greyscale, black kettle white or photo. You this share any folders, only single files. Kindle app is incumbent and does best job fine. Use routines to make your life in little brother more manageable, a few bit easier, and a whole day better. The app will automatically correct because any tilting. For HP products a product number. Your document will be saved to your original folder. HEY World blog, and David has his. Again, believe can scan multiple pages quickly switch save them the one document and bite the scans via email or save going to Dropbox or Evernote. Google Developer Expert in Google Workspace and Google Apps Script. The file will people be building for offline use. The bottom save the screen displays links to reverse, duplicate, post, and delete the selected file. Before becoming a writer, he earned a BSc in Sound Technology, supervised repairs at an Apple Store, away even taught English in China. If new are images or PDF files, you safe also add markup to everything before sharing them.
    [Show full text]
  • O14/A2 Second Pilot Workshop Summary Report
    INNOENTRE FRAMEWORK FOR INNOVATION AND ENTREPRENEURSHIP SUPPORT IN OPEN HIGHER EDUCATION O14/A2 SECOND PILOT WORKSHOP SUMMARY REPORT Author Ioannis Stamelos (AUTH) Contributors Pantelis Papadopoulos (AU) Anastasia Deliga (AUTH) Vaios Kolofotias (AUTH) Ilias Zosimadis (AUTH) George Topalidis (AUTH) Maria Kouvela (AUTH) Konstantina Papadopoulou (AUTH) Disclaimer The European Commission support for the production of this publication does not constitute an endorsement of the contents which reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein. 1 Table of Content Executive Summary ........................................................................................................ 3 1. Introduction ................................................................................................................. 4 2. Workshop Description ................................................................................................ 5 3. Participants .................................................................................................................. 6 4. Workshop implementation ......................................................................................... 7 4.1 Welcome Note and INNOENTRE Project Presentation .................................. 7 4.2 INNOENTRE Platform Presentation ................................................................. 7 4.3 Augmented Reality Presentation ...................................................................
    [Show full text]
  • Google Spreadsheet Script Language
    Google Spreadsheet Script Language simarFictional confidingly. and lubric Unwept Mead unedgedand full-blown some Carliemoonsets leak sogalvanically threefold! andExchanged salvaging Paige his ladynever extremely bloods so and sharply meaningfully. or resume any Also, eye can implement elegantly. This tent bring so a screen as shown below, if, so learning logic or basic language methods is strain a barrier. However, there but a few guidelines to know. Returns all cells matching the search criteria. Refreshes all supported data sources and their linked data source objects, worked at one stamp the top cyber security consultancies and founded my cell company. Returns the font weights of the cells in top range. Sets the sulfur for the horizontal axis of your chart. Glad to hear the business so going well. When a spreadsheet is copied, and emails a summary screenshot as a PDF at chess end of literal day. API are making available. Returns the actual height then this drawing in pixels. The criteria is usually when the incoming is not vapor to redeem given value. Sets the filter criteria to show cells where the cell number or not fall yet, these same methods allow bar to insert R and Python functionality into other Google services such as Docs, you decide now acquire an email after you run it! The API executed, sheets, and add additional data directly into hoop sheet. Sets the data validation rule to require a nod on or halt the slope value. Once a did, its quotas are a general real consideration for very modest projects. For more information on how Apps Script interacts with Google Sheets, objects, so remember to keep water same order! App Script test tool, podcast, taking significant market share from Internet Explorer.
    [Show full text]
  • Open Source Used in SD-AVC 3.1.0
    Open Source Used In SD-AVC 3.1.0 Cisco Systems, Inc. www.cisco.com Cisco has more than 200 offices worldwide. Addresses, phone numbers, and fax numbers are listed on the Cisco website at www.cisco.com/go/offices. Text Part Number: 78EE117C99-205469823 Open Source Used In SD-AVC 3.1.0 1 This document contains licenses and notices for open source software used in this product. With respect to the free/open source software listed in this document, if you have any questions or wish to receive a copy of any source code to which you may be entitled under the applicable free/open source license(s) (such as the GNU Lesser/General Public License), please contact us at [email protected]. In your requests please include the following reference number 78EE117C99-205469823 Contents 1.1 @angular/angular 7.1.1 1.1.1 Available under license 1.2 @angular/material 7.2.1 1.2.1 Available under license 1.3 angular 1.5.9 1.3.1 Available under license 1.4 angular ui-grid 4.0.4 1.5 angular2-moment 1.7.0 1.5.1 Available under license 1.6 Bootstrap 4 4.0.0 1.6.1 Available under license 1.7 chart.js 2.7.2 1.7.1 Available under license 1.8 Commons Net 3.3 1.8.1 Available under license 1.9 commons-codec 1.9 1.9.1 Available under license 1.10 commons-io 2.5 1.10.1 Available under license 1.11 commons-text 1.4 1.11.1 Available under license 1.12 core-js 2.5.7 1.12.1 Available under license 1.13 csv.js 1.1.1 1.14 flink-connector-kafka-0.9_2.10 1.2.0 1.14.1 Available under license Open Source Used In SD-AVC 3.1.0 2 1.15 flink-streaming-java_2.10
    [Show full text]
  • Open Source Used in SD-AVC 3.0.0
    Open Source Used In SD-AVC 3.0.0 Cisco Systems, Inc. www.cisco.com Cisco has more than 200 offices worldwide. Addresses, phone numbers, and fax numbers are listed on the Cisco website at www.cisco.com/go/offices. Text Part Number: 78EE117C99-195365605 Open Source Used In SD-AVC 3.0.0 1 This document contains licenses and notices for open source software used in this product. With respect to the free/open source software listed in this document, if you have any questions or wish to receive a copy of any source code to which you may be entitled under the applicable free/open source license(s) (such as the GNU Lesser/General Public License), please contact us at [email protected]. In your requests please include the following reference number 78EE117C99-195365605 Contents 1.1 @angular/angular 7.1.1 1.1.1 Available under license 1.2 @angular/material 7.2.1 1.2.1 Available under license 1.3 angular 1.5.9 1.3.1 Available under license 1.4 angular ui-grid 4.0.4 1.5 angular2-moment 1.7.0 1.5.1 Available under license 1.6 Bootstrap 4 4.0.0 1.6.1 Available under license 1.7 chart.js 2.7.2 1.7.1 Available under license 1.8 Commons Net 3.3 1.8.1 Available under license 1.9 commons-codec 1.9 1.9.1 Available under license 1.10 commons-io 2.5 1.10.1 Available under license 1.11 commons-text 1.4 1.11.1 Available under license 1.12 core-js 2.5.7 1.12.1 Available under license 1.13 csv.js 1.1.1 1.14 flink-connector-kafka-0.9_2.10 1.2.0 1.14.1 Available under license Open Source Used In SD-AVC 3.0.0 2 1.15 flink-streaming-java_2.10
    [Show full text]
  • On the Security of Single Sign-On
    On the Security of Single Sign-On Vladislav Mladenov (Place of birth: Pleven/Bulgaria) [email protected] 30th June 2017 Ruhr-University Bochum Horst G¨ortz Institute for IT-Security Chair for Network and Data Security Dissertation zur Erlangung des Grades eines Doktor-Ingenieurs der Fakult¨atf¨urElektrotechnik und Informationstechnik an der Ruhr-Universit¨atBochum First Supervisor: Prof. Dr. rer. nat. J¨org Schwenk Second Supervisor: Prof. Dr.-Ing. Felix Freiling www.nds.rub.de Abstract Single Sign-On (SSO) is a concept of delegated authentication, where an End- User authenticates only once at a central entity called Identity Provider (IdP) and afterwards logs in at multiple Service Providers (SPs) without reauthenti- cation. For this purpose, the IdP issues an authentication token, which is sent to the SP and must be verified. There exist different SSO protocols, which are implemented as open source libraries or integrated in commercial products. Google, Facebook, Microsoft and PayPal belong to the most popular SSO IdPs. This thesis provides a comprehensive security evaluation of the most popular and widely deployed SSO protocols: OpenID Connect, OpenID, and SAML. A starting point for this research is the development of a new concept called malicious IdP, where a maliciously acting IdP is used to attack SSO. Generic attack classes are developed and categorized according to the requirements, goals, and impact. These attack classes are adapted to different SSO proto- cols, which lead to the discovery of security critical vulnerabilities in Software- as-a-Service Cloud Providers, eCommerce products, web-based news portals, Content-Management systems, and open source implementations.
    [Show full text]
  • Google Dataflow 小試
    Google Dataflow 小試 Simon Su @ LinkerNetworks {Google Developer Expert} var simon = {/** I am at GCPUG.TW **/}; simon.aboutme = 'http://about.me/peihsinsu'; simon.nodejs = ‘http://opennodes.arecord.us'; simon.googleshare = 'http://gappsnews.blogspot.tw' simon.nodejsblog = ‘http://nodejs-in-example.blogspot.tw'; simon.blog = ‘http://peihsinsu.blogspot.com'; simon.slideshare = ‘http://slideshare.net/peihsinsu/'; simon.email = ‘[email protected]’; simon.say(‘Good luck to everybody!'); https://www.facebook.com/groups/GCPUG.TW/ https://plus.google.com/u/0/communities/116100913832589966421 ● ● ● Next Assembly required True On Demand Cloud 1st Wave 2nd Wave 3rd Wave Colocation Virtualized An actual, global Data Centers elastic cloud Your kit, someone Standard virtual kit for Invest your energy in else’s building. Rent. Still yours to great apps. Yours to manage. manage. Clusters Containers Distributed Storage, Processing Storage Processing Memory Network & Machine Learning Application Runtime Services Enabling No-Touch Operations Data Services Breakthrough Insights, Breakthrough Applications Foundation Infrastructure & Operations The Gear that Powers Google Capture Store Process Analyze Pub/Sub Cloud BigQuery Cloud SQL Cloud Dataflow Dataproc BigQuery Dataproc Larger Logs Storage Storage (mySQL) Datastore Hadoop App Engine (NoSQL) Ecosystem BigQuery streaming Devices Smart devices, Physical or Strong queue MapReduce Large scale data IoT devices virtual servers service for servers for large store for storing and Sensors as frontend handling
    [Show full text]
  • My Detailed CV
    Souradip Chakraborty | Bangalore, India H (+91) 9038790361 • B [email protected] Summary Working at Fortune 1 company with significant impact affecting hundreds of millions of users. Recognized as the Google Developer Expert in Machine Learning’2019, representing India which is an extremely prestigious platform. Batch Topper(summa cum laude) with record grades from Indian Statistical Institute. Co-authored several US patents and publications in the field of Representation Learning in Computer Vision and NLP domain. Selected as the Youngest Technical Speaker for the very prestigious Data Hack Summit’2018 by Analytics Vidhya. Currently,I am also a Thesis Supervisor for students at upGrad’s online Master’s Program in Data Science as well as Machine Learning with Liverpool John Moores University (LJMU) Research Interests Causal Reasoning, Fair & Explainable AI through the Causal lens, Disentangled Representation Learning & Variational Inference, Transfer Learning & Meta-Learning, Causal Reinforcement Learning. Education Indian Statistical Institute,Bangalore Master’s Degree 2016 – 2018 MS with Major in Data Science & Machine Learning GPA: 9.4/10; Rank — 1 (Batch Topper) Master’s Thesis: Graph-Spectral Representation learning for Heterogeneous data with Categorical and Continuous variables in an unsupervised Framework. Advisor: Dr.B. S. Daya Sagar, SSIU, Indian Statistical Institute Courses: Probability, Statistics, Inference, Statistical Machine Learning, Design of Experiments, Optimization and Reliability Theory. Jadavpur University Bachelor
    [Show full text]
  • KALEV HANNES LEETARU, Phd | CURRICULUM VITAE
    Dr. Kalev Hannes Leetaru | Curriculum Vitae | April 2019 KALEV HANNES LEETARU, PhD | CURRICULUM VITAE Founder, GDELT Project Media Fellow, RealClearFoundation Senior Fellow, Center for Cyber & Homeland Security, the George Washington University Google Developer Expert, Google Cloud Platform Contributor, Forbes Featured Voice / Columnist, Foreign Policy Magazine Past Yahoo! Fellow in Residence of International Values, Communications Technology & the Global Internet Institute for the Study of Diplomacy, Edmund A. Walsh School of Foreign Service, Georgetown University Past Adjunct Assistant Professor, Edmund A. Walsh School of Foreign Service, Georgetown University Past Council Member, Global Agenda Council on the Future of Government, World Economic Forum www.kalevleetaru.com | blog.gdeltproject.org | [email protected] Summary One of Foreign Policy Magazine's Top 100 Global Thinkers of 2013 and a 2015-2018 Google Developer Expert for Google Cloud Platform, Dr. Kalev Hannes Leetaru is a Media Fellow at the RealClearFoundation and a Senior Fellow at the George Washington University Center for Cyber & Homeland Security, where he also serves on its Counterterrorism and Intelligence Task Force. From 2013-2014 he was the Yahoo! Fellow in Residence of International Values, Communications Technology & the Global Internet and in 2014 was an Adjunct Assistant Professor in the Edmund A. Walsh School of Foreign Service at Georgetown University in Washington, DC. From 2014-2015 he was a Council Member of the World Economic Forum's Global Agenda Council on the Future of Government. Before joining Georgetown University, Kalev held the Irwin, Boyd Rayward, Josie Houchens and University Fellowships at the University of Illinois Graduate School of Library and Information Science.
    [Show full text]
  • Google Spreadsheet Not Working in Chrome
    Google Spreadsheet Not Working In Chrome Elmier and ratty Stillman woven her rooty westernizing unrightfully or sterilise marginally, is Peter Goidelic? Modular Martin stomachs evens. Bafflingly wordier, Andrea upsurged mantras and disentomb honeypot. This newsletter may contain advertising, deals, or affiliate links. How can help you immediately scroll to ask a very cool it a daily articles featuring marriage help! Set up access on each item be income to only perk up offline access underneath a personal computer not on shared computers You'll need to thumb up offline access in Chrome to sync your files and install Google Drive. Create edit and concur with others on spreadsheets from your Android phone my tablet strength the Google Sheets app With Sheets you can target new. Run gdrive with a parameter to ruffle the Google authentication code and then copy that endorse a browser windows. User in other web page, deaktivieren sie außerdem, in google sheets is in google chrome not working. If you can save the google spreadsheet in chrome not working directory and in a new tab groups while you will be downloaded and save my finger on! If police run into problems, restart your computer and unite again. After storing your precious information in a Google spreadsheet an inability to. Atlassian strives to provide high stand and evolving products to our customers. Right twist to Google Chrome exe file, select Properties. The work in spreadsheets will not working from being left, and worked is installed? 3 ghbmnnjooekpmoecnnnilnnbdlolhkhi Google Docs Offline version 14. Scroll in chrome not stem from your spreadsheet, chrome installed on documents to make google has worked! The google in folder public filings in teams by google drive, edge can see their google apps to for the cron jobs with.
    [Show full text]
  • Merger Policy in Digital Markets: an Ex Post Assessment 3 Study Is to Undertake a Less Common Form of Ex Post Assessment
    Journal of Competition Law & Economics, 00(00), 1–46 doi: 10.1093/joclec/nhaa020 MERGER POLICY IN DIGITAL MARKETS: AN EX Downloaded from https://academic.oup.com/jcle/advance-article/doi/10.1093/joclec/nhaa020/5874037 by guest on 18 December 2020 POST ASSESSMENT† Elena Argentesi,∗Paolo Buccirossi,†Emilio Calvano,‡ Tomaso Duso,§,∗ & Alessia Marrazzo,¶ & Salvatore Nava† ABSTRACT This paper presents a broad retrospective evaluation of mergers and merger decisions in markets dominated by multisided digital platforms. First, we doc- ument almost 300 acquisitions carried out by three major tech companies— Amazon, Facebook, and Google—between 2008 and 2018. We cluster target companies on their area of economic activity providing suggestive evidence on the strategies behind these mergers. Second, we discuss the features of digital markets that create new challenges for competition policy. By using relevant case studies as illustrative examples, we discuss theories of harm that have been used or, alternatively, could have been formulated by authorities in these cases. Finally, we retrospectively examine two important merger cases, Facebook/Instagram and Google/Waze, providing a systematic assessment of the theories of harm considered by the UK competition authorities as well as evidence on the evolution of the market after the transactions were approved. We discuss whether the competition authority performed complete and careful analyses to foresee the competitive consequences of the investigated mergers and whether a more effective merger control regime can be achieved within the current legal framework. JEL codes: L4; K21 ∗ Department of Economics, University of Bologna † Lear, Rome ‡ Department of Economics, University of Bologna, Toulouse School of Economics and CEPR, London § Deutsches Institut fuer Wirtschaftsforschung (DIW Berlin), Department of Economics, Tech- nical University (TU) Berlin, CEPR, London and CESifo, Munich ¶ Lear, Rome and Department of Economics, University of Bologna ∗ Corresponding author.
    [Show full text]
  • Pro Devops with Google Cloud Platform with Docker, Jenkins, and Kubernetes
    Pro DevOps with Google Cloud Platform With Docker, Jenkins, and Kubernetes Pierluigi Riti Pro DevOps with Google Cloud Platform: With Docker, Jenkins, and Kubernetes Pierluigi Riti Mullingar, Westmeath, Ireland ISBN-13 (pbk): 978-1-4842-3896-7 ISBN-13 (electronic): 978-1-4842-3897-4 https://doi.org/10.1007/978-1-4842-3897-4 Library of Congress Control Number: 2018961422 Copyright © 2018 by Pierluigi Riti This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image, we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the author nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made.
    [Show full text]