Using Third-Party Data to Make Smarter Decisions

Total Page:16

File Type:pdf, Size:1020Kb

Using Third-Party Data to Make Smarter Decisions Using third-party data to make smarter decisions A collection of AWS Data Exchange blogs Table of contents Using Amazon SageMaker, AWS Marketplace, and AWS Data Exchange to predict retail product popularity � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �6 The retail scenario: deliver a custom ML model to predict the popularity of retail bath products � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �6 Solution overview � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �7 Step 1: Subscribe to the algorithm � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �7 Step 2: Create an Amazon SageMaker notebook instance and conduct the experiment � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �8 Next steps � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �9 Collect and distribute high-resolution crypto market data with ECS, S3, Athena, Lambda, and AWS Data Exchange � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 11 Data ingestion � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 13 Data publication � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 19 Analyzing COVID-19 data with AWS Data Exchange, Amazon Redshift, and Tableau � � � � � � � � � � � � � � � � � � � � � � � � � 36 Dashboarding COVID-19 data � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 37 Summary � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 41 Tableau Software – APN Partner spotlight � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 42 Using AWS Marketplace for machine learning workloads � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 43 How AWS Marketplace supports your ML workloads � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 43 Table of contents // 2 Data visualization in AWS using AWS Data Exchange and Amazon QuickSight � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 51 Prerequisites � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 51 Preparing the data � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 52 Creating a data visualization � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 53 Example visualizations � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 53 Publish and update data products dynamically with AWS Data Exchange � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 59 Prerequisites � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 60 AWS Data Exchange concepts � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 60 Publishing a new product to AWS Data Exchange � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 61 Publishing new data files to the product automatically � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 68 Algorithmic Trading on AWS with Amazon SageMaker and AWS Data Exchange � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 82 Feeding Algorithmic Trading Engine with Data: Focus on AWS Data Exchange � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 86 Deployment and Usage Description � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 87 Clean up resources used � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 98 How Wine Access optimizes wine delivery using WeatherTrend360 from AWS Data Exchange � � � � � � � � � � � � � � � � � �100 Business challenges � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �100 The temperature challenge � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �100 Solution overview � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �100 How cloud-based data mesh technology can enable financial regulatory data collection� � � � � � � � � � � � � � � � � � � � � � �104 Background � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �104 Table of contents // 3 Table of contents // 3 Introducing the data mesh � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 104 Outline implementation approach � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 105 Opportunities and benefits � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 107 Creating customized data products on AWS Data Exchange � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 110 Prerequisites � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 110 Creating a product with revision access rules � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 110 Creating a private product � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 113 How restaurants are augmenting data to drive insights � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 115 Conclusion � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � 119 Table of contents // 4 Table of contents // 4 Introduction Agile, successful organizations are increasingly reliant upon the new insights gained by using third-party data to complement their internal data� Layering data from multiple third parties enable users to adapt dynamic business models quickly and enhance customer satisfaction� AWS Data Exchange can accelerate that capability� This eBook is intended for technical decision-makers and builders who seek to extract highly impactful and refined insights from data to make more informed decisions, faster. The use cases here span multiple industries—financial services, retail, hospitality, healthcare, manufacturing—but all have a common aim: to make smarter.
Recommended publications
  • Download the Paper (PDF)
    WWW.VIRUSBULLETIN.COM/CONFERENCE 2019 LONDON 2 – 4 October 2019 EXPLORING EMOTET, AN ELABORATE EVERYDAY ENIGMA Luca Nagy Sophos, Hungary [email protected] ABSTRACT Based on Sophos detection numbers, the Emotet trojan is the most widespread malware family in the wild. Since its appearance more than fi ve years ago, it has been – and remains – the most notorious and costly active malware. Emotet owes its reputation to its constant state of evolution and change. The malware’s rapid advancement helps support its highly sophisticated operation. This paper will discuss the reverse engineering of its components, as well as the capabilities and features of Emotet: a detailed overview of its multi-layered operation, starting with the spam lure, the malicious attachments (and their evolution), and the malware executable itself, from its highly sophisticated packer to its C2 server communications. Emotet is well known for its modular architecture, its worm-like propagation, and its highly skilled persistence techniques. The recent versions spread rapidly using multiple methods. Besides its ability to spread by brute forcing using its own password lists, it can also harvest email addresses and email content from victims, then spread through spam. Its diverse module list hides different malicious intentions, such as information stealing, including credentials from web browsers or email clients; spreading capabilities; and delivering other malware including ransomware and other banking trojans. We will dissect the background operations of the payload modules. We will also present statistics from Sophos about Emotet’s global reach. A BRIEF HISTORY OF EMOTET The fi rst Emotet sample we detected popped up on 26 May 2014.
    [Show full text]
  • The ENIGMA Data Clearinghouse: a Platform for Rigorous Self-Validated Data Modeling and Integrative, Reproducible Data Analysis
    The ENIGMA Data Clearinghouse: A platform for rigorous self-validated data modeling and integrative, reproducible data analysis John-Marc Chandonia*,1 ([email protected]), Pavel S. Novichov*,1, Adam P. Arkin, and Paul D. Adams1,2 1Lawrence Berkeley National Lab, Berkeley; 2University of California at Berkeley; *co-first authors http://enigma.lbl.gov Project Goals: ENIGMA (Ecosystems and Networks Integrated with Genes and Molecular Assemblies) uses a systems biology approach to understand the interaction between microbial communities and the ecosystems that they inhabit. To link genetic, ecological, and environmental factors to the structure and function of microbial communities, ENIGMA integrates and develops laboratory, field, and computational methods. One of the Grand Challenges of data science is to facilitate knowledge discovery by enabling datasets to be readily analyzable both by humans and by machine learning algorithms. In 2016, a diverse group of stakeholders formalized a concise and measurable set of principles, called FAIR, to increase the utility of datasets for the purpose of knowledge discovery. The four principles of FAIR are Findability, Accessibility, Interoperability, and Reusability. Findability means that data are assigned stable identifiers, and properly indexed. Accessibility means the data are easily retrievable by people authorized to have access. Interoperability means the data are clearly documented using a formal language, in order to facilitate integrated analyses that span multiple datasets. Reusability means the data are documented sufficiently well that it may be used by other people than those who originally generated it, and that the provenance of all data is clear. The latter two principles are particularly challenging, yet critical to achieve, for organizations such as ENIGMA that draw conclusions based on highly integrative analyses of many types of data generated by multiple labs.
    [Show full text]
  • Transaction / Regular Paper Title
    TFG EN ENGINYERIA INFORMÀTICA, ESCOLA D’ENGINYERIA (EE), UNIVERSITAT AUTÒNOMA DE BARCELONA (UAB) 1 ENIGMA A Python-based file sharing server that ensures privacy, anonymity and confidentiality Xavier Torrent Gorjón Resum—Des dels inicis de la humanitat, la comunicació i la seva privacitat ha estat un camp d'exhaustiva recerca. Això encara és cert avui dia, considerant que la privacitat i seguretat a Internet és motiu de debat diàriament. Aquest projecte apunta a oferir un servidor basat en Python capaç d'emmagatzemar arxius en línia, tot preservant la seva privacitat, confidencialitat i anonimat. Hem iterat sobre diversos dissenys en la nostra cerca d'una implementació que complís tots els nostres requeriments. Finalment hem aconseguit una solució que implica usar dos servidors diferents, un a càrrec de les accions com logins i processos de registre, i l'altre responsable de tractar amb els fitxers. Des de l'esquema teòric hem desenvolupat una aplicació considerant tots els possibles atacs que es podrien fer contra el nostre sistema, centrant-nos en els atacs de man-in-the-middle. Hem completat satisfactòriament el projecte en el calendari previst, oferint un producte que pot complir tots els requeriments de seguretat d'avui en dia, mantenint la senzillesa d'ús. Paraules clau—Privacitat de dades, confidencialitat, anonimat en arxius. Abstract—Ever since the inception of humanity, communication and its privacy has been a field of extensive research. Even today, this premise holds true, as privacy and security on the Internet is a daily topic. This project aims to deliver a Python-based on-line server capable of storing all kinds of files while preserving privacy, confidentiality and anonymity.
    [Show full text]
  • Find Truth in Data 74 $3 7,500 ,000 10 931.5125 640 5 ,859,700
    Find truth in data 2016MOMENTUM REPORT 5,859,700 Average daily traffic at 59th St N/Q/R MTA subway station 10 74 Elevators Noise $37,500,000 last complaints Last sale inspected in 2016 price 3/2/2015 of Thor Equities 640 Student enrollment at PS 112 931.5125 Frequency of Verizon Wireless Antenna #3295904 2016 MOMENTUM REPORT Issue 01 - 02 COMPANY 2014 - 2016 2015 Total Capital Raised Revenue Growth Series B Round $34.6mil 500% $28.2mil Enigma is backed by top-tier Fortune 500 clients including Circle of trusted advisors expands investors including NEA, Two Merck, American Express, to include NEA: Scott Sandell, Sigma Ventures, American Express and EMD are realizing the Managing General Partner; Ventures, Comcast Ventures, immense value of data that Forest Baskett, former CTO of Silicon Crosslink, and The New York Times. is connected and actionable. Graphics; and Greg Papadopoulos, former CTO of Sun Microsystems. 2015 - 2016 Bookings 10X Enigma bookings increased more than tenfold from 2015 to 2016 as the company has partnered with new clients and identified opportunities to expand existing relationships. 2015 2016 GROWTH Our New Flatiron HQ Office Square 13,000 ft2 Footage 867% Enigma Technologies, Inc. was founded in a small Harlem apartment and has since evolved to a 13,000 ft2 150 ft2 space on 5th Avenue to accommodate the fast growing team. 2013 2014 2015 2016 Employee Headcount 65 722% There are now 70 team members supporting a range of functions 9 from Operations and HR to Data Science and Engineering. 2013 2014 2015 2016 2016 MOMENTUM REPORT Issue 01 - 03 TEAM Where We Live Employees boast a wide range of backgrounds, from industrial engineering, computational astrophysics, and neuroscience, to art history, philosophy, and journalism.
    [Show full text]
  • Planning and Designing Databases on AWS (AWS-PD-DB)
    Planning and Designing Databases on AWS (AWS-PD-DB) COURSE OVERVIEW: In this course, you will learn about the process of planning and designing both relational and nonrelational databases. You will learn the design considerations for hosting databases on Amazon Elastic Compute Cloud (Amazon EC2). You will learn about our relational database services including Amazon Relational Database Service (Amazon RDS), Amazon Aurora, and Amazon Redshift. You will also learn about our nonrelational database services including Amazon DocumentDB, Amazon DynamoDB, Amazon ElastiCache, Amazon Neptune, and Amazon QLDB. By the end of this course, you will be familiar with the planning and design requirements of all 8 of these AWS databases services, their pros and cons, and how to know which AWS databases service is right for your workloads. WHO WILL BENEFIT FROM THIS COURSE? • Data platform engineers • Database administrators • Solutions architects • IT professionals PREREQUISITES: We recommend that attendees of this course have previously completed the following AWS courses: • AWS Database Offerings digital training • Data Analytics Fundamentals digital training • Architecting on AWS classroom training COURSE OBJECTIVES: After completion of this course, students will be able to... • Apply database concepts, database management, and data modeling techniques • Evaluate hosting databases on Amazon EC2 instances • Evaluate relational database services (Amazon RDS, Amazon Aurora, and Amazon Redshift) and their features • Evaluate nonrelational database services
    [Show full text]
  • Interactive Attendee Guide for Oil & Gas Professionals
    oil & gas Interactive attendee guide for Oil & Gas Professionals Hello, On behalf of the entire AWS Worldwide Oil & Gas team, welcome to re:Invent 2018! This year’s conference is going to be our Welcome. biggest yet, with 50,000+ attendees and more than 2,000 technical sessions. To get the most out of re:Invent, we encourage you to take advantage of the resources outlined in this document, including our “How to re:Invent” video series. Keep in mind that reserved seating goes live on October 11. You can start planning your schedule at any time by logging into your account, visiting the session catalog, and marking sessions of interest. Although re:Invent is a big conference, the strength of the Oil & Gas community makes it feel much smaller. We look forward to seeing you in Vegas! Arno van den Haak Business Development, AWS Worldwide Oil & Gas © 2018 | Amazon Web Services. All rights reserved. Table of contents What to expect in 2018 » Let’s get started. re:Invent agenda » Oil & Gas sessions » This guide is designed to help attendees of AWS re:Invent 2018 plan their experience and identify breakout sessions and events of interest. It is intended to complement the re:Invent app, Other recommended sessions » which will help attendees navigate the conference on-site. Networking opportunities » Click on the links to navigate this guide. Executive Summit overview » Event venues and logistics » AWS Oil & Gas contacts » © 2018 | Amazon Web Services. All rights reserved. What to expect Networking re:Invent Agenda Oil & Gas Other Recommended Executive Summit Event Venue AWS Oil & Gas in 2018 Sessions Sessions Opportunities Overview and Logistics Expert Contacts What Where AWS re:Invent is a learning conference hosted by Amazon Web We are taking over Las Vegas--with events at the ARIA, Vdara, Services (AWS) for the global cloud computing community.
    [Show full text]
  • Analytics Lens AWS Well-Architected Framework Analytics Lens AWS Well-Architected Framework
    Analytics Lens AWS Well-Architected Framework Analytics Lens AWS Well-Architected Framework Analytics Lens: AWS Well-Architected Framework Copyright © Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress may not be used in connection with any product or service that is not Amazon's, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon. Analytics Lens AWS Well-Architected Framework Table of Contents Abstract ............................................................................................................................................ 1 Abstract .................................................................................................................................... 1 Introduction ...................................................................................................................................... 2 Definitions ................................................................................................................................. 2 Data Ingestion Layer ........................................................................................................... 2 Data Access and Security Layer ............................................................................................ 3 Catalog and Search Layer ...................................................................................................
    [Show full text]
  • The Essential Turing: Seminal Writings in Computing, Logic, Philosophy, Artificial Intelligence, and Artificial Life: Plus the Secrets of Enigma
    The Essential Turing: Seminal Writings in Computing, Logic, Philosophy, Artificial Intelligence, and Artificial Life: Plus The Secrets of Enigma B. Jack Copeland, Editor OXFORD UNIVERSITY PRESS The Essential Turing Alan M. Turing The Essential Turing Seminal Writings in Computing, Logic, Philosophy, Artificial Intelligence, and Artificial Life plus The Secrets of Enigma Edited by B. Jack Copeland CLARENDON PRESS OXFORD Great Clarendon Street, Oxford OX2 6DP Oxford University Press is a department of the University of Oxford. It furthers the University’s objective of excellence in research, scholarship, and education by publishing worldwide in Oxford New York Auckland Cape Town Dar es Salaam Hong Kong Karachi Kuala Lumpur Madrid Melbourne Mexico City Nairobi New Delhi Taipei Toronto Shanghai With offices in Argentina Austria Brazil Chile Czech Republic France Greece Guatemala Hungary Italy Japan South Korea Poland Portugal Singapore Switzerland Thailand Turkey Ukraine Vietnam Published in the United States by Oxford University Press Inc., New York © In this volume the Estate of Alan Turing 2004 Supplementary Material © the several contributors 2004 The moral rights of the author have been asserted Database right Oxford University Press (maker) First published 2004 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, without the prior permission in writing of Oxford University Press, or as expressly permitted by law, or under terms agreed with the appropriate reprographics rights organization. Enquiries concerning reproduction outside the scope of the above should be sent to the Rights Department, Oxford University Press, at the address above.
    [Show full text]
  • The BG News April 13, 1990
    Bowling Green State University ScholarWorks@BGSU BG News (Student Newspaper) University Publications 4-13-1990 The BG News April 13, 1990 Bowling Green State University Follow this and additional works at: https://scholarworks.bgsu.edu/bg-news Recommended Citation Bowling Green State University, "The BG News April 13, 1990" (1990). BG News (Student Newspaper). 5071. https://scholarworks.bgsu.edu/bg-news/5071 This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License. This Article is brought to you for free and open access by the University Publications at ScholarWorks@BGSU. It has been accepted for inclusion in BG News (Student Newspaper) by an authorized administrator of ScholarWorks@BGSU. NETTERS SET TO DUEL REDSKINS Women face a Redskin team with nine straight MAC titles; # Men look to become a member of the conference's upper echelon .. .see Sports p.5 The Nation *s Best College Newspaper K Weather Friday Vol.72 Issue 112 April 13,1990 Bowling Green, Ohio High 55' The BG News Low 40° BRIEFLY BG, USSR to hold forum Student leader by Jill Novak ternational classrooms ... which will be cost effi- escapes China staff writer cient, "he said. Students participating in the exchange view large CITY television monitors, with the screen split down the by Dan Biers They may not speak the same language, but Uni- middle so they can actually see each other simulta- Associated Press writer versity students and Soviet students will be able to neously. Summer softball: Any communicate and share ideas with the help of an in- An interpreter talks at the same time the partici- HONG KONG — Another fugitive student leader of student staying in Bowling Green this terpreter when a global classroom exchange is im- pants speak, but the participant's voice intonations the crushed pro-democracy movement has escaped summer and interested in playing plemented in the fall of 1991.
    [Show full text]
  • Dynamic Data Fabric and Trusted Data Mesh Using Goldengate
    Business / Technical Brief Technology Brief: Dynamic Data Fabric and Trusted Data Mesh using the Oracle GoldenGate Platform Core Principles and Attributes for a Trusted, Ledger-based, Low-latency Streaming Enterprise Data Architecture January 2021, Version 2.1 Copyright © 2021, Oracle and/or its affiliates Public 1 Dynamic Data Fabric and Trusted Data Mesh using the Oracle GoldenGate Platform Copyright © 2021, Oracle and/or its affiliates | Public Document Disclaimer This document is for informational purposes only and is intended solely to assist you in planning for the implementation and upgrade of the product features described. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described in this document remains at the sole discretion of Oracle. Due to the nature of the product architecture, it may not be possible to safely include all features described in this document without risking significant destabilization of the code. Document Purpose The intended audience for this document includes technology executives and enterprise data architects who are interested in understanding Data Fabric, Data Mesh and the Oracle GoldenGate streaming data platform. The document’s organization and content assume familiarity with common enterprise data management tools and patterns but is suitable for individuals new to Oracle GoldenGate, Data Fabric and Data Mesh concepts. The primary intent of this document is to provide education about (1) emerging data management capabilities, (2) a detailed enumeration of key attributes of a trusted, real-time Data Mesh, and (3) concise examples for how Oracle GoldenGate can be used to provide such capabilities.
    [Show full text]
  • Amazon Neptune Fast, Fully Managed Graph Database Service
    Amazon Neptune Fast, fully managed graph database service Karthik Bharathy Product Leader, Neptune © 2020, Amazon Web Services, Inc. or its Affiliates. Agenda • Graph and its use cases • Amazon Neptune overview • Architecture • Graph Data Model • Capabilities • Resources Graphs are all around us Why graph? Relationships enable new applications. connections paths patterns Network & IT Knowledge Fraud Detection Recommendations Social Life Sciences Graphs Networking Operations Connected Data Queries Navigate (variably) connected structure Filter or compute a result based on strength, weight or quality of relationships Knowledge Graph Brings context and semantic meaning by linked entities and events https://aws.amazon.com/blogs/apn/exploring-knowledge-graphs-on-amazon-neptune-using-metaphactory/ https://aws.amazon.com/blogs/database/building-and-querying-the-aws-covid-19-knowledge-graph/ Identity Graph A single unified view of customers and prospects based on their interactions with a product or website across a set of devices and identifiers https://aws.amazon.com/blogs/database/building-a-customer-identity-graph-with-amazon-neptune/ Customer 360 Gain a 360° view of your customers so you can better understand purchasing patterns and improve marketing attribution. https://aws.amazon.com/blogs/database/building-a-customer-360-knowledge-repository-with-amazon-neptune-and-amazon-redshift/ Fraud Detection Detect fraud patterns - a potential purchaser is using the same email address and credit card, multiple people associated with an email address, or multiple people sharing the same IP address but residing in different physical addresses. Social Recommendation Manage relationships between information such as customer interests, friends, or purchase history in a graph and quickly query it to make recommendations that are personalized.
    [Show full text]
  • Architecting for HIPAA Security and Compliance Whitepaper
    Architecting for HIPAA Security and Compliance on Amazon Web Services AWS Whitepaper Architecting for HIPAA Security and Compliance on Amazon Web Services AWS Whitepaper Architecting for HIPAA Security and Compliance on Amazon Web Services: AWS Whitepaper Copyright © Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress may not be used in connection with any product or service that is not Amazon's, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon. Architecting for HIPAA Security and Compliance on Amazon Web Services AWS Whitepaper Table of Contents Abstract ............................................................................................................................................ 1 Introduction ...................................................................................................................................... 2 Encryption and protection of PHI in AWS .............................................................................................. 3 Alexa for Business ...................................................................................................................... 6 Amazon API Gateway ................................................................................................................. 6 Amazon AppFlow
    [Show full text]