A Modern Approach to Data Orchestration a Modern Approach to Data Orchestration
Total Page:16
File Type:pdf, Size:1020Kb
White Paper A Modern Approach to Data Orchestration A Modern Approach to Data Orchestration Table of Contents Overview 3 Reltio’s Approach ................................................................................................................................................................. 3 Leading with An API-first Approach ............................................................................................................................ 4 Real-time APIs and Event Streaming 5 Direct access via REST API .............................................................................................................................................. 5 Real-time Event-based Streaming ................................................................................................................................ 6 Data Orchestration Pipelines 6 Batch Data Load API .......................................................................................................................................................... 6 Data Loader............................................................................................................................................................................ 7 Data Export ............................................................................................................................................................................ 7 Pre-built Data Pipelines for Data Lakes and Cloud Data Warehouses ............................................................ 8 Apache Spark ........................................................................................................................................................................ 9 Google BigQuery ................................................................................................................................................................. 9 Snowflake ................................................................................................................................................................................ 10 Data Integration Tool Connectors 11 MuleSoft Connector ............................................................................................................................................................ 11 SnapLogic Connector ......................................................................................................................................................... 12 Talend Data Fabric ............................................................................................................................................................... 13 Airflow to Build Custom Data Flows ............................................................................................................................ 13 Application Connector for Salesforce 13 Data as a Service Connectors 15 Reltio Data as a Service for 3rd Party Commercial Data ...................................................................................... 15 Dun & Bradstreet Connector ........................................................................................................................................... 15 Available Tenants for Third-party Data ....................................................................................................................... 16 Customer Data Subscriptions ......................................................................................................................................... 17 Conclusion 17 www.reltio.com 2 A Modern Approach to Data Orchestration Overview Reltio aggregates data from internal, third party, public, and social media sources, so you can establish a unified, accurate 360-degree view of people, organizations, products, places and activities, as well as the interrelationships between these entities. Further, all downstream operational and analytical systems can then gain real-time access to this enriched, organized, and optimized data. With Reltio Connected Customer 360, you can leverage the accurate, consistent, and comprehensive information that powers enhanced customer experiences and real-time operations. Reltio provides several mechanisms to support different integration scenarios and architectures. Data orchestration and integration are the two conceptual layers that enable the data exchange. The orchestration layer is aware of the source and target (Applications, Cloud Data Warehouses, 3rd party data source) and is logic aware. The orchestration layer is a collection of use-case-specific, or application-specific capabilities, provided either directly by Reltio, or by Reltio’s network of technology partners. The integration layer is composed of a “native” set of capabilities provided directly by the Reltio platform itself, including APIs. Reltio’s Approach Reltio provides a responsive data platform that ensures business agility to organizations by connecting data from all applications and systems, both on-premises and in the cloud with an API-led approach. Digital Transformation and delivering Connected Customer Experiences require an agile API-driven approach that helps bring data together, as well as helps the use of that data in various operational and analytical applications. As stated in the now-famous Jeff Bezos’ mandate to Amazon teams, “all teams will henceforth expose their data and functionality through service interfaces.” This was the foundation of Amazon’s digital transformation and AWS’s birth. Similarly, Reltio took the API-first approach to build our responsive data platform. www.reltio.com 3 A Modern Approach to Data Orchestration Leading with An API-first Approach Reltio has always been API-first platform and provided APIs for Configuration as well as Data. Most of the leading data and application platforms have moved to or are in the process of moving to this API-first approach where each critical functionality is exposed via an API. Leading application and platform providers design their systems by utilizing APIs they can make available across the organization to stitch together a complete experience, as well as offer to their partners and customers to extend the experience. Legacy data management and integration platforms that were built on decades old technology impede your transformation objectives. Reltio is helping Global 2000 innovators build digital platforms by providing core capabilities as reusable building blocks that connect with and complement each other. Aligned to the API economy, Reltio’s API-first approach laid the groundwork for building our responsive platform that Data Innovators across Global 2000 companies use for digital innovation and running dynamic businesses. Reltio’s approach allows organizations to recompose and change as their business needs change. A key benefit of the API approach is the ability to recompose for any use case, since the APIs are used by Reltio’s UI and also offered as a headless backend for easy integration into any application or custom UI. Reltio’s wide array of API sets are the building blocks to define how your enterprise data can be accessed and provisioned. Now you have complete control over how you can leverage data to operationalize various omnichannel customer experiences. This responsive approach makes it possible for businesses to create new revenue models and monetize new business opportunities with high agility. www.reltio.com 4 A Modern Approach to Data Orchestration Real-time APIs and Event Streaming REST APIs are available for high-speed loading and are used with outbound-message queues to distribute and make data accessible to downstream systems. With these capabilities, you can efficiently enhance existing applications and create new data-driven offerings. Reltio provides powerful out of the box capabilities for integration with other systems, in various classic modalities: • Batch. Use the REST API for bulk loading, extracting volumes of data and scheduled data enrichment. • Real-time. Post, Get, Put, Delete and Search calls in real-time using the Reltio REST API. • Cloud Messaging Queue. Receive event messages from Reltio via cloud messaging queues (AWS SQS,GCP Pub/Sub, Azure Service Bus). Direct access via REST API Reltio offers access to all customer tenant data, metadata configuration, and security through REST APIs. REST APIs are based on best practices of the Open Data Protocol [http://www.odata.org]. The Open Data Protocol enables the creation of HTTP-based data services, which allow resources identified using URIs and defined in an abstract data model to be published and edited by Web clients using simple HTTP messages. Reltio’s API philosophy is based on FAIR standards and principals. The APIs are designed with an emphasis on machine-actionability as humans are increasingly relying on computational support to deal with data because of the increase in volume, complexity, variety, and velocity. Reltio’s API set adheres to the principles of Findability, Accessibility, Interoperability, and Reusability. The self-describing Reltio API is based on the following: • Resource: every piece of information in the Reltio system is a resource (even a value of an attribute is a resource) • Resource URI: every resource in a system has URI and can be reached/queried using these URIs (with security limits) • Simple operations: There are four types of operations supported for resources - get, add, update, and delete with a low latency API supporting real-time operations with 99.95% uptime SLA. REST APIs use JSON