Replication at the Speed of Change – a Fast, Scalable Replication Solution for Near Real-Time HTAP Processing Dennis Butterstein Daniel Martin Jia Zhong Lingyun Wang Knut Stolze Felix Beier IBM Silicon Valley Lab IBM Research & Development GmbH 555 Bailey Ave Schonaicher¨ Strasse 220 San Jose, CA 95141, United States 71032 Boblingen,¨ Germany
[email protected] [email protected] [email protected] fdanmartin,stolze,
[email protected] ABSTRACT engine was first replaced with Netezza (IBM PureData Sys- 2 The IBM Db2 Analytics Accelerator (IDAA) is a state- tem for Analytics ). Netezza's design is to always use table of-the art hybrid database system that seamlessly extends scans on all of its disks in parallel, leveraging FPGAs to ap- the strong transactional capabilities of Db2 for z/OS with ply decompression, projection and filtering operations before the very fast column-store processing in Db2 Warehouse. the data hits the main processors of the cluster nodes. The The Accelerator maintains a copy of the data from Db2 for row-major organized tables were hash-distributed across all z/OS in its backend database. Data can be synchronized nodes (and disks) based on selected columns (to facilitate at a single point in time with a granularity of a table, one co-located joins) or in a random fashion. The engine itself or more of its partitions, or incrementally as rows changed is optimized for table scans; besides Zone Maps there are no using replication technology. other structures (e. g., indices) that optimize the processing IBM Change Data Capture (CDC) has been employed as of predicates.