Meet Me Halfway: Split Maintenance of Continuous Views
Meet Me Halfway: Split Maintenance of Continuous Views Christian Winter, Tobias Schmidt, Thomas Neumann, Alfons Kemper Technische Universitat¨ Munchen¨ {winterch, tobias.schmidt, neumann, kemper}@in.tum.de ABSTRACT result Query From Industry 4.0-driven factories to real-time trading al- Insert gorithms, businesses depend on analytics on high-velocity real-time data. Often these analytics are performed not in dedicated stream processing engines but on views within a general-purpose database to combine current with histori- Initialization cal data. However, traditional view maintenance algorithms tables event streams are not designed with both the volume and velocity of data streams in mind. Figure 1: Exemplary split of a continuous view In this paper, we propose a new type of view specialized query plan for maintenance. Parts that are eval- for queries involving high-velocity inputs, called continuous uated for each insert are marked with a grey ar- view. The key component of continuous views is a novel row. Parts with a white arrow are evaluated for maintenance strategy, splitting the work between inserts and each query to the view. The framed part is evalu- queries. By performing initial parts of the view's query for ated once at view creation time. each insert and the remainder at query time, we achieve both high input rates and low query latency. Further, we keep the memory overhead of our views small, independent of input such analyses have taken place in databases and data ware- velocity. To demonstrate the practicality of this strategy, we houses focusing on analytical query throughput. However, integrate continuous views into our Umbra database system.
[Show full text]