Data Management

SQPR: Stream Query Planning With Reuse

Download Now Free registration required

Executive Summary

When users submit new queries to a Distributed Stream Processing System (DSPS), a query planner must allocate physical resources, such as CPU cores, memory and network bandwidth, from a set of hosts to queries. Allocation decisions must provide the correct mix of resources required by queries, while achieving an efficient overall allocation to scale in the number of admitted queries. By exploiting overlap between queries and reusing partial results, a query planner can conserve resources but has to carry out more complex planning decisions. In this paper, the authors describe SQPR, a query planner that targets DSPSs in data centre environments with heterogeneous resources.

  • Format: PDF
  • Size: 693.8 KB