StreamCloud: A Large Scale Data Streaming System

Data streaming has become an important paradigm for the real-time processing of continuous data flows in domains such as finance, telecommunications, and networking. Some applications in these domains require to process massive data flows that current technology is unable to manage, that is, streams that, even for a single query operator, require the capacity of potentially many machines. Research efforts on data streaming have mainly focused on scaling in the number of queries or query operators, but overlooked the scalability issue with respect to the stream volume. In this paper, the authors present StreamCloud a large scale data streaming system for processing large data stream volumes.