Increasing Efficiency of Data-Flow Based Middleware Systems by Adapting Data Generation

Provided by: Alpen-Adria-Universitaet Klagenfurt
Topic: Big Data
Format: PDF
Many data-flow oriented applications are based on the pipe-and-filter concept. This paper presents an improvement of the state of the art for multi-threaded pipe-and-filter processing architectures. The authors present a novel approach for adapting the time of data generation in the pipeline where adjacent pipeline stages exchange information about the current utilization. They compare their approach to a traditional input data driven pipeline and achieve a significant reduction of the processing delay and required memory consumption.

Find By Topic