CEC: Continuous Eventual Checkpointing for Data Stream Processing Operators

Download Now
Provided by: Foundation for Research and Technology - FORTH
Topic: Big Data
Format: PDF
The checkpoint roll-backward methodology is the underlying technology of several fault-tolerance solutions for continuous stream processing systems today, implemented either using the memories of replica nodes or a distributed file system. In this scheme the recovering node loads its most recent checkpoint and requests log replay to reach a consistent pre-failure state. Challenges with that technique include its complexity (typically implemented via copy-on-write), the associated overhead (exception handling under state updates), and limits to the frequency of check pointing.
Download Now

Find By Topic