A Common Substrate for Cluster Computing

Date Added: May 2009
Format: PDF

The success of MapReduce has sparked many e orts to design cluster computing frameworks. The authors argue that no single framework will be optimal for all applications, and that they should instead enable organizations to run multiple frameworks efficiently in the same cloud. Furthermore, to ease development of new frameworks, it is critical to identify common abstractions and modularize their architectures. To achieve these goals, they propose Nexus, a low-level substrate that provides isolation and efficient resource sharing across frameworks running on the same cluster, while giving each framework freedom to implement its own programming model and fully control the execution of its jobs.