STEAMEngine: Driving MapReduce Provisioning in the Cloud

MapReduce has gained in popularity as a distributed data analysis paradigm, particularly in the cloud, where MapReduce jobs are run on virtual clusters. The provisioning of MapReduce jobs in the cloud is an important problem for optimizing several user as well as provider-side metrics, such as runtime, cost, throughput, energy, and load. This paper presents a provisioning framework called STEAMEngine that consists of provisioning algorithms to optimize these metrics through a set of common building blocks.