Purlieus: Locality-Aware Resource Allocation for MapReduce in a Cloud

The authors present Purlieus, a MapReduce resource allocation system aimed at enhancing the performance of MapReduce jobs in the cloud. Purlieus provisions virtual MapReduce clusters in a locality-aware manner enabling MapReduce Virtual Machines (VMs) access to input data and importantly, intermediate data from local or close-by physical machines. They demonstrate how this locality-awareness during both map and reduce phases of the job not only improves runtime performance of individual jobs but also has an additional advantage of reducing network traffic generated in the cloud data center. This is accomplished using a novel coupling of, otherwise independent, data and VM placement steps. They conduct a detailed evaluation of Purlieus and demonstrate significant savings in network traffic and almost 50% reduction in job execution times for a variety of workloads.

Provided by: IBM Topic: Virtualization Date Added: Sep 2011 Format: PDF

Find By Topic