Improving MapReduce Performance in a Heterogeneous Cloud: A Measurement Study

Provided by: Georgia Institute of Technology
Topic: Cloud
Format: PDF
Hybrid clouds, geo-distributed cloud and continuous upgrades of computing, storage and networking resources in the cloud have driven datacenters evolving towards heterogeneous clusters. Unfortunately, most of MapReduce implementations are designed for homogeneous computing environments and perform poorly in heterogeneous clusters. Although a fair of research efforts have dedicated to improve MapReduce performance, there still lacks of in-depth understanding of the key factors that affect the performance of MapReduce jobs in heterogeneous clusters. In this paper, the authors present an extensive experimental study on two categories of factors: system configuration and task scheduling.

Find By Topic