Scheduling in MapReduce-Like Systems for Fast Completion Time

Large-scale data processing needs of enterprises today are primarily met with distributed and parallel computing in data centers. MapReduce has emerged as an important programming model for these environments. Since today's data centers run many MapReduce jobs in parallel, it is important to find a good scheduling algorithm that can optimize the completion times of these jobs. While several recent papers focused on optimizing the scheduler, there exists very little theoretical understanding of the scheduling problem in the context of MapReduce.

Provided by: Purdue University Topic: Data Centers Date Added: Jan 2011 Format: PDF

Find By Topic