Optimizing Completion Time and Resource Provisioning of Pig Programs

Provided by: University of Peloponnese
Topic: Cloud
Format: PDF
As cloud computing continues to mature, IT managers have started concentrating on the support of additional performance requirements: quality of service and tailored resource allocation for achieving service performance goals. In this paper, the authors consider the popular Pig framework that provides a high-level SQL-like abstraction on top of MapReduce engine for processing large data sets. Programs written in such frameworks are compiled into Directed Acyclic Graphs (DAGs) of MapReduce jobs. Often, data processing applications have to produce results by a certain time deadline.

Find By Topic