Dynamic Proportional Share Scheduling in Hadoop

Download Now
Provided by: Springer Healthcare
Topic: Big Data
Format: PDF
The authors present the Dynamic Priority (DP) parallel task scheduler for Hadoop. It allows users to control their allocated capacity by adjusting their spending over time. This simple mechanism allows the scheduler to make more efficient decisions about which jobs and users to prioritize and gives users the tool to optimize and customize their allocations to fit the importance and requirements of their jobs. Additionally, it gives users the incentive to scale back their jobs when demand is high, since the cost of running on a slot is then also more expensive. They envision their scheduler to be used by deadline or budget optimizing agents on behalf of users.
Download Now

Find By Topic