ADUS: Adaptive Resource Allocation in Cluster Systems Under Heavy-Tailed and Bursty Workloads
Source: Northeastern University
A large-scaled cluster system has been employed in various areas by offering pools of fundamental resources. How to effectively allocate the shared resources in a cluster system is a critical but challenging issue, which has been extensively studied in the past few years. Despite the fact that classic load balancing policies, such as Random, Join Shortest Queue and size-based polices, are widely implemented in actual systems due to their simplicity and efficiency, the performance benefits of these policies diminish when workloads are highly variable and heavily dependent. In this paper, the authors propose a new load balancing policy named ADUS, which attempts to partition jobs according to their sizes and to further rank the servers based on their loads.