The International Journal of Innovative Research in Computer and Communication Engineering
A fully distributed load balancing algorithm is presented to cope with the load imbalance problem. The authors' algorithm is compared against a centralized approach in a production system and a competing distributed solution presented in the literature. The simulation results indicate that their proposal is comparable with the existing centralized approach and considerably outperforms the prior distributed algorithm in terms of load imbalance factor, movement cost, and algorithmic overhead. The performance of their proposal implemented in the Hadoop distributed file system is further investigated in a cluster environment.