Data Centers

A New End-to-End Flow-Control Mechanism for High Performance Computing Clusters

Free registration required

Executive Summary

High Performance Computing usually leverages messaging libraries such as MPI or GASNet in order to exchange data among processes in large-scale clusters. In this paper the authors present a new flow control mechanism that is able to adapt the buffering resources used by a process according to the parallel application communication pattern and the varying activity among communicating peers. The tests carried out in a 64-node 1024-core EXTOLL cluster show that the authors new dynamic flow-control mechanism provides extraordinarily high buffer efficiency along with very low overhead, which is reduced between 8 and 10 times.

  • Format: PDF
  • Size: 1331.2 KB