Topology agnostic hot-spot avoidance with InfiniBand

Provided by: John Wiley & Sons
Topic: Big Data
Format: PDF
InfiniBand has become a very popular interconnect due to its advanced features and open standard. Large-scale InfiniBand clusters are becoming very popular, as reflected by the top 500 supercomputer rankings. However, even with popular topologies such as constant bi-section bandwidth fat tree, hot-spots may occur with InfiniBand due to inappropriate configuration of network paths, presence of other jobs in the network and un-availability of adaptive routing. In this paper, the authors present a Hot-Spot Avoidance Layer (HSAL) for InfiniBand, which provides hot-spot avoidance using path bandwidth estimation and multi-pathing using LMC mechanism, without taking the network topology into account.

Find By Topic