Data Centers

Designing Topology-Aware Collective Communication Algorithms for Large Scale InfiniBand Clusters: Case Studies With Scatter and Gather

Download Now Date Added: Mar 2010
Format: PDF

Modern high performance computing systems are being increasingly deployed in a hierarchical fashion with multi-core computing platforms forming the base of the hierarchy. These systems are usually comprised of multiple racks, with each rack consisting of a finite number of chassis, and each chassis having multiple compute nodes or blades, based on multi-core architectures. The networks are also hierarchical with multiple levels of switches. Message exchange operations between processes that belong to different racks involve multiple hops across different switches and this directly affects the performance of collective operations.