Designing Efficient FTP Mechanisms for High Performance Data-Transfer Over InfiniBand
Source: Ohio State University
The rapid growth of InfiniBand, 10 Gigabit Ethernet/ iWARP and IB WAN extensions is increasingly gaining momentum for designing high end computing clusters and data-centers. For typical applications such as data staging, content replication and remote site backup etc., FTP has been the most popular method to transfer bulk data within and across these clusters or data-centers. Although the existing sockets based FTP approaches can be transparently used in these systems through the protocols like IPoIB or SDP, their performance and scalability are limited due to the additional interaction overhead and unoptimized protocol processing.