PDIO: High-Performance Remote File I/O for Portals-Enabled Compute Nodes

Date Added: Jan 2010
Format: PDF

Portals Direct I/O ("PDIO") is a special purpose middleware infrastructure for writing data from compute processor memory on Portals-enabled compute nodes to remote agents anywhere on the WAN in real-time. The prototype implementation provided a means for aggregation of outgoing data through multiple load balanced routing daemons, end-to-end parallel data streams through externally connected "I/O Nodes", and a bandwidth feedback mechanism for stability and robustness. It was used by one research group, demonstrated live at several conferences, and shown to deliver bandwidths of up to 800 Mbit/sec.