Data Centers

AHPIOS: An MPI-Based Ad-Hoc Parallel I/O System

Date Added: Apr 2011
Format: PDF

This paper presents the design and implementation of a portable Ad-Hoc Parallel I/O System (AHPIOS). AHPIOS virtualizes on-demand available distributed storage resources and allows the files to be striped over several storage devices. Additionally, the design unifies the configuration of the MPI-IO library and the AHPIOS data servers. By a strong integration of the application, MPI-IO library and file system, a significant performance improvement can be achieved. The experimental section shows that the full MPIIO integrated AHPIOS implementation of file access operations outperforms the existing MPI-IO implementation by as much as 495% for file writes and 522% for file reads.