VPFS: Bandwidth Virtualization of Parallel Storage Systems

Date Added: Sep 2011
Format: PDF

This paper presents vPFS, a new parallel file system performance management approach to support the allocation of shared storage bandwidth on a per-application basis. Existing parallel file systems are unable to differentiate I/O requests from different applications and meet per-application bandwidth requirements. This limitation presents an increasing hurdle for applications to achieve their desired Quality of Service (QoS) as High-Performance Computing (HPC) systems continue to scale up. This paper proposes vPFS, a new solution to address this challenge through a bandwidth virtualization layer for parallel file systems. vPFS employs user-level parallel file system proxies to interpose requests between native parallel file system clients and servers to schedule parallel I/Os from different applications according to configurable bandwidth management policies.