Easing the Burdens of HPC File Management

Date Added: Nov 2011
Format: PDF

While the amount of data the authors can process and store grows, their ability to find data remains dependent upon their own memories more often than not. Manual metadata management is common among scientific users, consuming their time while not making use of the computing resources at hand. Their system design proposes to empower users with more powerful data finding tools, such as unified search spaces, provenance, and ranked file system search. By returning the responsibility of file management to the file system, they enable scientists to focus on their science without the need for a customized file organization scheme for their work.