Active Flash: Out-of-Core Data Analytics on Flash Storage
Source: Northeastern University
Next generation science will increasingly come to rely on the ability to perform efficient, on-the-fly analytics of data generated by High-Performance Computing (HPC) simulations, modeling complex physical phenomena. Scientific computing workflows are stymied by the traditional chaining of simulation and data analysis, creating multiple rounds of redundant reads and writes to the storage system, which grows in cost with the ever-increasing gap between compute and storage speeds in HPC clusters. Recent HPC acquisitions have introduced compute node-local flash storage as a means to alleviate this I/O bottleneck.