Giga+TableFS on PanFS: Scaling Metadata Performance on Cluster File Systems

Download Now
Provided by: Carnegie Mellon University
Topic: Big Data
Format: PDF
Modern file systems provide scalable performance for large file data management. However, in case of metadata management the usual approach is to have single or few points of Meta-Data Service (MDS). In the current world, file systems are challenged by unique needs such as managing exponentially growing files, using file-system as a key-value store, check-pointing that are highly metadata intensive and are usually bottlenecked by the centralized MDS schemes. To overcome this metadata bottle-neck, the authors evaluate a scalable MDS layer for the existing cluster file systems using Giga+ -a high performance distributed index without synchronization and serialization and TableFS -a file system with an embedded No-SQL database using modern key-value pair levelDB.
Download Now

Find By Topic