Carnegie Mellon University
Modern file systems provide scalable performance for large file data management. However, in case of metadata management the usual approach is to have single or few points of Meta-Data Service (MDS). In the current world, file systems are challenged by unique needs such as managing exponentially growing files, using file-system as a key-value store, check-pointing that are highly metadata intensive and are usually bottlenecked by the centralized MDS schemes. To overcome this metadata bottle-neck, the authors evaluate a scalable MDS layer for the existing cluster file systems using Giga+ -a high performance distributed index without synchronization and serialization and TableFS -a file system with an embedded No-SQL database using modern key-value pair levelDB.