Data Management

Magellan: A Searchable Metadata Architecture for Large-Scale File Systems

Date Added: Nov 2009
Format: PDF

As file systems continue to grow, metadata search is becoming an increasingly important way to access and manage files. However, existing solutions that build a separate metadata database outside of the file system face consistency and management challenges at large-scales. To address these issues, the authors developed Magellan, a new large-scale file system metadata architecture that enables the file system's metadata to be efficiently and directly searched. This allows Magellan to avoid the consistency and management challenges of a separate database, while providing performance comparable to that of other large file systems.