Supporting Scalable and Adaptive Metadata Management in Ultralarge-Scale File Systems

Provided by: Institute of Electrical & Electronic Engineers
Topic: Data Centers
Format: PDF
In this paper, the authors present a scalable and adaptive decentralized metadata lookup scheme for ultralarge-scale file systems (more than Petabytes or even Exabytes). Their scheme logically organizes Meta-Data Servers (MDSs) into a multilayered query hierarchy and exploits grouped Bloom filters to efficiently route metadata requests to desired MDSs through the hierarchy. This metadata lookup scheme can be executed at the network or memory speed, without being bounded by the performance of slow disks. An effective workload balance method is also developed in this paper for server reconfigurations.

Find By Topic