Joint Latency and Cost Optimization for Erasure-coded Data Center Storage

Provided by: George Washington University
Topic: Cloud
Format: PDF
Modern distributed storage systems offer large capacity to satisfy the exponentially increasing need of storage space. They often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. This paper provides an insightful upper bound on the average service delay of such erasure-coded storage with arbitrary service time distribution and consisting of multiple files. Not only does the result supersede known delay bounds that only work for a single file, it also enables a novel problem of joint latency and storage cost minimization over three dimensions: selecting the erasure code, placement of encoded chunks, and optimizing scheduling policy.

Find By Topic