BiN: A Buffer-in-NUCA Scheme for Accelerator-Rich CMPs

Provided by: Association for Computing Machinery
Topic: Storage
Format: PDF
As the number of on-chip accelerators grows rapidly to improve power-efficiency, the buffer size required by accelerators drastically increases. Existing solutions allow the accelerators to share a common pool of buffers or/and allocate buffers in cache. In this paper, the authors propose a Buffer-in-NUCA (BiN) scheme with the following contributions: a dynamic interval-based global buffer allocation method to assign shared buffer spaces to accelerators that can best utilize the additional buffer space, and a flexible and low-overhead paged buffer allocation method to limit the impact of buffer fragmentation in a shared buffer, especially when allocating buffers in a Non-Uniform Cache Architecture (NUCA) with distributed cache banks.

Find By Topic