RADBench: A Concurrency Bug Benchmark Suite
Testing and debugging tools for concurrent programs are often validated on known bugs. To aid the development of these tools, the authors present the Race, Atomicity, and Deadlock Benchmark (RADBench) suite. The RADBench suite contains the full source of 10 real concurrency bugs found in large open-source software projects including Mozilla SpiderMonkey, Mozilla NSPR, Mem-cached, Apache Web Server, and Google Chromium Web Browser. They discuss the difficulties they have found in reproducing these bugs that must be accounted for when building testing and debugging tools. Finally, they propose an approach to reproducibility that has a number of benefits over standard deterministic replay for debugging. RADBench is open source and publicly available.