Designing Benchmarks for P2P Systems

In this paper, the authors discuss requirements for Peer-To-Peer (P2P) benchmarking, and they present two exemplary approaches to benchmarks for Distributed HashTables (DHT) and P2P gaming overlays. They point out the characteristics of benchmarks for P2P systems, focusing on the challenges compared to conventional benchmarks. The two benchmarks for very different types of P2P systems are designed applying a common methodology. This includes the definition of the System Under Test (SUT) and particularly its interfaces, the workloads and metrics.