IaaS Cloud Benchmarking: Approaches, Challenges, and Experience
Infrastructure-as-a-Service (IaaS) cloud computing is an emerging commercial infrastructure paradigm under which clients (users) can lease resources when and for how long needed, under a cost model that reflects the actual usage of resources by the client. For IaaS clouds to become mainstream technology and for current cost models to become more client-friendly, benchmarking and comparing the non-functional system properties of various IaaS clouds is important, especially for the cloud users. In this paper, the authors focus on the IaaS cloud-specific elements of benchmarking, from a user's perspective. They propose a generic approach for IaaS cloud benchmarking, discuss numerous challenges in developing this approach, and summarize their experience towards benchmarking IaaS clouds.