Date Added: Jun 2009
Benchmarking the performance of algorithms, devices, and programming methodologies is a well-worn topic among developers and research of high-performance computing appliances. Independent and partisan benchmark results are a difficult thing to navigate and understand. As shown in Figure 1, benchmarking has evolved from looking just at clock speed, to encompassing operations per second, and now including total cost of ownership and energy efficiency. Because each methodology is based on a set of assumptions, designers and developers are forced to critique each with a focus on the first two stages of scientific inquiry.