MalStone: Towards a Benchmark for Analytics on Large Data Clouds

Date Added: Jul 2010
Format: PDF

Developing data mining algorithms that are suitable for cloud computing platforms is currently an active area of research, as is developing cloud computing platforms appropriate for data mining. Currently, the most common benchmark for cloud computing is the Terasort (and related) benchmarks. Although the Terasort Benchmark is quite useful, it was not designed for data mining per se. In this paper, the authors introduce a benchmark called MalStone that is specifically designed to measure the performance of cloud computing middleware that supports the type of data intensive computing common when building data mining models. They also introduce MalGen, which is a utility for generating data on clouds that can be used with MalStone.