Big Data

A Critical Performance Study of Memory Mapping on MultiCore Processors: An Experiment with K-Means Algorithm with Large Data Mining Data Sets

Download Now Date Added: Nov 2010
Format: PDF

Increased availability of Multi-Core processors is forcing one to re-design algorithms and applications so as to exploit the available computational power from multiple cores. It is not uncommon to employ memory mapping of files in applications involving huge I/O bandwidth to improve the response/service times. This paper mainly focuses on performance of memory mapped files on Multi-Core processors. Experiments are carried out with k-means algorithm, a popular Data Mining (DM) clustering algorithm, to explore the potential of Multi-Core hardware under OpenMP API and POSIX threads. Observations are made both with static and dynamic threads of OpenMP. Experiments are also conducted with both simulated and real data sets.