Data Centers Investigate

Introducing Map-Reduce to High End Computing

Download now Free registration required

Executive Summary

In this paper, the authors present an scientific application that has been given a Hadoop MapReduce implementation. They also discuss other scientific fields of supercomputing that could benefit from a MapReduce implementation. They recognize in this work that Hadoop has potential benefit for more applications than simply datamining, but that it is not a panacea for all data intensive applications. They provide an example of how the halo finding application, when applied to large astrophysics datasets, benefits from the model of the Hadoop architecture.

  • Format: PDF
  • Size: 259.2 KB