Peer-to-Peer Data Sharing for Scientific Workflows on Amazon EC2

Download Now Date Added: Oct 2012
Format: PDF

In this paper, the authors consider the problem of data sharing in scientific workflows running on the cloud. They present the design and evaluation of a peer-to-peer approach to help solve this problem. They compare the performance of their peer-to-peer file manager with that of two network file systems for storing data for a typical data-intensive workflow application. Their results show that while their peer-to-peer file manager performs significantly better than one of the network file systems tested, it does not perform as well as the other. Finally, they discuss the various issues that might have affected the performance of their peer-to-peer file manager.