Weaver: Integrating Distributed Computing Abstractions Into Scientific Workflows Using Python

Date Added: Apr 2010
Format: PDF

Weaver is a high-level framework that enables researchers to integrate distributed computing abstractions into their scientific workflows. Rather than develop a new workflow language, the authors built Weaver on top of the Python programming language. As such, Weaver takes advantage of users' familiarity with Python, minimizes barriers to adoption, and al-lows for integration with existing software. In this paper, they introduce Weaver's programming model, which consists of datasets, functions, and abstractions that users combine to organize and specify large-scale scientific workflows.