Rethinking Data Management for Big Data Scientific Workflows

Download Now
Provided by: University of Southampton
Topic: Cloud
Format: PDF
Scientific workflows consist of tasks that operate on input data to generate new data products that are used by subsequent tasks. Workflow management systems typically stage data to computational sites before invoking the necessary computations. In some cases data may be accessed using remote I/O. There are limitations with these approaches, however. First, the storage at a computational site may be limited and not able to accommodate the necessary input and intermediate data. Second, even if there is enough storage, it is sometimes managed by a file-system with limited scalability.
Download Now

Find By Topic