A Distributed Data Management Middleware for Data-Driven Application Systems

A key challenge in supporting data-driven scientific applications is the storage and management of input and output data in a distributed environment. This paper describes a distributed storage middleware, based on a data and metadata management framework, to address this problem. In this middleware system, applications define the structure of their input and output data using XML schemas. The system provides support for registration, versioning, management of schemas, and management of storage, querying, and retrieval of instance data corresponding to the schemas in distributed databases. The paper carries out an experimental evaluation of the system on a set of PC clusters connected over wide- and local-area networks.