A Data Throughput Prediction and Optimization Service for Widely Distributed Many-Task Computing

Free registration required

Executive Summary

In this paper, the authors present the design and implementation of a network throughput prediction and optimization service for many-task computing in widely distributed environments. This service uses multiple parallel TCP streams to improve the end-to-end throughput of data transfers. A novel mathematical model is used to decide the number of parallel streams to achieve best performance. This model can predict the optimal number of parallel streams with as few as three prediction points.

  • Format: PDF
  • Size: 429.9 KB