Optimization of Large Scale of Files Transfer in Meteorological Grid
In this paper, the authors focus on performance enhancement of large scale of small files transfer, which is critical to the performance of meteorological grid. GridFTP and compression techniques are used to optimize the efficiency. The transfer parameters are configured before transmission, such as extended block mode (Mode E), TCP buffer size. Compression is used to compress files into single file, in order to eliminate negotiating time before transmission. During the course of their research, they sacrifice the disk space for avoiding the vicious recurrence of compression-decompression-compression. In the end, the experiments show the advantages of their approach.