Sciweavers

HPDC
2003
IEEE

Optimizing GridFTP through Dynamic Right-Sizing

13 years 8 months ago
Optimizing GridFTP through Dynamic Right-Sizing
In this paper, we describe the integration of dynamic right-sizing — an automatic and scalable buffer management technique for enhancing TCP performance — into GridFTP, a subsystem of the Globus Toolkit for managing bulk data transfers across computational grids. Such grids are often characterized by networks with large bandwidth-delay products. Unfortunately, many of today’s grid applications use only a small fraction of available bandwidth because the default buffer sizes in TCP are tuned for yesterday’s WAN speeds. Buffer sizes can be manually tuned to allow TCP flow control to adapt to high-speed WAN environments, but this is a tedious process. Although recent work has shown how to automatically tune system buffers during connection set-up, these values may not be appropriate for the connection’s lifetime due to varying network delay and throughput. We show how using the technique of dynamic rightsizing (DRS) in GridFTP helps us optimize memory usage while maintaini...
Sunil Thulasidasan, Wu-chun Feng, Mark K. Gardner
Added 04 Jul 2010
Updated 04 Jul 2010
Type Conference
Year 2003
Where HPDC
Authors Sunil Thulasidasan, Wu-chun Feng, Mark K. Gardner
Comments (0)