Predicting Sporadic Grid Data Transfers

14 years 3 days ago
Predicting Sporadic Grid Data Transfers
The increasingly common practice of replicating datasets and using resources as distributed data stores in Grid environments has led to the problem of determining which replica can be accessed most efficiently. Because of diverse performance characteristics and load variations of several components in the end-to-end path linking these various locations, selecting a replica from among many requires accurate prediction information of the data transfer times between the sources and sinks. In this paper we present a prediction system that is based on combining end-to-end application throughput observations and network load variations, capturing wholesystem performance and variations in load patterns, respectively. We develop a set of regression models to derive predictions that characterize the effect of network load variations on file transfer times. We apply these techniques to the GridFTP data movement tool, part of the Globus Toolkit™, and observe performance gains of up to 10% in p...
Sudharshan Vazhkudai, Jennifer M. Schopf
Added 14 Jul 2010
Updated 14 Jul 2010
Type Conference
Year 2002
Where HPDC
Authors Sudharshan Vazhkudai, Jennifer M. Schopf
Comments (0)