Sciweavers

Share
CCGRID
2003
IEEE

Evaluation of the inter-cluster data transfer on Grid environment

10 years 6 months ago
Evaluation of the inter-cluster data transfer on Grid environment
High-performance peer-to-peer transfer between clusters will be fundamental technology base for various Grid middleware, such as large-scale data transfer in DataGrid settings, or collective communication in Grid-wide MPIs. There, two major factors are involved: on one hand network pipes with large RT T × bandwidth typically become data-starved, resulting in bandwidth loss; on the other hand when multiple nodes on the clusters attempt simultaneous transfer, the network pipe could become saturated, resulting in packet loss which again may result in bandwidth degradation in large RT T × bandwidth networks. By dynamically and automatically adjusting transfer parameters between the two clusters, such as the number of network nodes, number of socket stripes, we could achieve optimal bandwidth even when the network is under heavy contention. In order to arrive at a proper performance model for automated adjustment, we have conducted several simulations by which we have discovered that suc...
Shoji Ogura, Satoshi Matsuoka, Hidemoto Nakada
Added 04 Jul 2010
Updated 04 Jul 2010
Type Conference
Year 2003
Where CCGRID
Authors Shoji Ogura, Satoshi Matsuoka, Hidemoto Nakada
Comments (0)
books