Sciweavers

Share
HPDC
1999
IEEE

A Network-Aware Distributed Storage Cache for Data Intensive Environments

9 years 1 months ago
A Network-Aware Distributed Storage Cache for Data Intensive Environments
Modern scientific computing involves organizing, moving, visualizing, and analyzing massive amounts of data at multiple sites around the world. The technologies, the middleware services, and the architectures that are used to build useful high-speed, wide area distributed systems, constitute the field of data intensive computing. In this paper we will describe an architecture for data intensive applications where we use a high-speed distributed data cache as a common element for all of the sources and sinks of data. This cache-based approach provides standard interfaces to a large, application-oriented, distributed, on-line, transient storage system. We describe our implementation of this cache, how we have made it "network aware," and how we do dynamic load balancing based on the current network conditions. We also show large increases in application throughput by access to knowledge of the network conditions.
Brian Tierney, Jason Lee, Brian Crowley, Mason Hol
Added 03 Aug 2010
Updated 03 Aug 2010
Type Conference
Year 1999
Where HPDC
Authors Brian Tierney, Jason Lee, Brian Crowley, Mason Holding, Jeremy Hylton, Fred L. Drake
Comments (0)
books