Sciweavers

MIDDLEWARE
2007
Springer

New Worker-Centric Scheduling Strategies for Data-Intensive Grid Applications

13 years 9 months ago
New Worker-Centric Scheduling Strategies for Data-Intensive Grid Applications
Distributed computations, dealing with large amounts of data, are scheduled in Grid clusters today using either a task-centric mechanism, or a worker-centric mechanism. Because of the large data sets, the execution time is bounded by the cost of data transfer. In this paper, we introduce new worker-centric scheduling strategies that are novel in that they aim to implicitly exploit the locality of interest in order to reduce the cost of data transfer. Many Grid applications are characterized by such a locality of interest, i.e., a file is often accessed by multiple tasks and, more importantly, a set of files that are accessed by one task are also likely to be accessed together by other tasks. Our new deterministic, as well as probabilistic, scheduling algorithms implicitly exploit this feature to improve running time. Our experiments are done with traces of a real Grid application (Coadd), and show that our algorithms are able to achieve utilization of over 90%, while reducing makespa...
Steven Y. Ko, Ramsés Morales, Indranil Gupt
Added 08 Jun 2010
Updated 08 Jun 2010
Type Conference
Year 2007
Where MIDDLEWARE
Authors Steven Y. Ko, Ramsés Morales, Indranil Gupta
Comments (0)