Sciweavers

Share
ESCIENCE
2005
IEEE

Flexible IO Services in the Kepler Grid Workflow System

12 years 7 months ago
Flexible IO Services in the Kepler Grid Workflow System
Existing Grid workflow tools assume that individual components either communicate by passing files from one application to another, or are explicitly linked using interprocess communication pipes. When files are used it is usually difficult to overlap reader and write execution. On the other hand, interprocess communication primitives are invasive and require substantial modification to existing code. We have built a library, called GriddLeS, that combines the advantages of both approaches without any changes to the application code. GriddLeS overloads conventional file IO operations, and supports either local, remote or replicated file access, or direct communication over pipes. In this paper we discuss how GriddLeS can be combined with workflow packages and show how flexible and powerful virtual applications can be constructed rapidly. A large atmospheric science case study is discussed.
David Abramson, Jagan Kommineni, Ilkay Altintas
Added 24 Jun 2010
Updated 24 Jun 2010
Type Conference
Year 2005
Where ESCIENCE
Authors David Abramson, Jagan Kommineni, Ilkay Altintas
Comments (0)
books