Sciweavers

Share
IWNAS
2008
IEEE

Storage Aware Resource Allocation for Grid Data Streaming Pipelines

8 years 10 months ago
Storage Aware Resource Allocation for Grid Data Streaming Pipelines
Data streaming applications, usually composed with sequential/parallel tasks in a data pipeline form, bring new challenges to task scheduling and resource allocation in grid environments. Due to high volumes of data and relatively limit storage capability, resource allocation and data streaming have to be storage aware. In this paper, Genetic Algorithm (GA) is adopted for task scheduling of pipelines, based on online measurement and prediction with Gray Model (GM). On-demand data streaming is introduced to avoid data overflow using repertory strategies. Experimental results show that balance among task executions with on-demand data streaming is required to improve overall performance, avoid system bottlenecks and backlogs of intermediate data, and increase data throughput of pipelines as a whole.
Wen Zhang, Junwei Cao, Yisheng Zhong, Lianchen Liu
Added 31 May 2010
Updated 31 May 2010
Type Conference
Year 2008
Where IWNAS
Authors Wen Zhang, Junwei Cao, Yisheng Zhong, Lianchen Liu, Cheng Wu
Comments (0)
books