Low Memory Cost Dynamic Scheduling of Large Coarse Grain Task Graphs

Schedulinglarge task graphsis an importantissue in parallel computingsince it allowsthe treatment of big size problems. In this paper we tackle the following problem: how to schedule a task graph, when it is too large to fit into memory? Our answer features the parameterized task graph (PTG), which is a symbolic representation of the task graph. We propose a dynamic scheduling algorithmwhich takes the PTG as an entry and allows to generate a generic program. The performances of the method are studied as well as its limitations. We show that our algorithmfinds good schedule for coarse grain task graphs, has a very low memory cost, and has a good computational complexity. When the average number of operations of each task is large enough, we prove that the scheduling overhead is negligiblewithrespect to the makespan. The feasibility of our approach is studied on several compute-intensivekernels found in numerical scientific applications.

• Type: Conference
• Year: 1998
• Where: IPPS
• Authors: Michel Cosnard, Emmanuel Jeannot, Laurence Rougeot
• Keywords: Distributed And Parallel Computing, IPPS 1998, Parameterized Task Graph, Schedulinglarge Task, Task Graphs