Compiler and runtime support for out-of-core HPF programs

This paper describes the design of a compiler which can translate out-of-core programs written in a data parallel language like HPF. Such a compiler is required for compiling large scale scienti c applications, such as the Grand Challenge applications, which deal with enormous quantities of data. We propose a framework by which a compiler together with appropriate runtime support can translate an out-ofcore HPF program to a message passing node program with explicit parallel I/O. We describe the basic model of the compiler and the various transformations made by the compiler. We also discuss the runtime routines used by the compiler for I/O and communication. In order to minimize I/O, the runtime support system can reuse data already fetched into memory. The working of the compiler is illustrated using two out-of-core applications, namely a Laplace equation solver and LU Decomposition, together with performance results on the Intel Touchstone Delta.

• Type: Conference
• Year: 1994
• Where: ICS
• Authors: Rajeev Thakur, Rajesh Bordawekar, Alok N. Choudhary
• Keywords: Compiler, Distributed And Parallel Computing, Explicit Parallel I/o, ICS 1994, Runtime Support