NPAC Technical Report SCCS-597
Compiler and Runtime Support for Out-of-Core HPF Programs
Rajeev Thakur, Rajesh Bordawekar, Alok Choudhary
Submitted January 1 1994
Abstract
This paper describes the design of a compiler which can translate
out-of-core programs written in a data parallel language like HPF.
Such a compiler is required for compiling large scale scientific
applications, such as the Grand Challenge applications, which deal
with enormous quantities of data. We propose a framework by which a
compiler together with appropriate runtime support can translate an
out-of-core HPF program to a message passing node program with
explicit parallel I/O. We describe the basic model of the compiler and
the various transformations made by the compiler. We also discuss the
runtime routines used by the compiler for I/O and communication. In
order to minimize I/O, the runtime support system can reuse data
already fetched into memory. The working of the compiler is
illustrated using two out-of-core applications, namely a Laplace
equation solver and LU Decomposition, together with performance
results on the Intel Touchstone Delta.