Our experiments were performed on a 16-node Intel iPSC/860 at Northeast Parallel Architecture Center at Syracuse University and on a 16-node Intel Paragon at the Portland Group, Inc. Most of the measurements reported were done by using our Fortran 90D/HPF compiler. Our compiler generates Fortran 77 plus message passing calls. The generated programs were compiled using the Parasoft Express Fortran compiler, which calls Portland Group if77 release 4.0 compiler with all optimizations turned on (-O4). The Fortran 90D/HPF runtime primitives use Parasoft's Express Message Passing system, version 3.0. Timings were taken using extime() an Express function having an accuracy of one microsecond.