Foilset Search Full Index for Scripted foilset

HPCC Software Technologies Fall 96 -- Overview and HPF

Given by Geoffrey C. Fox at Delivered Lectures of CPS615 Basic Simulation Track for Computational Science on 26 September 96. Foils prepared 26 September 1996

We go through the 2D Laplace's Equation with both HPF and MPI for Simple Jacobi Iteration
HPF and Fortran90 are reviewed followed by MPI
We also discuss the structure of problems as these determine why and when certain software approaches are appropriate


This mixed presentation uses parts of the following base foilsets which can also be looked at on their own!
Master Set of Foils for 1996 Session of CPS615
CPS615 Foils -- set C: Laplace Example -- Programming Models and Performance
Overview of Fortran 90 and HPF Fall 96
Part A:Overview of Programming Paradigms and Relation to Applications
Part B:Overview of Programming Paradigms and Relation to Applications

Table of Contents for HPCC Software Technologies Fall 96 -- Overview and HPF

There are two types of foils -- html and image which are each available in basic and JavaScript enabled "focused" style
(basic:)(focus style:) Denote Foils where Image Critical
(basic:)(focus style:) Denote Foils where Image has important information
(basic:)(focus style:) Denote Foils where HTML is sufficient


CPS 615 Details of HPCC Software

We first Discuss the Laplace Example for HPF
1 CPS615 -- Base Course for the Simulation Track of Computational Science
Fall Semester 1996 --
HPCC Software Technologies
HPF and MPI
2 Abstract of CPS615 HPCC Software Technologies
3 Parallel Computing
Algorithms and
Software --
Laplace Example
4 The Solution of Laplace's Equation
5 Discretized Form of Laplace'e Equation on a Parallel Processor
6 Basic Structure of Domain to be Updated in Parallel Version
7 Sequential and Introduction to Parallel Coding for the
Laplace Example
8 SEQUENTIAL LAPLACE PROGRAMMING
JACOBI ITERATION IN ONE DIMENSION
(constant in y direction)
9 SEQUENTIAL LAPLACE PROGRAMMING
JACOBI ITERATION IN TWO DIMENSIONS
10 Approaches to Parallel Programming
11 SPMD or SCMD
Single Program (code) Multiple Data
12 Data Parallel
Programming for
Laplace Example
13 Parallel Laplace Programming
Data Parallel for Jacobi Iteration in One Dimension
14 Notes on HPF Implementation of Lapace Solver

Overview of Fortran90
15 HPF is an extension of Fortran 90
16 Why is Fortran90 Easier than Fortran77
17 Important Features of Fortran90
18 Introduction to Fortran90 Arrays - I
19 Introduction to Fortran90 Arrays - II
20 Fortran90 Arrays and Memory Allocation
21 More on Fortran90 Arrays and Subroutines
22 Typical Use of Array and Intrinsic Operations
23 Derived Type in Fortran90
24 Examples of POINTER's in Fortran90
25 MODULEs in Fortran90
26 MODULEs INTERFACES and Overloaded Operators in Fortran90

Motivation and Introduction to HPF
27 Outline of HPF Discussion
28 Information on HPF and HPF Forum (HPFF)
29 Possible Programming Models
30 Data Parallel Programming Model

Discussion of Types of Problems!
31 Problem Architectures
32 5 Categories of Problems
33 Example of Basic Problem Architectures Regular Synchronous Problem Class
34 Example of Basic Problem Architectures Irregular Loosely Synchronous
35 Example of Basic Problem Architectures The difficult Asynchronous Class
36 Embarassingly Parallel Problem Class
37 Example of Basic Problem Architectures for MetaProblem Class
38 Software Bus Structure of USMADE

Problem Architectures
39 Computing as a Mapping Problem
40 Complex Systems to give a Theory of Computing
41 Parallel Computing is "just" an optimization problem, even if we can't agree on what to optimize
42 Complex System Representation of Levels in Computer Software
43 The map of Problem ---> Computer is performed in two or more statges
44 The Mapping of Space of Problem Architectures onto Space of Machine Architectures

What is HPF and its Capabilities
45 What determines when Parallelism is Clear ?
46 Evaluation of High Performance Fortran What applications need what features of HPF and its extensions ?
47 What Issues should High Performance Fortran (HPF) Address!
48 Goal of High Performance Fortran
49 Any Complete Programming Environment Must Handle
50 HIGH PERFORMANCE FORTRAN COMPILERS
51 What type of compiler is HPF ?
52 The High Performance Fortran Library
53 HPF Intrinsic Library
54 High Performance Fortran Library -- I
55 High Performance Fortran Library -- II
56 Imprecise Mapping of Problem Classes into Runtime and Language Terms
57 General Applicability of HPF, HPF++, HPC++
58 Importance of HPF, HPC++ to Users
59 What about other languages ?
60 What applications does HPF support? If not - what extensions are needed?
61 5 Categories of Problems
62 Comparison of 3 different Programming Models

Finally a Detailed Discussion of HPF
63 Parallelism in HPF
64 Fortran77 is part of Fortran90
65 HPF Features
66 What gives high performance in HPF
67 Compiler directives used in HPF
68 What does an HPF Compiler do?
69 Syntax of HPF Directives
70 Data Mapping in HPF
71 Staged Data Mapping in HPF
72 Template in HPF
73 Abstract Processors in HPF
74 Example of Template and Processors
75 Align Directive in HPF
76 Examples of Align Directive
77 Changing Rank in Align Directive
78 Replication in Align Directive
79 General Alignments in HPF
80 Formal Definition of Align Directive
81 More obscure Complicated Examples of Align Directive
82 Distribution Directive in HPF
83 Basic Examples of Distribute Directive
84 Two Dimensional Example of Distribute Directive
85 The Two Basic Distributions in HPF
86 The Example of Matrix Inversion
87 Example of Graphics Rendering
88 Example of Distribute Directive with Complex Alignment
89 Dynamic Data Mapping
90 Advanced Mapping Directives -- ReDistribution and ReAlign
91 Advanced Mapping Directives -- Allocatable arrays and pointers
92 Subprograms in HPF
93 Passing Distributed Arrays as Subprogram Arguments in HPF
94 Mapping Options for Dummy (Subroutine) Arguments
95 Inherit Distribution Directive in HPF
96 Summary of Mapping Directives in HPF
97 Fundamental Parallelism Assumption in HPF
98 Parallel statements and Constructs in HPF
99 Parallelism in Fortran 90 array assignments
100 WHERE (masked array assignment) in HPF
101 WHERE...ELSEWHERE / IF...ELSE constructs in HPF
102 Intrinsic functions in HPF
103 HPF library functions
104 SUM, SUM_PREFIX and SUM_SCATTER defined
105 HPF Intrinsic EXAMPLE: SUM
106 FORALL Statement in HPF
107 Examples of FORALL statements in HPF
108 Semantics of the FORALL statement in HPF
109 Vector Indices in FORALL's
110 Multiple Statement FORALL's
111 HPF FORALL construct Pictorially
112 PURE Functions in HPF
113 Example of PURE Function from Chuck Koelbel
114 The INDEPENDENT Assertion in HPF
115 !HPF$ INDEPENDENT FORALL Pictorially
116 !HPF$ INDEPENDENT DO Pictorially
117 !HPF$ INDEPENDENT, NEW Variable
118 Extrinsics in HPF
119 High Performance Fortran HPF2 Changes
120 ON HOME for Computation Placement
121 Reductions in INDEPENDENT DO Loops
122 Spawning Tasks in HPF
123 New Data Mapping Features in HPF 2.0 - I
124 New Data Mapping Features in HPF 2.0 - II

Full WebWisdom URL and this Foilset Search
This contains all WebWisdom links preceded by those referenced in this foilset

List of WebWisdom URL's Used in this Foilset


key cpshpf URL http://www.npac.syr.edu/EDUCATION/PUB/hpfe/ * HPF Education Overview at NPAC by gcf on April 1,1995
Times 1 Foils referenced Foil 50
key forumhpf URL http://www.erc.msstate.edu/hpff/home.html * HPF Forum Web Page by gcf on April 1,1995
Times 1 Foils referenced Foil 50
key hpfa URL http://www.npac.syr.edu/hpfa/index.html * High Performance Fortran Application Resource by gcf on April 1,1995
Times 1 Foils referenced Foil 46
key hpfappls URL http://www.npac.syr.edu/hpfa/algorithms.html * HPF Application Classes by gcf on April 1,1995
Times 1 Foils referenced Foil 60
key nsehpf URL http://www.netlib.org/hpf/index.html * HPF Entry at NHSE by gcf on April 1,1995
Times 1 Foils referenced Foil 50
key pcwbook URL http://www.npac.syr.edu/copywrite/pcw//index.html * Parallel Computing Works Book by gcf on April 1,1995
Times 2 Foils referenced Foil 56 Foil 61
key pcwchap14 URL http://www.npac.syr.edu/copywrite/pcw//node334.html * Chapter 14 of Parallel Computing Works (Asynchronous Problems) by gcf on April 1,1995
Times 1 Foils referenced Foil 35
key pcwchap18 URL http://www.npac.syr.edu/copywrite/pcw//node441.html * Chapter 18 of Parallel Computing Works (Metaproblems) by gcf on April 1,1995
Times 2 Foils referenced Foil 37 Foil 49
key pcwchap3 URL http://www.npac.syr.edu/copywrite/pcw//node21.html * Chapter 3 of Parallel Computing Works (Theory of Problem Architecture) by gcf on April 1,1995
Times 3 Foils referenced Foil 31 Foil 42 Foil 56
key pcwchap4 URL http://www.npac.syr.edu/copywrite/pcw//node30.html * Chapter 4 of Parallel Computing Works (Synchronous Applications) by gcf on April 1,1995
Times 1 Foils referenced Foil 33
key pcwchap9 URL http://www.npac.syr.edu/copywrite/pcw//node174.html * Chapter 9 of Parallel Computing Works (Loosely Synchronous Applications) by gcf on April 1,1995
Times 1 Foils referenced Foil 34
© Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu

If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.

Page produced by wwwfoil on Sun Feb 22 1998