All Lecture Foils of CPS-615 Fall 1996

Table of Contents

Introductory Materials on HPCC

• Basic Structure of Domain to be Updated in Parallel Version.
• General Features of Laplace Example.
• Superconducting Technology -- Problems.

Computer Architectures, Performance and Basic Overview of HPF

• MIMD Distributed Memory Architecture.
• Latency/Bandwidth Space for 0-byte message(Latency) and 1 MB message(bandwidth).
• Overview of Communication Networks with Switches vs. Buses Topologies.
• HPCC Software Technologies Fall 96 -- Overview and HPF.

Programming Paradigms, Models and Performance

• Discretized Form of Laplace'e Equation on a Parallel Processor.
• Programming Models and Performance for Laplace's Equation.
• HPCC Software Technologies Fall 96 -- Overview and HPF.

Programming Paradigms, Models and HPF (continued)

• An overview of Fortran 90 and HPF.
• Data Parallel Programming Model.
• Overview of Programming Paradigms and Relation to Applications.
• The Mapping of Heterogeneous Metaproblems onto Heterogeneous Metacomputer Systems.
• The map of Problem<-->Computer is performed in two or more stages to `What determines when Parallelism is Clear?'.
• Parallelism in HPF to Examples of Align Directive.
• HPF discussion.
• WHERE (masked array assignment) in HPF.
• HPF discussion (from Tom Haupt).

Computational Methods, Models, Problems and More on HPF

• Ordinary Differential Equations (ODE) and the N-body problem.
• Simple Data Parallel Version of N-Body Force Computation.
• ODE's and particle dynamics.
• N-body Problem is a one dimensional Algorithm.
• Numerical Integration.
• Use of High Order Newton Cotes.
• basic statistics and random numbers.
• The Gaussian Distribution.
• Paul Coddington's recent article Random Number Generation.
• Statistics and Random Numbers (In preparation for Monte Carlo).
• Stock Market Example of Multiple Monte Carlo.
• HPF$ INDEPENDENT, NEW Variable.

Message Passing Interface (MPI) and Some Applications

• Message Passing Interface MPI for users.
• Blocking Receive MPI_Recv(C) MPI_RECV(Fortran).
• Old Reference to MPI.
• Peter Pacheco's MPI tutorial.
• Message Passing Interface MPI for users.

Advanced Computational Methods and Solvers

• Module on Iterative PDE Solvers.
• Matrix Notation for Iterative Methods.
• Background in Partial Differential Equations with attention to CFD.
• Linear Algebra Presentation.
• A good Introduction to Linear Algebra and other methods at HPSC group of the University of Colorado.
• Brief Review of Jacobi, SOR, and Conjugate Gradients Methods.
• Finite Element and Conjugate Gradient Presentation.
• Integral Formulation of Finite Element Method.
• Triangular Elements in Two Dimensions.
• An Introduction to Conjugate Gradient Method Without the Agonizing Pain at CMU (look in section called reports in this URL).
• Some Practical Optimization Methods.
• Parallel Full Matrix Algorithms.
• Cannon's Algorithm for Matrix Multiplication.