Full HTML for

Scripted foilset MPI HPF and DAGH for Parallelization of Black Hole Codes

Given by Scott Klasky, Tom Haupt, Geoffrey C. Fox at SIAM Workshop Minneapolis "Is Message Passing Obsolete" on 16 March 97. Foils prepared 18 March 97
Outside Index Summary of Material


We describe basic physics and computational features of Binary Black Collision Grand Challenge
We show a simple finite difference is complicated by
  • Adaptive Mesh refinement
  • Complex inner and outer boundary conditions
  • Need for several algorithms for hyberbolic and elliptic parts of problem
MPI or more generally message passing is not obsolete but rather the only complete solution!
Higher level systems DAGH and especially HPF cannot express full complexity of problem and MPI must fill in the missing parts
HPF2 might be able to express full problem but HPF1 misses many key capabilities
DAGH is more succesful than HPF1 but needs MPI for parts of problem
Postscript or FramemakerVersion
HPF Code for Linear Waves
Grand Challenge Alliance Home Page
NPAC Activity in Grand Challenge Alliance

Table of Contents for full HTML of MPI HPF and DAGH for Parallelization of Black Hole Codes

Denote Foils where Image Critical
Denote Foils where HTML is sufficient
Denote Foils where Image is not available

1 HPF & DAGH usage in the Binary Black Hole Grand Challenge
2 Goals of the Alliance
3 Black Hole Grand Challenge Alliance
4 Black Hole Initial Condition from Scott Klasky
5 Computational Infrastructure
6 ADM Equations
7 ADM Equations continued
8 Causal Differencing
9 Causal Differencing continued
10 Apparent Horizon boundary conditions
11 Difficulties of the BBH Problem
12 DAGH System
13 Sample HPF and
DAGH codes

14 Sample of HPF and DAGH code
15 Parallel Execution in DAGH
16 Parallel Execution in DAGH continued
17 Implementation
18 Linear Waves
19 Linear wave problem with outer boundary condition
20 Elliptic Problem for the shift
21 Black holes (Inner boundary condition)
22 Black holes continued
23 Moving Inner boundary continued
24 Moving Inner boundary
25 Finding the Apparent Horizon
26 Some Conclusions on Programming Models

Outside Index Summary of Material



HTML version of Scripted Foils prepared 18 March 97

Foil 1 HPF & DAGH usage in the Binary Black Hole Grand Challenge

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 2 Goals of the Alliance

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 3 Black Hole Grand Challenge Alliance

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index
See Original Foil

HTML version of Scripted Foils prepared 18 March 97

Foil 4 Black Hole Initial Condition from Scott Klasky

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index
From http://godel.ph.utexas.edu/Ftp/images/black_hole_collision_id.gif
The gold and voilet curves are isosurfaces of the metric component gxx for field =2(gold) and 1.5 (violet). The green surface is the zero isosurface of Kxx, the extrinsic curvature, so it's like looking at the position of space which will be frozen at the initial time, since the extrinsic curvature is like the velocity. The gold balls are at the throat of the holes. These are the solution of the elliptic initial value problem.

HTML version of Scripted Foils prepared 18 March 97

Foil 5 Computational Infrastructure

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 6 ADM Equations

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 7 ADM Equations continued

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 8 Causal Differencing

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 9 Causal Differencing continued

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 10 Apparent Horizon boundary conditions

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 11 Difficulties of the BBH Problem

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 12 DAGH System

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 13 Sample HPF and
DAGH codes

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index
These are for different parts of UNIGRID codes
HPF diff subroutine calculates differentials
DAGH is sample solver
  • GridHierarchy to end_forall are all DAGH commands setting up the Grid hierarchy and involking solver
  • MaxLev=1 in UNIGRID case
  • f_inverse is C++ function that calls Fortran t2_inverse
  • inverse is original Fortran77 solver invoked by DAGH with grids set up with suitable Ghost regions so one can use original sequential Fortran code

HTML version of Scripted Foils prepared 18 March 97

Foil 14 Sample of HPF and DAGH code

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 15 Parallel Execution in DAGH

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 16 Parallel Execution in DAGH continued

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 17 Implementation

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 18 Linear Waves

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 19 Linear wave problem with outer boundary condition

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 20 Elliptic Problem for the shift

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 21 Black holes (Inner boundary condition)

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 22 Black holes continued

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 23 Moving Inner boundary continued

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 24 Moving Inner boundary

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 25 Finding the Apparent Horizon

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index

HTML version of Scripted Foils prepared 18 March 97

Foil 26 Some Conclusions on Programming Models

From MPI HPF and DAGH for Parallelization of Black Hole Codes SIAM Workshop Minneapolis "Is Message Passing Obsolete" -- 16 March 97. *
Full HTML Index
This application does NOT suggest Message Passing is Obsolete!
  • Rather message passing is only "complete" solution and the alternative higher level approaches only express parts of the problem
This application suggests a tool-kit approach where you can link together many environments and not be tied to a single system
  • Possible an Interpreted front end and/or use of systems like WebFlow
This stresses need for interoperable subsystems rather than ambitious complete solutions that can't be completed

© Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu

If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.

Page produced by wwwfoil on Sun Aug 10 1997