In HPspmd model, all communications go through explicit calls to user-level libraries, initially: |
Adlib: regular collective operations |
MPI: low-level message passing |
Later, add interfaces to other libraries, eg |
Global Arrays: 1-sided access to remote data |
CHAOS: irregular collective operations |