1 | In HPspmd model, all communications go through explicit calls to user-level libraries, initially: |
2 | Adlib: regular collective operations |
3 | MPI: low-level message passing |
4 | Later, add interfaces to other libraries, eg |
5 | Global Arrays: 1-sided access to remote data |
6 | CHAOS: irregular collective operations |
7 |