Collective communication
-
More than point-to-point operations
|
Buffering
-
Major cost of communication is data copying
|
Nonblocking communication
-
Allows concurrency between computation and communication (if hardware permits)
|
Intercommunicators
|
Cartesian Grids
|