Collective Communication
Provides standard interfaces to common global operations
- Communications: broadcast
- Computation: summation
A collective operation uses a process group
- All processes in group call same operation at (roughly) the same time
Message tags not needed (generated internally)