Collective Communication
Provides standard interfaces to common global operations
A collective operation involves a group of processes
- Specialized functions for defining process groups
- Same function is called by all processes in group
Use different communicators instead of message tags