Generalizing the Process Identifier
Collective operations typically operate on all processes (subgroups in some systems)
- This is too restrictive (e.g., need minimum over a column or a sum across a row, of processes)
MPI supports process groups
- Initial “all” group
- Group management routines (build, delete)
- Collective operations on groups