Synchronization
MPI_Barrier(comm)
- Blocks until all processes in communicator comm call it
Useful for producing meaningful timings
- If processors are not synched before the timing, benchmarks may show negative-time messages
Typically, synchronization comes from messages themselves