One can often perform computing during a collective communication |
MPI_REDUCE performs reduction operation of type chosen from
|
MPI_ALLREDUCE is same as MPI_REDUCE but it stores result in all -- not just one -- processors |
MPI_SCAN performs reductions with result for processor r depending on data in processors 0 to r |