Matrix Multiplication makes extensive use of broadcast operations as its communication primitives |
We can use this application to discuss three approaches to broadcast
|
Which have different performance depending on message sizes and hardware architecture |