There is tradeoff between parallelism and communication |
Programmer defines the data mapping |
Underlaying assumptions are that: |
An operation on two or more data object is likely to be carried out much faster if they all reside in the same processor, |
and that it may be possible to carry out many such operations concurrently if they can be performed on different processors |