A Major Concern |
A major concern is data decomposition -- how to divide arrays among local CPUs to minimise communication |
Here is a major distinction between shared- and distributed-memory: |
In SM the processors don't need to worry about communicating with their peers, only with the central memory, while in the DM there really isn't anything but the processors. |