Computer Architectures - MIMD - Distributed Memory
Computer Architectures - MIMD - Distributed Memory
A Major Concern
- A major concern is data decomposition -- how to divide arrays among local CPUs to minimise communication
- Here is a major distinction between shared- and distributed-memory:
- In SM the processors don't need to worry about communicating with their peers, only with the central memory, while in the DM there really isn't anything but the processors.