Distributed Memory: Some Approaches

Distributed Memory: Some Approaches

Message-passing approach:

• Shared memory scales less well than message passing, and, once past its maximum effective bandwidth utilisation, the latency associated with message-passing may actually be lower than that encountered on an over-extended shared memory communications network.

• There are ways to decrease the overhead associated with message-passing, the most significant being to somehow arrange to do as much valuable computation as possible while communication is occurring.

Previous slide

Next slide

Back to the first slide

View Graphic Version