Distributed memory is, for all intents and purposes, virtually synonymous with message-passing, although the actual characteristics of the particular communication schemes used by different systems may hide that fact. |
Message-passing approach: |
Tasks communicate by sending data packets to each other. |
Messages are discrete units of information and can be distinguished from all other messages (theory). |
Parallel tasks use these messages to send information and requests for same to their peers. |