Distributed Memory: Some Approaches
Distributed Memory: Some Approaches
- Distributed memory is, for all intents and purposes, virtually synonymous with message-passing, although the actual characteristics of the particular communication schemes used by different systems may hide that fact.
Message-passing approach:
- Tasks communicate by sending data packets to each other.
- Messages are discrete units of information and can be distinguished from all other messages (theory).
- Parallel tasks use these messages to send information and requests for same to their peers.