Distributed Memory: Some Approaches
Distributed Memory: Some Approaches
Message-passing approach:
- The overhead is proportional to size and number of packets (more communication means greater costs; sending data is slower than accessing shared memory.).
- Message-passing is not cheap: every one of those messages has to be individually constructed, addressed, sent, delivered, and read, all before the information it contains can be acted upon.
- In the general case, message-passing will take more time and effort than shared-memory.