Multicomputer Cost Model
Cost of remote memory access/communication (including synchronization)
T = ts + N tw
- ts = per-message cost (“latency”)
- tw = per-word cost
- N = message size in words
Hence data locality is an important property of good parallel algorithms