For both parallel and sequential computers, cost is accessing remote memories with some form of "communication" |
Data locality addresses in both cases |
Differences are quantitative size of effect and what is done by user and what automatically |
Main |
Memory |
Interconnection Network |
.... |
.... |
Main |
Memory |
Main |
Memory |
Slow |
Can be Very Slow |