Two critical Issues are:
|
Memory Structure
-
Distributed
-
Shared
-
Cached
|
and Heterogeneous mixtures
|
Control and synchronization
|
SIMD -lockstep synchronization
|
MIMD -synchronization can take several forms
-
Simplest: program controlled message passing
-
"Flags" in memory - typical shared memory construct
-
Special hardware - as in cache and its coherency (coordination between nodes)
|