Parallel Machines and Programming Models

• First Model
  • Hardware-Based: Shared Memory Architecture.

  • Software-Based: Shared Address Space.

• Second Model
  • Hardware-Based: Distributed Memory Architecture.

  • Software-Based: Message Passing.

• Third Model
  • Hardware-Based: SIMD (Single Instruction Multiple Data) Architecture.

  • Software-Based: Data Parallel.

The following diagram illustrates the high-level mapping of these 3 models to the hardware. (Mem: memory, CA: communication assistant, $: cache, and P: processor).