Communication Must be Reduced
4 by 4 regions in each processor
- 16 Green (Compute) and 16 Red (Communicate) Points
8 by 8 regions in each processor
- 64 Green and “just” 32 Red Points
Communication is an edge effect
Give each processor plenty of memory and increase region in each machine
Large Problems Parallelize Best