Parallel Computing versus Distributed Computing
Parallel Computing versus Distributed Computing
Parallel Computing
- Communication must be high bandwidth and low latency.
- Low flexibility (and overhead) in messages (point-to-point).
Distributed Computing
- Communication can be high or low bandwidth.
- Latency typically high ---> can be very flexible messages involving fault tolerance, sophisticated routing, etc.
- Parallel Computing should on technical grounds define standards as more restrictive (demanding)? However it is smallest field.