Parallel Computing |
Communication must be high bandwidth and low latency. |
Low flexibility (and overhead) in messages (point-to-point). |
Distributed Computing |
Communication can be high or low bandwidth. |
Latency typically high ---> can be very flexible messages involving fault tolerance, sophisticated routing, etc. |
Parallel Computing should on technical grounds define standards as more restrictive (demanding)? However it is smallest field. |