1 | Asynchronous - Functional (or data) parallelism that is irregular in space and time. Often loosely coupled and so need not worry about optimal decomposition's to minimise communication. Hard to parallelise (massively) unless .... |
2 | Embarrassingly parallel - Essentially independent execution of disconnected components. |
3 | Metaproblems - Asynchronous collection of (loosely) synchronous components where these programs themselves can be parallelised (coarse grain task parallelism - each data component data parallel). |