Communication on Distributed Memory Architecture
On distributed memory machines, each chunk of decomposed data resides on separate memory space -- a processor is typically responsible for storing and processing data (owner-computes rule)
Information needed on edges for update must be communicated via explicitly generated messages