Seoul metropolitan government
Two major models for parallel programming are the message-passing model and the shared address space model. In the message-passing model, each processor has a private memory and communicates data to other processors by a message. Though programmers can get high performance with this model, it is difficult to write a program to optimize data distribution and data movement for the performance. The Message Passing Interface (MPI) is a de facto standard interface of this model. It is mainly used for a cluster that has physically distributed memories.