13. Example: 4 Servers Server User application MPI API Operating System Server User application MPI API Operating System Server User application MPI API Operating System Server User application MPI API Operating System Network
14. Example: 2 Servers Server User application MPI API Operating System User application MPI API Server User application MPI API User application MPI API Operating System Network
15. Example: 1 Server Server User application MPI API Operating System User application MPI API User application MPI API User application MPI API
16.
17.
18. Trivial MPI Application Process 0 to=1 from=3 Process 2 to=3 from=1 Process 1 to=2 from=0 Process 3 to=0 from=2 MPI_Send(…) MPI_Send(…) MPI_Send(…) MPI_Send(…) MPI_Recv(…) MPI_Recv(…) MPI_Recv(…) MPI_Recv(…)