IBM Redbooks: Practical MPI Programming
Discussion of parallel architectures and writing MPI programs for distributed-memory systems.
MPI: The Complete Reference
Online book describing the MPI standard and how to write programs with it.
Parallel Programming with MPI
Supplementary material, online drafts, and ordering information for a print book.