MPI Tutorial Introduction

Abstraction: Message Passing Interface standard introduction and parallel programming history

Key points:

• MPI standard defined at Supercomputing 1992 conference to unify parallel programming; MPI-1 completed 1994; first implementations by 1995
• Core model: processes assigned unique ranks within a communicator group; communicate via tagged send/receive operations
• Point-to-point communications involve one sender and one receiver; collective communications involve all processes (e.g. broadcast)
• MPI is lower-level than libraries like Hadoop but provides a portable foundation across parallel architectures
• Still the de-facto standard for message-passing parallel applications on HPC clusters and supercomputers
• Author developed tutorials based on work at Argonne National Laboratory and doctoral supercomputing research

Connections: Argonne National Laboratory · Parallel Computing · Message Passing · Distributed Memory Computing

Source: http://mpitutorial.com/tutorials/mpi-introduction/