William Gropp_Using MPI 3rd

In the fifteen years since the second edition of Using MPI was published, in 1999, high-performance computing (HPC) has undergone many changes. Some aspects of HPC have been disruptive and revolutionary; but others, no less significant, have been gradual and evolutionary. This edition of Using MPI updates the second edition to bring our presentation of the Message-Passing Interface (MPI) standard into line with these changes. The most dramatic change has been in parallel computing hardware. The speed (cycle rate) of individual processing units has leveled off because of power and heatdissipation constraints, causing parallelism to become mainstream and, for HPC, putting increased pressure on the scale of parallelism. Computer vendors have responded. The preface to the second edition refers to “the very largest computers in the world, with thousands of processors.” Today, applications run on computers with millions of pro