An Introduction to Parallel Programming, 2nd ed. by Peter Pacheco and Matthew Malensek

The second edition of An Introduction to Parallel Programming is also an elementary introduction to programming parallel systems with MPI, Pthreads, and OpenMP. However, this edition also includes an introduction to programming GPUs using CUDA. The book should be used by students and professionals with some knowledge of programming conventional, single-processor systems, but who have little or no experience programming multiprocessor systems.

Here's an archive of the source code that's discussed in the book. For the code to display properly, you should use a fixed-width font (e.g., courier) and a display width of at least 80 characters. (Updated 04/22/23.)

A list of errata can be downloaded from this link. (Updated 11/01/2023.)

Please note: Lecture notes and other companion materials are in preparation. They will be posted as soon as they become available. In the meantime, the materials for the first edition may be helpful. Links are available here.