Overview of Parallel Computing

• Lecture 1

Beginning C

• Lecture 2

Functions and Pointers

• Lecture 3

• Reading: C 1.1 – 1.4, 1.7, 1.8
• Virtualization on Windows
• Compiler and Editor Setup
• Using git
• hello.c
• hello-multi.c
• arg_passing.c

Arguments and Arrays

• Lecture 4

Strings

• Lecture 5
• Lecture 6

• Reading: C 1.6, 1.9, 1.10, 2.2
• Function Arguments
  • arg_example1.c
  • arg_example2.c
  • print_addresses.c
• compilation.c
• array_break.c
• strings.c

I/O and Command Line Arguments

• Lecture 7
• Lecture 8

Structs, Dynamic Memory

• Lecture 9

• Reading: C 7.1 – 7.6
• cmdline_args.c
• debug.c
• flush.c, flush.py

Dynamic Memory

• Lecture 10
• Lecture 11
• Lecture 12

• Reading: C 7.8.5
• structs.c
• structs2.c

Mon: President’s Day Holiday

Linked lists

• Linked List Notes

• Midterm 1: March 2nd
• Midterm 1 Study Guide

MPI

• Lecture 13
• Lecture 14

• Passwordless SSH Setup
• basic_mpi.c
• mpi_hello.c
• hello_send.c

MPI Communication

• Lecture 15
• Lecture 16
• Lecture 17

• MPI Usage Info
• pi-py.py
• pi-c.c
• pi-mpi.c

Collective Communication I

• Lecture 18

• blocking.c
• non-blocking.c

Collective Communication II

• Lecture 19

Distributed Sorting

• Lecture 20

• sleep_sort.c
• Bubble Sort Dance (Thanks, Ismail!)

Distributed Sorting

• Lecture 21

Midterm 2: Fri, April 13

• Study Guide

Introduction to pthreads

• Lecture 22

Critical Sections

• Lecture 23

Condition Variables

• Lecture 24

• thread_hello.c
• global_hello.c

pthread Review

• Lecture 25

Bitcoin

• Lecture 26

• busywait.c
• prod_con.c
• many_mutexes.c

Concurrency Bugs, Thread Safety

• Lecture 27

Introduction to CUDA

• Lecture 28

• deadlock.c
• livelock.c
• starvation.c

CUDA

• Lecture 29

• cuda-hello.cu
• cuda-add.cu