CS442 - Parallel and Distributed Programming

• Syllabus

• Shared Memory Consistency: A Tutorial
• Extending Parallel Pseudo-Code Language Peril-L - Has some minor (in some ways trivial) extensions to Peril-L along with an implementation of Jacobi iteration in its extended Peril-L

• OpenMP tutorial for Lawrence Livermore National Laboratory
• OpenMP C and Fortran reference cards * MPI Tutorial from Lawrence Livermore National Laboratory
• Directions for using the turnin program to submit assignments.

• Programming Assignment 1 - new due date 5:00pm October 26th
  • Tarfile of jacobi iteration implementations for the assignment, including:
    1. jacobi-book.c - The original version of the program as listed in the textbook
    2. jacobi-book-corrected.c - A corrected version of the book version that compiles on POSIX systems and fixes several logial bugs
    3. jacobi-optimized.c - An optimized version of the corrected version of the book's implementation that uses replication to remove some synchronization operations.
• Midterm Problem Set - due 9:30am, Tuesday November 3, 2009.
• Programming Assignment 2

For the remainder of the semester, we're going to be looking at techniques for building parallel programs as well as some information on distributed and cloud computing systems

Due to the shortage of detail in the main book on this subject, we're going to use excerpts from Ian Foster's online book "Designing and Building Parallel Programs (DBPP)". The schedule below gives links to the remainder the readings for each of the assigned lectures.

• October 20, 22 - Summary of DBPP method for parallel algorithm design - DBPP sections 2.1-2.5. Problem set handed out 10/22 due 10/29.
• October 27 - Class co-convened with CS587. Paper for the day is Not yet posted
• October 29 - Parallel search techniques - Shortest Path Computations, and game tree search
• November 3 - Monte carlo techniques and volunteer computing systems (e.g. SETI@Home)

• November 5 - Introduction to distributed computing issues, RPC
• November 10, 12 - Distributed transaction systems
• November 17, 19 - 2009 ACM/IEEE International Conference on Supercomputing, no class
• November 24 - Intro to Cloud/Grid Computing, performance analysis programming assignment handed out.
• November 26 - Happy Thanksgiving! No class
• December 1, 3, 8 - Large scale data processing systems - MapReduce/Hadoop/etc. Problem set due 12/15 handed out 12/3.
• December 10 - Class review and summary