Parallel Numerics - Winter 08

From Sccswiki
Jump to navigation Jump to search
Winter 08
Univ.-Prof. Dr. Thomas Huckle
Time and Place
Monday, 10:00-12:00, room 02.07.023
Friday, 10:00-12:00, room 02.07.023
CSE (compulsory course, 3rd semester), Mathematics (Master), Informatics (Master) (Modul IN2012)
Tobias Weinzierl
Friday, January 30, 10:00-12:00, room CH 21010
Semesterwochenstunden / ECTS Credits
SWS (2V + 2Ü) / 5 Credits


This course will be given in every winter term. The lectures and tutorials are conducted in English, and the course substitutes the German lecture "Numerik auf Parallelrechnern".


  1. Monday, October 20: 10:15-11:45 am: First lecture; Remarks on the tutorials
  2. Friday, October 24: 10:15-11:45 am: First tutorial
  3. Monday, November 3: 10:15-11:45 am: Tutorial instead of lecture
  4. Friday, November 7: 10:15-11:45 am: Lecture instead of tutorial
  5. Friday, January 9: No tutorial
  6. Monday, January 12: 10:15-11:45 am: First lecture in 2009
  7. Friday, January 16: 10:15-11:45 am: First tutorial in 2009
  8. Friday, January 30: 10:00-12:00 am: Exam
  9. Monday, February 2: 10:15-11:45 am: Exam Solution
  10. Friday, February 13: 10:15-11:45 am: Post-exam review in MI 02.05.044
  11. Oral re-exam will be on Tuesday, April 21st, and Wednesday, April 22nd. Please enregister in the list at the door of room 02.05.044


  1. High-Performance Computing
  2. Performance: Analysis, Modeling, and Measurements
  3. Basic Linear Algebra Subprograms
  4. Direct Solution of Sparse Linear Systems
  5. Iterative Methods for Linear Systems
  6. Linear Eigenvalue Problems
  7. Programming in MPI

Course Material

Lecture Notes



  1. Flynn's Taxonomy & MPI Basics ([Worksheet], [Source Code])
  2. Numerical Integration & P2P Communication I ([Worksheet], [Source Code])
  3. Vector-Vector Operations & P2P Communication II ([Worksheet], [Source Code])
  4. Matrix / Matrix Operations & P2P Communication III ([Worksheet], [Source Code])
  5. Parallel Gauss Elimination & Collaborative Operations ([Worksheet], [Source Code])
  6. Tridiagonal Matrices, the Hockney/Golub Method & Message Tags ([Worksheet])
  7. Sparse Matrix-Vector Multiplication & MPI Communicators ([Worksheet])
  8. Stationary Methods ([Worksheet])
  9. Domain Decomposition ([Worksheet])


  1. Loop Optimisation ([Slides])
  2. Open MP ([Slides])

Literature & External Links

  1. Numerical Linear Algebra for High-Performance Computers (Dongarra, Duff, Sorensen, van der Vorst)
  2. Parallel Algorithms for Matrix Computations (Gallivan, Heath, Ng, Ortega,...)
  3. A User's Guide to MPI (Pacheco)
  4. Iterative Methods for Sparse Linear Systems (Saad)
  5. Loesung linearer Gleichungssysteme auf Parallelrechnern (Frommer)
  1. [An Introduction To Quantum Computing for Non-Physicists]



The exam takes place Friday, January 30, 2009 at 10:00 in room CH 21010 (Department of Chemistry). Make sure you are in place on time. As the lecture hall is reserved till 10:00, and as we have to leave at 11:45, there's no chance to wait for late arrivals. A handwritten sheet of paper (size A4, front and back page) may be used during the exam as mnemonic as well as the MPI operation reference distributed during the tutorials. No other material besides dictionaries is allowed.

Please study your examination regulations. Students in most disciplines have to register for the exams throughout the semester. In CSE, e.g., you have to register at Dr. Bader's office, in Computer Science, e.g., there is a centralised online registration via MyTUM. The grades will be published via MyTUM exclusively.

Students that did not pass the exam or did not participate and still need the credits should contact Prof. Thomas Huckle for an appointment as soon as possible. In this case, the appointment always is the second try, i.e. if you do not take part in the exam, it is a failed try.

Oral re-exam will be on Tuesday, April 21st, and Wednesday, 22nd. Please enregister in the list at the door of room 02.05.044

Old Exams

This Year's Exam