Parallel Numerics - Winter 11

From Sccswiki
Jump to navigation Jump to search
Winter 11
Univ.-Prof. Dr. Thomas Huckle
Time and Place
Lecture: Monday 10:15 - 11:45 Uhr (MI 02.07.023), Tutorial Friday 10:15 - 11:45 Uhr (MI 02.07.023)
CSE (compulsory course, 3rd semester), Mathematics (Master), Informatics (Master) (Modul IN2012 oder IN2012)
Matous Sedlacek
Inspection/Review of Reexam on Monday 7.5.2012 at 10:00 in 02.05.044 and 02.05.040!
Semesterwochenstunden / ECTS Credits
SWS (2V + 2Ü) / 5 Credits


This course will be given in every winter term. The lectures and tutorials are conducted in English, and the course substitutes the German lecture "Numerik auf Parallelrechnern".


  1. First lecture: 24.10.2011
  2. First tutorial: 28.10.2011
  3. Additional 10th tutorial: There will be an additional 10th tutorial. See the worksheet below.
  4. No tutorial on 23.12.2011: The last tutorial this year will be on 16.12.2011!
  5. Exam will be on 10.2.2012: See details below!
  6. Worksheet solutions 1-8 available:
  7. First Tutorial 2012: 13.1.2012
  8. Last Tutorial on 20.1.2012
  9. EXAM INSPECTION/REVIEW on Friday 24.2.2012 at 10:15-11:45 in room 01.07.014!
  10. Room change for EXAM INSPECTION/REVIEW!!! Will take place in room 01.07.014!
  11. REEXAM on Monday 23.4.2012 at 10:00-11:30 in room 01.07.014! See details below!
  12. Inspection/Review of Reexam on Monday 7.5.2012 at 10:00 in 02.05.044 and 02.05.040!


  1. High-Performance Computing
  2. Performance: Analysis, Modeling, and Measurements
  3. Basic Linear Algebra Subprograms
  4. Direct Solution of Sparse Linear Systems
  5. Iterative Methods for Linear Systems
  6. Linear Eigenvalue Problems
  7. Programming in MPI

Course Material

Lecture Notes



Corrections with new version are marked in red.

Tutorial Topics Worksheet Proposal for solution / code Slides
1 Flynn's Taxonomy & MPI Basics worksheet1.pdf worksheet1_solution.pdf
2 Numerical Integration & P2P Communication I worksheet2.pdf worksheet2_solution.pdf
3 Vector-Vector Operations & P2P Communication II worksheet3.pdf worksheet3_solution.pdf
4 Matrix-Matrix-Operations & P2P Communication III worksheet4.pdf worksheet4_solution.pdf
5 Parallel Gaussian elimination & Collective Operations worksheet5.pdf worksheet5_solution.pdf
6 Tridiagonal Matrices, Hockney/Golub method & Message Tags worksheet6.pdf worksheet6_solution.pdf
7 Sparse Matrix-Vector Multiplication & MPI Communicators worksheet7.pdf worksheet7_solution.pdf
8 Stationary Methods worksheet8.pdf worksheet8_solution.pdf
9 Domain Decomposition worksheet9.pdf worksheet9_solution.pdf
10 Gradient Methods, Preconditioning & Eigenvalues worksheet10.pdf worksheet10_solution.pdf

Literature & External Links

  1. Introduction to High Performance Scientific Computing (Eijkhout, Chow, van de Geijn) [free download]
  2. Numerical Linear Algebra for High-Performance Computers (Dongarra, Duff, Sorensen, van der Vorst)
  3. Parallel Algorithms for Matrix Computations (Gallivan, Heath, Ng, Ortega,...)
  4. A User's Guide to MPI (Pacheco)
  5. Iterative Methods for Sparse Linear Systems (Saad)
  6. Loesung linearer Gleichungssysteme auf Parallelrechnern (Frommer)
  1. [An Introduction To Quantum Computing for Non-Physicists]


  • Date: 2012, February 10th (Friday), 14:30-16:00
  • Room: MW 0350 (Egbert-von-Hoyer-Hörsaal, Departement of mechanical engineering)
  • Registration: Via TumOnline till 2012, mid January.
    You can sign off till 2011, end of January.
  • Inspection/Review: February 24th (Friday), 2012, 10:15-11:45, room 01.07.014.
  • WRITTEN Reexam on Monday 23.4.2012 at 10:00-11:30 in room 01.07.014! Registration now open via TumOnline!
  • Inspection/Review of Reexam on Monday 7.5.2012 at 10:00 in 02.05.044 and 02.05.040!

Allowed Material for the exam

  • 1 two-sided hand-written sheet of paper
  • "Message Passing Interface Quick Reference in C" [MPI Quick Reference]


The exam takes place on 10.2.2012. Make sure you are in place on time. As the lecture hall is reserved from 14:00, and as we have to leave at 16:00, there's no chance to wait for late arrivals. A handwritten sheet of paper (size A4, front and back page) may be used during the exam as mnemonic as well as the MPI operation reference distributed during the tutorials. No other material besides dictionaries is allowed.

Please study your examination regulations. Students in most disciplines have to register for the exams throughout the semester via TumOnline.

Students that did not pass the exam or did not participate and still need the credits should contact Prof. Thomas Huckle for an appointment as soon as possible. In this case, the appointment always is the second try, i.e. if you do not take part in the exam, it is a failed try.

Old Exams