Parallel Numerics - Winter 12

From Sccswiki
Jump to navigation Jump to search
Winter 12
Dr. rer. nat. Tobias Neckel
Time and Place
Lecture: Tuesday 9:00 - 10:30 Uhr (MI 02.07.023), Tutorial Friday 10:15 - 11:45 Uhr (MI 02.07.023)
CSE (compulsory course, 3rd semester), Mathematics (Master), Informatics (Master) (Modul IN2012)
Matous Sedlacek
Reexam on 19.4.2013. See details below.
Semesterwochenstunden / ECTS Credits
SWS (2V + 2Ü) / 5 Credits
Parallel Numerics


This course will be given in every winter term. The lectures and tutorials are conducted in English, and the course substitutes the German lecture "Numerik auf Parallelrechnern".


  1. First lecture: Tuesday 23.10.2012
  2. First tutorial: Friday 26.10.2012
  3. Exam: Thursday 28.2.2013 at 8:30-10:00 in room 5503.EG.350 (MW 0350, Egbert-von-Hoyer-Hörsaal)
  4. No tutorial on Friday 07.12.2012 !
  5. stationary.m: Additional MATLAB script available (see below)
  6. Sheet 10: The solution to sheet 10 will be online next week to motivate for own solution.
  7. Additional tutorial: Last tutorial is next week on Friday 25.01.2013.
  8. Exam inspection: See details below!
  9. Reexam: Will take place on April 19th 2013 at 13:00. See details below!


  1. High-Performance Computing
  2. Performance: Analysis, Modeling, and Measurements
  3. Basic Linear Algebra Subprograms
  4. Direct Solution of Sparse Linear Systems
  5. Iterative Methods for Linear Systems
  6. Linear Eigenvalue Problems
  7. Programming in MPI

Course Material

Lecture Slides

Additional Material

  • MATLAB script for stationary iterative methods: [stationary.m]


Corrections with new version are marked in red.

Tutorial Topics Worksheet Proposal for solution / code Additional (Slides)
1 Flynn's Taxonomy & MPI Basics sheet1.pdf sheet1_solution.pdf
2 Numerical Integration & P2P Communication I sheet2.pdf sheet2_solution.pdf
3 Vector-Vector Operations & P2P Communication II sheet3.pdf sheet3_solution.pdf
4 Matrix-Matrix-Operations & P2P Communication III sheet4.pdf sheet4_solution.pdf
5 Parallel Gaussian elimination & Collective Operations sheet5.pdf sheet5_solution.pdf
6 Tridiagonal Matrices, Hockney/Golub method & Message Tags sheet6.pdf sheet6_solution.pdf
7 Sparse Matrix-Vector Multiplication & MPI Communicators sheet7.pdf sheet7_solution.pdf
8 Stationary Methods sheet8.pdf sheet8_solution.pdf
9 Gradient Methods, Preconditioning & Eigenvalues sheet9.pdf sheet9_solution.pdf
10 Domain Decomposition sheet10.pdf sheet10_solution.pdf

Literature & External Links

  1. Introduction to High Performance Scientific Computing (Eijkhout, Chow, van de Geijn) [free download]
  2. Numerical Linear Algebra for High-Performance Computers (Dongarra, Duff, Sorensen, van der Vorst)
  3. Parallel Algorithms for Matrix Computations (Gallivan, Heath, Ng, Ortega,...)
  4. A User's Guide to MPI (Pacheco)
  5. Iterative Methods for Sparse Linear Systems (Saad)
  6. Loesung linearer Gleichungssysteme auf Parallelrechnern (Frommer)
  1. [An Introduction To Quantum Computing for Non-Physicists]


  • Date: 28.2.2013 at 8:30-10:00
  • Room: 5503.EG.350 (MW 0350, Egbert-von-Hoyer-Hörsaal)
  • Registration: via TUMOnline
  • Inspection/Review: 25.3.2013 in room 02.05.040
    Specific alphabetical time slots are (surnames starting with character):
    1) 10:00 - 11:30: A - L
    2) 12:30 - 14:00: M - P
    3) 14:00 - 15:30: Q - X
    Note that only 2 persons will be allowed to inspect their exam simultaneously!
    Do not forget your student and identity card!


  • Type: oral (not written)
  • Date: 19.4.2013 from 13:00.
    You have to fill in your name into list on door of office 02.05.040!
    Each candidate may choose only one time slot for the exam and each time slot may contain only one candidate.
    The time slots range from 13:00 till 17:00.
  • Room: 02.05.040 (FMI Building)
  • Registration: via TUMOnline till 1.4.2013 AND by choosing time slot: fill in your name into list on door of office 02.05.040 (see above)!
  • Allowed Material: MPI Quick Reference card.
    Do not forget your student and identity card!

Allowed Material for the exam

  • 1 two-sided hand-written sheet of paper
  • "Message Passing Interface Quick Reference in C" [MPI Quick Reference]


The exam takes place on t.b.a. Make sure you are in place on time. As the lecture hall is reserved from t.b.a., and as we have to leave at t.b.a., there's no chance to wait for late arrivals. A handwritten sheet of paper (size A4, front and back page) may be used during the exam as mnemonic as well as the MPI operation reference distributed during the tutorials. No other material besides dictionaries is allowed.

Please study your examination regulations. Students in most disciplines have to register for the exams throughout the semester via TumOnline.

Students that did not pass the exam or did not participate and still need the credits should contact Prof. Thomas Huckle for an appointment as soon as possible. In this case, the appointment always is the second try, i.e. if you do not take part in the exam, it is a failed try.

Old Exams