HPC - Algorithms and Applications - Winter 13

From Sccswiki
Revision as of 19:50, 20 March 2014 by Bader (talk | contribs)
Jump to navigation Jump to search
Winter 13/14
Prof. Dr. Michael Bader
Time and Place
Lecture: Monday, 14.00-15.30, MI 02.07.023 (starts Oct 21);
Tutorial: Wednesday, 10-12, MI 02.07.023 (starts Oct 23, roughly bi-weekly)
Elective topic in Informatics Bachelor/Master: students in mathematics or in any science or engineering discipline are welcome!
Oliver Meister
written exam, Wednesday, Feb 5, 2014; 10-12 in room MI 02.07.023 (time and room of the tutorial)
a repeat exam (oral) will be offered on April 2 and 3
Semesterwochenstunden / ECTS Credits
3 SWS (2V + 1Ü) / 4 ECTS
https://campus.tum.de/tumonline/lv.detail?clvnr=950111465 (lecture)
https://campus.tum.de/tumonline/wbStpModHB.detailPage?&pKnotenNr=705979 (module description)


  • From Nov 18, the lecture on Monday will start at 14.00 (instead of 14.15)


The lecture will have a focus on parallel algorithms and implementation techniques in the field of numerical simulation and high performance computing, such as:

  • linear algebra problems on dense and sparse matrices
  • simulation on structured and unstructured meshes
  • particle-based simulations (with long-range and short-range interactions)
  • spectral methods (parallel FFT and related algorithms)
  • Monte Carlo and statistical methods

(a.k.a. the seven dwarfs of HPC).

The accompanying tutorials will include practical assignments, and will concentrate on the programming of GPU and accelerator platforms.

Lecture Material

Slides and exercise sheets/solutions will be made available during the lecture.

Lecture slides will be published here after the lessons: See also the lecture from winter term 2012/13.


Roughly every second week a two hour tutorial will take place (details at page top; days and time will be announced in TUMonline and in the lectures). The assignments and their solutions will be gradually posted here.

Date Slides Worksheet Source Source (solution)
Oct 23rd Organizational remarks - - -
Nov 6th Introduction to CUDA Worksheet 1 Exercise 1 Solution 1
Nov 13th Further details on Dense LA in CUDA Worksheet 2 Exercise 2 Solution 2
Nov 27th Sparse LA in CUDA Worksheet 3 Exercise 3 Solution 3
Dec 11th Solving the heat equation with CUDA Worksheet 4 Exercise 4 Solution 4
Jan 8th The Shallow Water Equations and CUDA Worksheet 5 Exercise 5 Solution 5
Jan 22nd Further topics on SWE and CUDA Worksheet 6 - -


  • Repeat Exam: will be scheduled as oral exam on April 2/3; the same rules as for the written exam will apply (esp. no helping material, questions on the tutorials)
  • Exam review: you may view your corrected and graded exam on Thursday, Feb 13, 15.30 (office of Prof. Bader, Leibniz Supercomputing Centre, room E.2.044)
  • a repeat exam will be offered:
    • in early April (exact day and time t.b.a.)
    • as a written exam, if more than 12 students register for the exam; otherwise it will be an oral exam
  • written exam on Feb 5, 2014, from 10.15 (room MI 02.07.023)
    • please be in (front of) the lecture room in time (at 10.00); the exam will start on 10.15, at the latest, and there will be announcements before the start!
  • no helping material of any kind will be allowed for the exam
  • please make sure that you register for the exam in TUMonline
  • the exam will extend over all topics discussed in the lectures and tutorials:
    • approx. 30% of the questions will deal with questions related to the tutorials; basic knowledge about GPU programming with CUDA is thus necessary
  • The following topics will be excluded as topics of the exam:

Literature and Online Material

Books on CUDA


Helpful, but not strictly required is knowledge in:

  • basics of numerical methods (e.g.: lecture IN0019 Numerical Programming or similar)
  • basics of parallel programming (lecture Parallel Programming, HPC - Programming Paradigms and Scalability, or similar)

Most important is a certain interest in problems from scientific computing and numerical simulation!