Parallel Numerics - Winter 12

Term

Winter 12

Lecturer

Dr. rer. nat. Tobias Neckel

Time and Place

Lecture: Tuesday 9:00 - 10:30 Uhr (MI 02.07.023), Tutorial Friday 10:15 - 11:45 Uhr (MI 02.07.023)

Audience

CSE (compulsory course, 3rd semester), Mathematics (Master), Informatics (Master) (Modul IN2012)

Tutorials

Matous Sedlacek

Exam

28.2.2013 in room 5503.EG.350 (MW 0350, Egbert-von-Hoyer-Hörsaal) from 8:30-10:00

Semesterwochenstunden / ECTS Credits

SWS (2V + 2Ü) / 5 Credits

TUMonline

Parallel Numerics

---

IN2012

This course will be given in every winter term. The lectures and tutorials are conducted in English, and the course substitutes the German lecture "Numerik auf Parallelrechnern".

News

1. First lecture: Tuesday 23.10.2012
2. First tutorial: Friday 26.10.2012
3. Exam: Thursday 28.2.2013 at 8:30-10:00 in room 5503.EG.350 (MW 0350, Egbert-von-Hoyer-Hörsaal) (see below)
4. No tutorial on Friday 07.12.2012 !
5. Sheet 9: The solution to sheet 9 will be online next week to motivate for own solution. Moreover, exercise 2 will be discussed next week.

Contents

1. High-Performance Computing
2. Performance: Analysis, Modeling, and Measurements
3. Basic Linear Algebra Subprograms
4. Direct Solution of Sparse Linear Systems
5. Iterative Methods for Linear Systems
6. Linear Eigenvalue Problems
7. Programming in MPI

Course Material

Lecture Slides

• Lecture 1 [23-10-2012.pdf]
• Lecture 2 [30-10-2012.pdf]
• Lecture 3 [6-11-2012.pdf]
• Lecture 4 [13-11-2012.pdf]
• Lecture 5 [20-11-2012.pdf]
• Lecture 6 [27-11-2012.pdf]
• Lecture 7 [04-12-2012.pdf]
• Lecture 8 [11-12-2012.pdf]
• Lecture 9 [18-12-2012.pdf]
• Lecture 10 [08-01-2013.pdf]

Tutorials

Corrections with new version are marked in red.

Tutorial	Topics	Worksheet	Proposal for solution / code	Additional (Slides)
1	Flynn's Taxonomy & MPI Basics	sheet1.pdf	sheet1_solution.pdf ws1_task6.cpp
2	Numerical Integration & P2P Communication I	sheet2.pdf	sheet2_solution.pdf ws2_task1.cpp	Flynn_SPMD.pdf
3	Vector-Vector Operations & P2P Communication II	sheet3.pdf	sheet3_solution.pdf ws3_task5.cpp	Comm_Modes.pdf Block_Send.pdf
4	Matrix-Matrix-Operations & P2P Communication III	sheet4.pdf	sheet4_solution.pdf ws4_task5.cpp	AmdahlGustaf.txt
5	Parallel Gaussian elimination & Collective Operations	sheet5.pdf	sheet5_solution.pdf ws5_task3.cpp	Collective.pdf Pivoting.txt
6	Tridiagonal Matrices, Hockney/Golub method & Message Tags	sheet6.pdf	sheet6_solution.pdf ws6_task1_serial.cpp ws6_task1_parallel.cpp ws6_task3.cpp	Hockney_Golub_Notes.pdf
7	Sparse Matrix-Vector Multiplication & MPI Communicators	sheet7.pdf	sheet7_solution.pdf ws7_task3.cpp
8	Stationary Methods	sheet8.pdf	sheet8_solution.pdf ws8_task3_serial.cpp ws8_task3_parallel.cpp	Jacobi_Relaxation_Notes.pdf
9	Gradient Methods, Preconditioning & Eigenvalues	sheet9.pdf	sheet9_solution.pdf ws9_task1_sequential.c ws9_task1_parallel.c
10	Domain Decomposition	sheet10.pdf	sheet10_solution.pdf

Literature & External Links

1. Introduction to High Performance Scientific Computing (Eijkhout, Chow, van de Geijn) [free download]
2. Numerical Linear Algebra for High-Performance Computers (Dongarra, Duff, Sorensen, van der Vorst)
3. Parallel Algorithms for Matrix Computations (Gallivan, Heath, Ng, Ortega,...)
4. A User's Guide to MPI (Pacheco)
5. Iterative Methods for Sparse Linear Systems (Saad)
6. Loesung linearer Gleichungssysteme auf Parallelrechnern (Frommer)

1. [An Introduction To Quantum Computing for Non-Physicists]

Exam

• Date: 28.2.2013 at 8:30-10:00
• Room: 5503.EG.350 (MW 0350, Egbert-von-Hoyer-Hörsaal)
• Registration: via TUMOnline
• Inspection/Review: t.b.a.
• WRITTEN Reexam on t.b.a
• Inspection/Review of Reexam t.b.a.

Allowed Material for the exam

• 1 two-sided hand-written sheet of paper
• "Message Passing Interface Quick Reference in C" [MPI Quick Reference]

Regulations

The exam takes place on t.b.a. Make sure you are in place on time. As the lecture hall is reserved from t.b.a., and as we have to leave at t.b.a., there's no chance to wait for late arrivals. A handwritten sheet of paper (size A4, front and back page) may be used during the exam as mnemonic as well as the MPI operation reference distributed during the tutorials. No other material besides dictionaries is allowed.

Please study your examination regulations. Students in most disciplines have to register for the exams throughout the semester via TumOnline.

Students that did not pass the exam or did not participate and still need the credits should contact Prof. Thomas Huckle for an appointment as soon as possible. In this case, the appointment always is the second try, i.e. if you do not take part in the exam, it is a failed try.

Old Exams

• [Winter 11], [solution]
• [Winter 10], [solution]
• [Winter 09], [solution]
• [Winter 08], [partial solution]
• [Winter 07]
• [Winter 06]
• [Winter 05]