Difference between revisions of "Future Trends in Computing - Summer 16"

From Sccswiki
Jump to navigation Jump to search
 
(10 intermediate revisions by 2 users not shown)
Line 27: Line 27:
 
= Topics =
 
= Topics =
  
*Fault Tolerance
 
*Resource Aware Computing Concepts
 
*Dark Silicon
 
*Energy Aware Computing Techniques in HPC
 
*Task-Based Runtime Systems
 
*PGAS
 
*Heterogeneous Computing
 
*Actor-based Programming model
 
*MIC architectures (Intel Xeon Phi)
 
*MPI at Exascale
 
*DSLs for HPC (ExaStencils)
 
*Modeling vs. Automatic Tuning in HPC
 
<!--
 
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
| '''Supervisor''' || '''Topic''' || '''Assigned To''' || ''' Reviewer 1 ''' ||  ''' Reviewer 2 ''' || '''Paper''' || '''Slides'''
+
| '''Supervisor''' || '''Topic''' || '''Assigned To''' || '''Paper''' || '''Slides'''
 
|-
 
|-
| Alex || Invasive algorithms || Michael Riesch || Evgeny || SungJae || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Riesch_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Riesch_slides.pdf Slides]
+
| Prof. Gerndt || MIC architectures (Intel Xeon Phi) || Weijie Zhang || ||
 
|-
 
|-
| Isaías || Resource management for heterogeneous architectures || Nathaniel Knapp || Tamas || Matthias || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Knapp_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Knapp_slides.pdf Slides]
+
| Prof. Gerndt || Heterogeneous Computing || Guillermo González || ||  
 
|-
 
|-
| Emily || Faults and Fault-Tolerance || Christoph Hartlmüller || Martin || Michal || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Hartlmueller_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Hartlmueller_slides.pdf Slides]
+
| Prof. Gerndt || PGAS || Boro Šofranac || ||
 
|-
 
|-
| Isaías || Invasive Network-on-a-Chip architectures (iNoCs) || Evgeny Agamirzov || Felix || Oleksandr || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Agamirzov_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Agamirzov_slides.pdf Slides]
+
| Josef || Dark Silicon || Juan Medina Serrano || ||
 
|-
 
|-
| Isaías || Resource aware runtime systems || Tamas Borbáth || SungJae || Michael || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Borbath_paper_final.pdf Paper] || ---
+
| Josef || Energy Aware Computing Techniques in HPC || Alexandra Ioana Ilia || ||
 
|-
 
|-
| Emily || The Invasic Framework || Martin Schwörer || Matthias || Nathaniel || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Schwoerer_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Schwoerer_slides.pdf Slides]
+
| Emily || Fault Tolerance || Ioana­ Dumitrita Costinas || ||
 +
|-
 +
| Emily || Resource Aware Computing Concepts || Bibigul Shektybayeva || ||
 
|-
 
|-
| Emily || Resource-aware computing concepts || Felix Scheffler || Michal || Christoph || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Scheffler_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Scheffler_slides.pdf Slides]
+
| Alexander || Task-Based Runtime Systems || Lukas Schmidt || ||
 
|-
 
|-
| Josef || Dark silicon (hardware, current Trends, etc) || SungJae Jung || Oleksandr || Evgeny || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Jung_paper_final.pdf Paper] || ---
+
| Alexander || Actor-based Programming model || Iván Rodríguez || ||
 
|-
 
|-
| Josef || Power Saving by Dynamic Voltage and Frequency Scaling (DVFS) and Power Capping (PC) || Matthias Kruk || Michael || Tamas || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Kruk_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Kruk_slides.pdf Slides]
+
| Alexander || DSLs for HPC (ExaStencils) || Felix Uhl || ||
 
 
 
|-
 
|-
| Alex || Characterization of problems and extraction of patterns || Michal Szymczak || Nathaniel || Martin || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Szymczak_paper_final.pdf Paper] || ---
+
| Isaías || MPI at Exascale || Imke Helene Drave || ||
 
|-
 
|-
| Alex || Heterogeneous computing frameworks: OpenCL || Oleksandr Shchur || Christoph || Felix || [http://www5.in.tum.de/lehre/seminare/rac/ss15/paper/Shchur_paper_final.pdf Paper] || [http://www5.in.tum.de/lehre/seminare/rac/ss15/slides/Shchur_slides.pdf Slides]
+
| Isaías || Modeling vs. Automatic Tuning in HPC || Paul Karlshöfer || ||
 
|-
 
|-
 
|}
 
|}
-->
 
  
 
= Literature =
 
= Literature =
Line 75: Line 62:
  
 
= Schedule =  
 
= Schedule =  
 +
 
{| class="wikitable"
 
{| class="wikitable"
 
|-
 
|-
| '''Week''' || '''Time''' || '''Place''' || '''Description''' || '''Material'''
+
|'''Time''' || '''Place''' || '''Description''' || '''Material'''
|-
 
| - || 21.01.2015, 16:00 PM || MI 02.09.023 || Initial Meeting || [http://www5.in.tum.de/wiki/uploads/a/ae/20150121_initial_meeting.pdf Slides]
 
 
|-
 
|-
| 1st || 16.04.2015, 16:00 PM || MI 01.06.011 || Kick-Off Meeting || [http://www5.in.tum.de/wiki/uploads/7/7c/20150416_kickoff_meeting.pdf Slides]
+
|19.04.2016, 14:00 - 16:00 || MI 02.07.023 || Kick-Off Meeting || -
 
|-
 
|-
| 3rd || '''27.04.2015, 23:59 PM''' || - || '''Submission of paper outline'''  || -
+
|'''30.04.2016, 18:00''' || N\A || Submission of paper title and outline (no abstract) || -
 
|-
 
|-
| 3rd ||28.04.2015, 15:00 PM || MI 02.07.023 || Flash-Talk Meeting (2-min talk, no slides)  || -
+
|'''15.06.2016, 18:00''' || N\A || Submission of paper release candidate || -
 
|-
 
|-
| 7th || - || - || Submission of paper draft to supervisor (voluntary)  || -
+
|'''30.06.2016, 18:00''' || N\A || Submission of paper final version || -
 
|-
 
|-
| 8th || '''05.06.2015, 23:59 PM''' || - || '''Submission of paper (release candidate) for review'''  || -
+
|21.06.2016, 14:00 - 16:00 || MI 02.07.023 || Presentation (1) Alexandra Ioana Ilia (2) Juan Medina Serrano || -
 
|-
 
|-
| 9th || '''12.06.2015, 23:59 PM''' || - || '''Submission of 2 reviews''' || -
+
|24.06.2016, 14:00 - 16:00 || MI 01.13.010 || Presentation (1) Ioana­ Dumitrita Costinas (2) Bibigul Shektybayeva || -
 
|-
 
|-
| 10th || 16.06.2015, 14:00 PM || MI 02.07.023 || Presentation (1) Schwörer (2) Scheffler || -
+
|28.06.2016, 14:00 - 16:00 || MI 02.07.023 || Presentation (1) Guillermo González (2) Boro Šofranac || -
 
|-
 
|-
| 10th || 18.06.2015, 14:00 PM || MI 01.06.011 || Presentation (1) Borbáth  (2) Knapp || -
+
|01.07.2016, 08:30 - 10:00 || MI 02.07.023 || Presentation (1) Weijie Zhang (2) Lukas Schmidt || -
 
|-
 
|-
| 11th || 23.06.2015, 14:00 PM || MI 02.07.023 || Presentation (1) Hartlmüller || -
+
|05.07.2016, 14:00 - 16:00 || MI 02.07.023 || Presentation (1) Imke Helene Drave (2) Paul Karlshöfer || -
 
|-
 
|-
| 11th || 25.06.2015, 14:00 PM || MI 01.06.011 || Presentation (1) Riesch  (2) Szymczak  || -
+
|08.07.2016, 14:00 - 16:00 || MI 01.13.010 || Presentation (1) Iván Rodríguez (2) Felix Uhl || -
|-
 
| 12th || 30.06.2015, 14:00 PM || MI 02.07.023 || Presentation (1) Jung    (2) Kruk  || -
 
|-
 
| 12th || 02.07.2015, 14:00 PM || MI 01.06.011 || Presentation (1) Shchur  (2) Agamirzov  || -
 
|-
 
| 12th || '''03.07.2015, 23:59 PM''' || - || '''Submission of final paper''' || -
 
 
|-
 
|-
 
|}
 
|}
 
+
* '''Note 1''': Please send all submission to your supervisor and CC [[Alexander Pöppl, M.Sc.]].  
Note: Please CC Emily, when you submit papers/reviews to your supervisor. Please send your slides to Emily at least 1 day prior to your talk.
+
* '''Note 2''': Presentation slides are not subject to formal submission, but they will be graded as part of your presentation. You're strongly advised to consult your supervisor for the content of your slides.
 
+
* '''Note 3''': Missing submission deadlines may result in grade deduction or failure.
= Important Deadlines =
 
 
 
Detailed deadlines will be posted later. These preliminary deadlines are subject to change.
 
 
 
* End of April: submission of paper topic and outline.
 
* Beginning of June: submission of paper (release candidate) for review.
 
* End of June: submission of final paper.
 
 
 
Note: Failure to meet these deadlines may result in grade deduction or failure of the course.
 
  
 
= Requirements =
 
= Requirements =
  
* Course language: English
+
* '''Course language''': English
* Independent literature research
+
* '''Independent literature research'''
* Paper: 5-10 pages (max 10 pages) in total. IEEE format (see link below) required.
+
* '''Paper''': Total 6-10 pages (max 10 pages). IEEE format double-column (see link below) required.
* Presentation: 30 minutes talk + 15 minutes discussion
+
* '''Presentation''': 30 minutes talk + 15 minutes discussion
* Mandatory attendance: Participants must attend all presentations. Absence can be excused for "good" reasons with a prior notification to the supervisors. For absence due to sickness, a doctor's attest must be provided.
+
* '''Mandatory attendance''': Participants must attend all presentations. Absence may be approved for "good" reasons with a prior discussion to the supervisors. For absence due to sickness, a doctor's attest must be provided. Unapproved absence will result in grade deduction or failure.
  
 
= Grading =  
 
= Grading =  
TBA
+
* Major Components:
<!--
+
** paper release candidate
* Components: paper (papers,reviews) + presentation (slides,talk)
+
** paper final version
* Other factors: attendance, meeting the deadlines, plagiarism
+
** presentation (slides + talk)
 +
* Grade deduction or Failure factors: bad attendance, missing deadlines, plagiarism
 
* Bonus factors: commitment, activeness (interaction with supervisor, participation in discussions, etc.), self-implemented code/examples, etc.
 
* Bonus factors: commitment, activeness (interaction with supervisor, participation in discussions, etc.), self-implemented code/examples, etc.
-->
+
 
 
= Links =
 
= Links =
  
 
* [http://www.invasic.de Invasive Computing]  
 
* [http://www.invasic.de Invasive Computing]  
 
* [http://www5.in.tum.de/lehre/seminare/datamining/dm-template.tar.gz IEEE format]
 
* [http://www5.in.tum.de/lehre/seminare/datamining/dm-template.tar.gz IEEE format]
* [http://www5.in.tum.de/lehre/seminare/future_trends_computing/kickoff_slides.pdf Kick-off meeting slides (Jan 26, 2016)]
+
* [http://www5.in.tum.de/lehre/seminare/future_trends_computing/kickoff_slides.pdf Initial meeting slides (Jan 26, 2016)]

Latest revision as of 09:35, 1 July 2016

Term
Summer 16
Lecturer
Prof. Dr. Michael Gerndt, Dr. Josef Weidendorfer, Emily Mo-Hellenbrand, M.Sc., Alexander Pöppl, M.Sc., Isaías Alberto Comprés Ureña
Time and Place
Initial Meeting: January 26th, 09:00-10:00, room 02.07.023
Kick-Off Meeting: April 19th, 14:00-16:00, room 02.07.023
Presentations: see Schedule section below.
Audience
Students from Master Informatics (IN2107), Computational Science and Engineering (IN2183), and Bachelor Informatics (IN0014)
Tutorials
-
Exam
-
Semesterwochenstunden / ECTS Credits
2 SWS (2S) / 4 Credits
TUMonline
Link



Capacity

  • Max. number of participants: 12

Description

In the last ten years the period of vast increases in processing power mostly achieved by increasing the clock frequency of a processor has come to an end. Instead, computer architectures are getting more complex in order to accommodate the growing demand for processing power. Modern CPUs typically have a wide range of SIMD instructions for fine-grained data parallelism, and are capable of executing several threads on each of their several cores. Memory accesses are passed through multiple cache levels to hide memory access latencies. In addition to that, hardware specialized in performing massively parallel computations is getting more and more popular. Examples are GPUs and accelerators such as the Xeon Phi. In the HPC context, several nodes, each with its own CPU(s) and GPU(s) may be joined into a cluster.

Regular programming techniques and paradigms are no longer sufficient to fully utilize this hardware. Frameworks such as OpenCL take the structure and heterogeneity of the underlying hardware into account and provide the programming environment to expose all available resources, such as GPUs and accelerators. Novel approaches (such as invasive computing) expose the allocation of resources to the users, allowing them to request required resources and, by offering the reallocation of resources at runtime, enabling them to adapt to changing computing demands.

The behavior of the hardware at runtime also needs to be considered. Modern Cluster architectures are not necessarily capable to run at peak utilization 100% of the time. To avoid the overheating of the hardware and the resulting degradation of the silicon, the clock frequency of the CPU may be drastically reduced, or single nodes may even be shut down completely for a time. Taking these problems into account is an additional challenge developers face today.

Background: The seminar will (partly) discuss research executed in the collaborative research unit Invasive Computing funded by the German Research Foundation (DFG).

Topics

Supervisor Topic Assigned To Paper Slides
Prof. Gerndt MIC architectures (Intel Xeon Phi) Weijie Zhang
Prof. Gerndt Heterogeneous Computing Guillermo González
Prof. Gerndt PGAS Boro Šofranac
Josef Dark Silicon Juan Medina Serrano
Josef Energy Aware Computing Techniques in HPC Alexandra Ioana Ilia
Emily Fault Tolerance Ioana­ Dumitrita Costinas
Emily Resource Aware Computing Concepts Bibigul Shektybayeva
Alexander Task-Based Runtime Systems Lukas Schmidt
Alexander Actor-based Programming model Iván Rodríguez
Alexander DSLs for HPC (ExaStencils) Felix Uhl
Isaías MPI at Exascale Imke Helene Drave
Isaías Modeling vs. Automatic Tuning in HPC Paul Karlshöfer

Literature

Consider the Invasive Computing homepage. We encourage independent research and review of the available literature.

Schedule

Time Place Description Material
19.04.2016, 14:00 - 16:00 MI 02.07.023 Kick-Off Meeting -
30.04.2016, 18:00 N\A Submission of paper title and outline (no abstract) -
15.06.2016, 18:00 N\A Submission of paper release candidate -
30.06.2016, 18:00 N\A Submission of paper final version -
21.06.2016, 14:00 - 16:00 MI 02.07.023 Presentation (1) Alexandra Ioana Ilia (2) Juan Medina Serrano -
24.06.2016, 14:00 - 16:00 MI 01.13.010 Presentation (1) Ioana­ Dumitrita Costinas (2) Bibigul Shektybayeva -
28.06.2016, 14:00 - 16:00 MI 02.07.023 Presentation (1) Guillermo González (2) Boro Šofranac -
01.07.2016, 08:30 - 10:00 MI 02.07.023 Presentation (1) Weijie Zhang (2) Lukas Schmidt -
05.07.2016, 14:00 - 16:00 MI 02.07.023 Presentation (1) Imke Helene Drave (2) Paul Karlshöfer -
08.07.2016, 14:00 - 16:00 MI 01.13.010 Presentation (1) Iván Rodríguez (2) Felix Uhl -
  • Note 1: Please send all submission to your supervisor and CC Alexander Pöppl, M.Sc..
  • Note 2: Presentation slides are not subject to formal submission, but they will be graded as part of your presentation. You're strongly advised to consult your supervisor for the content of your slides.
  • Note 3: Missing submission deadlines may result in grade deduction or failure.

Requirements

  • Course language: English
  • Independent literature research
  • Paper: Total 6-10 pages (max 10 pages). IEEE format double-column (see link below) required.
  • Presentation: 30 minutes talk + 15 minutes discussion
  • Mandatory attendance: Participants must attend all presentations. Absence may be approved for "good" reasons with a prior discussion to the supervisors. For absence due to sickness, a doctor's attest must be provided. Unapproved absence will result in grade deduction or failure.

Grading

  • Major Components:
    • paper release candidate
    • paper final version
    • presentation (slides + talk)
  • Grade deduction or Failure factors: bad attendance, missing deadlines, plagiarism
  • Bonus factors: commitment, activeness (interaction with supervisor, participation in discussions, etc.), self-implemented code/examples, etc.

Links