Content |
|
|
Course material to
MPI, OpenMP, HPF, and advanced topics in parallel programming
All PDF and .ps.gz files were moved to the
ONLINE
Parallel Programming Workshop
|
1st day |
|
|
9:00 - 17:30, Message Passing Interface (MPI, part 1)
|
[ 1] | 9:00 | (0:10) | L | Introduction (talk) PDF |
[ 2] | 9:10 | (1:00) | L | Parallel Architectures and Programming Models (talk) PDF |
[ 2a] | -:-- | (1:00) | L | Parallel Hardware Architectures / Which Parallel Programming Model is the best? (online only) PDF |
| 10:10 | (0:15) | | Coffee |
[ 3] | 10:25 | | L | MPI-1 - Introduction to the Message Passing Interface PDF |
[3a] | -:-- | | L | MPI-1 Exercises - Solutions (handout) |
| 10:25 | (0:20) | L | Chap.1 MPI Overview (talk) |
| 10:45 | (1:15) | L | Chap.2 MPI Process Model (talk+practical) |
| 12:00 | (1:00) | | Lunch |
| 13:00 | (1:15) | L | Chap.3 Point-to-Point Communication (talk+practical) |
| 14:15 | (0:15) | | Coffee |
| 14:30 | (1:15) | L | Chap.4 Non-Blocking Communication (talk+practical) |
| 15:45 | (0:15) | | Coffee |
| 16:00 | (1:00) | L | Chap.5 Derived Datatypes (talk+practical) |
[ 4] | -:-- | | L | Writing Message-Passing Parallel Programs with MPI, Course Notes from the EPCC, (handouts) 2to1.ps.gz |
[ 5] | 17:00 | (0:30) | L | Parallel debugging and TotalView (talk+practical) PDF |
[5a] | -:-- | | L | Totalview Exercises
(handout) |
|
2nd day |
|
|
9:00 - 17:30, Message Passing Interface (MPI, part 2) and OpenMP
|
[ 3] | 9:00 | | L | MPI-1 - Introduction to the Message Passing Interface (continued) |
| 9:00 | (1:10) | L | Chap.6 Virtual Topologies (talk+practical) |
| 10:10 | (0:15) | | Coffee |
| 10:25 | (0:35) | L | Chap.7 Collective Communication (talk+practical) |
| 11:00 | (0:15) | | Coffee |
| 11:15 | (0:25) | L | Chap.8 Other MPI-1 features (talk) |
[3a] | -:-- | | L | MPI-1 Exercises - Solutions (handout) |
[ 4] | -:-- | | L | Writing Message-Passing Parallel Programs with MPI, Course Notes from the EPCC, (handouts) 2to1.ps.gz |
[ 6] | 11:40 | (0:20) | L | Heat conduction program, a parallelization example with MPI (talk) PDF |
[6a] | -:-- | | L | Heat conduction program, program listings (handout) |
| 12:00 | (1:00) | | Lunch |
[ 7] | 13:00 | (1:00) | L | OpenMP - Overview and execution model (talk+practical) PDF |
| 14:00 | (0:15) | | Coffee |
| 14:15 | (1:00) | L | OpenMP - Work sharing directives (talk+practical) |
| 15:15 | (0:45) | L | OpenMP - Data environment (talk+practical) |
| 16:00 | (0:15) | | Coffee |
| 16:15 | (0:30) | L | OpenMP - Pitfalls (talk) |
[7a] | -:-- | | L | OpenMP Exercises - Tasks and Solutions (handout) |
[ 8] | 16:45 | (0:45) | L | Assure - detection of OpenMP race conditions (talk+practical) PDF |
|
3rd day |
|
|
9:00 - 17:30, MPI-2 and advanced MPI programming
|
[ 9] | 9:00 | (0:30) | L | Access to the federal high-performance computing-centers (talk) PDF |
[10] | 9:30 | (0:15) | M | MPI-2 overview (talk) PDF |
[11] | 9:45 | (1:00) | M | MPI-2 parallel file I/O (basics) (talk+practical) PDF |
| 10:45 | (0:15) | | Coffee |
| 11:00 | (1:00) | M | MPI-2 parallel file I/O (fileviews) (talk+practical) |
| 12:00 | (1:00) | | Lunch |
| 13:00 | (1:00) | M | MPI-2 parallel file I/O (access methods) (talk+practical) |
[11a] | -:-- | | L | MPI-2 parallel file I/O Exercises - Skeletons and Solutions (handout) |
| 14:00 | (0:15) | | Coffee |
[12] | 14:15 | (1:00) | M | MPI-2 one-sided Communication (talk+practical) PDF |
[12a] | -:-- | | L | MPI-2 one-sided Exercises - Skeletons and Solutions (handout) |
| 15:15 | (0:15) | | Coffee |
[13] | 15:30 | (0:30) | M | Other MPI-2 chapters (talk) PDF |
[14] | 16:00 | (0:30) | M | Optimization of MPI applications (talk) PDF |
[15] | -:-- | (0:25) | M | MPI Performance Studies on Cray T3E and SGI Origin (talk) ps.gz |
| 16:30 | (0:15) | | Coffee |
[16] | 16:45 | (0:05) | M | Tools for MPI Performance Analysis and Debugging (talk) PDF |
[17] | 16:50 | (0:20) | M | VAMPIR and other tools for performance analysis (talk+practical) PDF |
[18] | 17:10 | (0:20) | L | Application Support at HLRS (talk) PDF |
|
4th day |
|
|
9:00 - 17:30, Advanced OpenMP programming and Vectorization
|
[19] | 9:00 | (0:30) | H | OpenMP - Enhancments in OpenMP 2.0 (talk) PDF |
[20] | 9:30 | (0:30) | H | OpenMP - Cluster extensions (talk) PDF |
| 10:00 | (0:15) | | Coffee |
[21] | 10:15 | (0:30) | M | OpenMP - Tools (talk) PDF |
[22] | 10:45 | (1:15) | M | OpenMP - Performance tuning and OpenMP (talk+practical) PDF |
| 12:00 | (1:00) | | Lunch |
[23] | 13:00 | (1:00) | H | MPI on hybrid systems / MPI + OpenMP (talk) PDF |
| 14:00 | (0:15) | | Coffee |
[24] | -:-- | (1:00) | M | NEC HPC platforms (April 2001, online only) PDF |
[25] | 14:15 | (1:00) | M | NEC SX-5 - Vectorization on NEC Supercomputers (talk) PDF |
[26] | -:-- | (1:00) | M | NEC SX-5 - Shared Memory parallelization on NEC Supercomputers (April 2001, online only) PDF |
[27] | 15:15 | (0:30) | M | NEC psuite (online demonstration) |
| 15:45 | (0:15) | | Coffee |
[28] | -:-- | (0:45) | M | Hitachi SR8000 - Introduction and Hardware Architecture (April 2001, talk) PDF |
[29] | 16:00 | (0:45) | M | Hitachi SR8000 - Programming models and tuning (talk and online demo.) PDF |
[29a] | --:-- | (0:45) | M | Hitachi SR8000 - Programming models and tuning (March 2001, online only) 1.ps.gz+2.ps.gz+3.ps.gz or 1.pdf+2.pdf+3.pdf |
[30] | 16:45 | (0:45) | L | Virtual reality based visualization (talk and online demo in the cave) PDF |
|
5th day |
|
|
9:00 - 16:30, Domain Decomposition and Load Balancing
|
[31] | 9:00 | (1:00) | H | Domain decomposition of structured and unstructured grids (talk) PDF |
| 10:00 | (0:15) | | Coffee |
[32+32a] | 10:15 | (1:15) | H | Load balancing (talk+practical) PDF+PDF |
[33] | 11:30 | (0:20) | L | Numerical libraries (talk) PDF |
[34] | 11:50 | (0:40) | M | Parallel numerics (part1) (talk) PDF |
| 12:30 | (1:00) | | Lunch |
| 13:30 | (0:45) | M | Parallel numerics (part2) |
| 14:15 | (0:10) | | Coffee |
[35] | 14:25 | (0:45) | H | Particle based domain decomposition (talk) PDF |
| 15:10 | (0:10) | | Coffee |
[36] | 15:20 | (1:10) | H | Object oriented parallel programming with C++ (talk) PDF |
| | | ^- | L=low=for beginners, M=middle, H=high=advanced |
|
6th day |
|
|
9:00 - 16:30, High Performance Fortran (HPF)
|
[37] | 9:00 | (3:00) | L | HPF, part 1 (talk+practicals) PDF |
| 12:00 | (1:00) | | Lunch |
| 13:00 | (3:30) | L | HPF, part 2 (talk+practicals) |
[37a] | -:-- | | L | HPF, Exercises - Skeletons and Solutions (handout) |
| | | ^- | L=low=for beginners, M=middle, H=high=advanced |
|
Practical |
|
|
All practical can be found
here.
|
Standard Documents |
|
|
The setting copy of our standard documents is available
here.
The documents 1, 2 and 3 are used in this course.
Each document is reduced by a factor of 0.707,
i.e., two pages of the original standard document is printed
on one paper page.
|
Course dates and Registration |
|
|
see on Parallel Programming Workshop course pages
at
courses and events at HLRS
(www.hlrs.de/news-events/events/)
and
external courses and events
(www.hlrs.de/news-events/external-events/).
|
URL |
|
|
http://www.hlrs.de/news-events/events/2001/parallel_prog_fall2001/material/ (URL of this page)
|