This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.
Introduction to Hybrid MPI/OpenMP Programming
Manager : Rémi Lacroix
Instructors : Rémi Lacroix, Dimitri Lecas
This training is aimed at anyone wishing to learn about hybrid MPI/OpenMP programming, particularly for optimal use of supercomputers, such as those in national computing centres.
Objectives
- Understand the underlying concepts,
- Learn about the different benefits of this approach (performance, scalability, memory optimisation...),
- See the different possible implementations and learn how to implement them explicitly in real applications.
- Target audience
- Prerequisites
- Duration and practical info
- Course content
- Course materials
- Upcoming sessions
Target audience
Anyone wishing to implement hybrid MPI and OpenMP parallelisation in a pre-existing application or one currently being designed.
Prerequisites
- Knowledge and use of Fortran 90/95 or C,
- Essential knowledge of MPI and OpenMP (i.e. knowing how to parallelise a basic code with MPI and with OpenMP).
Duration and practical info
This training lasts 2 days:
- from 09:30 (welcome from 9:00) to 17:30 (at the latest)
It takes place exclusively in-person at the premises of IDRIS in Orsay (91).
Attendance
Minimum : 8 people ;
Maximum : 20 people.
Plan :
- Introduction: evolution of hardware architectures and impact on programming and parallelisation techniques
- Hybrid programming: Definition and implementation
- Memory gain: impact of hybrid parallelisation on memory usage
- Performance: impact of hybrid parallelisation on performance (load balancing, use of the interconnect network, …)
- Conclusion
- Opening onto MPI + GPU hybrid programming
💡 50% of the time will be devoted to practical work (C and Fortran90 languages).
For an efficient execution of the practical parts, these will take place on the Jean Zay supercomputer. A workstation with access to the IDRIS supercomputer is provided to the learners. Experience in using a supercomputer, as well as prior access to it, are not required.
Course materials
All course materials, including slides, notes, and practical exercises, are provided under the following license: Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0). For more details on the license, please consultthis page.
To view the dates of the upcoming sessions for this training, go to the following page:
Registration
CNRS/French university staff | External participants |
Are you a member of CNRS or a French university staff? Your registration is free via our server. | Our training is aimed at all professionals from companies, public bodies and individuals. |