Skip to main content

Flash Info No 2025-01

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.
  • Table of Contents:

  • Happy New Year!

  • Next IDRIS UC Meeting: Wednesday 22 January 2025

  • Panoram'IA: Join us on Friday 24/01 at 10 am

  • IDRIS Training


  • Happy New Year!

IDRIS wishes all its users a very happy 2025!

  • Next IDRIS UC Meeting: Wednesday 22 January 2025

The next IDRIS User Committee (UC) meeting will take place on Wednesday 22 January 2025 at the IDRIS premises. Do not hesitate to send your requests to: cu-elus at idris.fr. More information: http://www.idris.fr/cu.html

  • Panoram'IA: Join us on Friday 24/01 at 10 am

IDRIS support invites you to "Panoram'IA" on Friday morning 24/01 at 10 am: the monthly live video magazine covering scientific and technical AI news. The live stream and replays are available on our YouTube channel "Un oeil sur l'IDRIS": https://www.youtube.com/@idriscnrs.

  • IDRIS Training

Register now for the upcoming IDRIS training sessions scheduled over the next few months.

Coming up very soon:

  • Practical Introduction to Deep Learning (PIDL), 3 and 4 February
  • Deep Learning Architectures (ArchDL), 5 and 6 February

Other scheduled training sessions:

  • MPI, 18 to 21 March
  • OpenMP, 26 to 28 March
  • Modern Scientific C++, 9 to 11 April
  • Introduction to OpenACC and OpenMP GPU, 16 to 18 April

For more information on the IDRIS training catalogue and registration procedures: http://www.idris.fr/formations/catalogue.html.


Death of Janine Connes

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

Janine Connes, founder of the CNRS Inter-Regional Electronic Computing Centre (CIRCÉ) in 1969 and its director until 1982, passed away on 28 November 2024 at the age of 98. Together with her husband Pierre Connes, she formed a high-flying scientific duo, with Pierre as the experimenter and Janine processing and analysing the results numerically. This pair established the Fourier Transform Infrared Spectroscopy method, which is of major importance in this field. The page on the University of California Los Angeles website dedicated to Mrs Connes attests to this. She also played a crucial role in the development of numerical simulation in France, enabling the CNRS to acquire the necessary resources to serve all scientific communities. She provides a detailed account of this saga in her book From the IBM 360/75 to the Jean Zay Supercomputer, written with the participation of Françoise Perriquet and published in 2022[^1]. We will briefly recall only the premises and the main stages here.

Flash Info No 2024-29

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

Adaptation to the new terms of the Anaconda license

[English version below]

Hello,

Since summer 2024, the use of Anaconda repositories has been subject to pricing (https://legal.anaconda.com/policies/). As IDRIS does not plan to purchase a license, a few measures have been put in place on Jean Zay to limit requests to paid repositories as much as possible.

1/ The new conda environments installed for you by IDRIS support will be provided using Miniforge and no longer using Anaconda. Older Anaconda-based environments will remain available and can still be completed on request. Support will take care to target open repositories such as conda-forge.

2/ The behavior of any existing conda environment on Jean Zay has been modified by deploying a configuration file /etc/conda/.condarc on all nodes with internet access (login nodes, prepost, compil, archive, visu). As a result, all installations performed by conda now target the open repository conda-forge as a priority.

3/ Despite the deployment of the new configuration file, some requests to Anaconda repositories may persist if you are using Anaconda or Miniconda. We ask you to be attentive during your installations. Finally, we strongly advise you to work with Miniforge from now on to avoid this problem. A “miniforge/24.9.0” module is already available, and new versions will be installed regularly. On the contrary, we no longer plan to maintain Anaconda modules in the future.

Please do not hesitate to contact assist@idris.fr if you have any question on this subject.

Best regards, The IDRIS Support Team


Hello,

Since summer 2024, the use of Anaconda repositories has been subject to pricing (https://legal.anaconda.com/policies/). As IDRIS does not plan to purchase a license, a few measures have been put in place on Jean Zay to limit requests to paid repositories as much as possible.

1/ The new conda environments installed for you by IDRIS support will be provided using Miniforge and no longer using Anaconda. Older Anaconda-based environments will remain available and can still be completed on request. Support will take care to target open repositories such as conda-forge.

2/ The behavior of any existing conda environment on Jean Zay has been modified by deploying a configuration file /etc/conda/.condarc on all nodes with internet access (login nodes, prepost, compil, archive, visu). As a result, all installations performed by conda now target the open repository conda-forge as a priority.

3/ Despite the deployment of the new configuration file, some requests to Anaconda repositories may persist if you are using Anaconda or Miniconda. We ask you to be attentive during your installations. Finally, we strongly advise you to work with Miniforge from now on to avoid this problem. A “miniforge/24.9.0” module is already available, and new versions will be installed regularly. On the contrary, we no longer plan to maintain Anaconda modules in the future.

Please do not hesitate to contact assist@idris.fr if you have any question on this subject.

Best regards, The IDRIS Support Team


Licence restrictions for using Alphafold3 on Jean Zay

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

Deepmind has open-sourced Alphafold 3 and made it available on GitHub. However, the model weights are subject to a licence that makes it impossible to provide them to all IDRIS users.

https://github.com/google-deepmind/alphafold3/blob/main/WEIGHTS_TERMS_OF_USE.md

Indeed, a number of people using IDRIS resources are not part of the academic world.

We will contact Deepmind to see if it is possible in our situation to share the weights. While waiting for a response, we will apply the following procedure:

  • IDRIS will install the code so that it is accessible to all users.
  • Each person wishing to use Alphafold 3 must obtain authorisation from Deepmind via the following form https://forms.gle/svvpY4u2jsHEwWYS6. Please note that the response may take up to 2 weeks.
  • The weights must be installed locally on the account of each person wishing to use Alphafold 3.

We have requested the model weights to perform internal tests.

Once these tests are completed, we will publish documentation on the website with all the steps to run Alphafold 3.

Flash Info No 2024-28

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.
  • Panoram'IA: Appointment Friday 15/11 at 10 am
  • DSDIR not accessible from the H100 partition
  • Shutdown of the old STORE space at the end of November 2024
  • IDRIS Training

  • Panoram'IA: Appointment Friday 15/11 at 10 am

IDRIS support invites you this Friday morning 15/11 at 10 am to "Panoram'IA": the monthly live video magazine that covers the scientific and technical news of AI. This session's programme includes: AI news, an expert intervention: "QROA: The art and science of jailbreaking LLMs" and our selection of papers with Papers Storm. The live stream and replays are available on our YouTube channel "Un oeil sur l'IDRIS": https://www.youtube.com/@idriscnrs.

  • DSDIR not accessible from the H100 partition

We would like to remind you that the DSDIR space, where we store public datasets and models useful to the community (http://www.idris.fr/jean-zay/gpu/jean-zay-gpu-dataset.html), is currently not accessible from the new H100 partition of Jean Zay. Equipment is currently being installed to enable its migration to a new Lustre-based storage system that will be accessible from all partitions. This new space should be operational by the end of 2024. In the meantime, if you need to use a dataset or model available in the DSDIR from an H100 node, we recommend copying it to your SCRATCH.

  • Shutdown of the old STORE space at the end of November 2024

Following the migration of the STORE space to a new Lustre-based storage system during the summer, the old STORE space remained accessible in read-only mode using the environment variable "$OLDSTORE" (http://www.idris.fr/jean-zay/modifications-extension-jean-zay-h100.html#cas_particulier_du_store). The definitive shutdown of this space will take place at the end of November 2024.

  • IDRIS Training

Remember to register now for the IDRIS training sessions scheduled for the rest of the year and early 2025:

  • HPC Debugging, 22 November
  • SIMD Vectorisation, 26 November
  • Optimised Deep Learning on Jean Zay, 14, 15, 16 and 17 January
  • MPI, 18, 19, 20 and 21 March
  • OpenMP, 26, 27 and 28 March

For more information on the IDRIS training catalogue and registration procedures: http://www.idris.fr/formations/catalogue.html.


Flash Info No 2024-27

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

[English version below]

Hello,

Following today's maintenance (Tuesday 1st October), several changes may impact you.

  • QoS name changes for the A100 partition

To better manage resource sharing on the machine, specific QoS have been defined for the A100 partition. If you explicitly used the QoS "qos_gpu-t3" or "qos_gpu-dev" in your job submissions targeting this partition, you will need to use "qos_gpu_a100-t3" or "qos_gpu_a100-dev" instead. The QoS "qos_gpu_a100-t3" is used by default and can be omitted.

The CPU and V100 partitions are not affected by this change.

The documentation has been updated accordingly: http://www.idris.fr/jean-zay/gpu/jean-zay-gpu-exec_partition_slurm.html#les_qos_disponibles.

  • Use of QoS via JupyterHub

If you wish to specify a QoS when using the Slurm launcher on JupyterHub, you will now need to specify it manually in the "Extra #SBATCH directives" field.

  • JupyterHub IP address change

The IP address of our JupyterHub instance has been modified. It is now 130.84.132.56. This change may impact you if your organisation applies IP address filtering for outgoing connections. If you encounter difficulties connecting to JupyterHub, we suggest contacting your IT service to inform them of this change.

As a reminder, the range of IP addresses used for IDRIS machines and services is as follows: 130.84.132.0/23. We recommend authorising the entire range rather than specific IP addresses to avoid being affected by future internal changes to our infrastructure.

  • Opening of the H100 partition

Users who have already obtained H100 hours can now use them. You can refer to the example below:

#!/bin/bash
#SBATCH --job-name=mon_travail # nom du job
#SBATCH -A xyz@h100 # comptabilite a utiliser, avec xyz le trigramme de votre projet
#SBATCH -C h100 # pour cibler les noeuds H100
# Ici, reservation de 3x24=72 CPU (pour 3 taches) et de 3 GPU (1 GPU par tache) sur un seul noeud :
#SBATCH --nodes=1 # nombre de noeud
#SBATCH --ntasks-per-node=3 # nombre de tache MPI par noeud (= ici nombre de GPU par noeud)
#SBATCH --gres=gpu:3 # nombre de GPU par noeud (max 4 pour les noeuds H100)
# Sachant qu'ici on ne reserve qu'un seul GPU par tache (soit 1/4 des GPUs),
# l'ideal est de reserver 1/4 des CPU du noeud pour chaque tache:
#SBATCH --cpus-per-task=24 # nombre de CPU par tache (1/4 des CPUs ici)
# /!\ Attention, "multithread" fait reference a l'hyperthreading dans la terminologie Slurm
#SBATCH --hint=nomultithread # hyperthreading desactive

Note that the default modules are not compatible with the H100 partition. To use the software environment specific to this partition, you must load the "arch/h100" module: http://www.idris.fr/jean-zay/cpu/jean-zay-cpu-doc_module.html#modules_compatibles_avec_la_partition_gpu_p6. This must be done in your submission scripts as well as in your terminal if you need to compile codes.

If you do not yet have H100 hours, the project manager can make a request on the eDARI portal if necessary.

Do not hesitate to contact assist@idris.fr if needed.

Best regards, The IDRIS support team


Dear Jean Zay user,

Several changes might affect you after today's maintenance operations (Tuesday October 1st):

  • QoS name changes for the A100 partition

In order to more precisely manage the resource sharing of the machine, specific QoS have been defined for the A100 partition. If you used to explicitly specify "qos_gpu-t3" or "qos_gpu-dev" in your Slurm jobs targeting the A100 partition, you now have to use "qos_gpu_a100-t3" or "qos_gpu_a100-dev" instead. Note that the "qos_gpu_a100-t3" QoS is used by default and may be omitted.

The CPU and V100 partitions are not affected by these changes.

The online documentation has been updated: http://www.idris.fr/eng/jean-zay/gpu/jean-zay-gpu-exec_partition_slurm-eng.html#available_qos

  • Use of QoS through JupyterHub

If you wish to specify a QoS when using Slurm on JupyterHub, you now have to do it manually in the "Extra #SBATCH directives" field.

  • JupyterHub IP address change

The IP address of our JupyterHub instance has been modified. It is now 130.84.132.56. This change might impact you if your institution applies an IP address filtering of outgoing connections. If you run into difficulties when connecting to JupyterHub, we invite you to contact your local administrator to mention this change.

As a reminder, the set of IP addresses used for the IDRIS machines and services is the following: 130.84.132.0/23. We recommend authorising the complete set rather than specific IP addresses so as not to be affected by potential future internal changes of our infrastructure.

  • Opening of the H100 partition

Users who were already granted H100 computing hours may now use them. An example submission script is as follows:

#!/bin/bash
#SBATCH --job-name=my_job # job name
#SBATCH -A xyz@h100 # account to use, with xyz the 3 letter code of your project
#SBATCH -C h100 # to target H100 nodes
# Example reservation of 3x24=72 CPU (for 3 tasks) and 3 GPU (1 GPU per task) on one node:
#SBATCH --nodes=1 # number of nodes
#SBATCH --ntasks-per-node=3 # number of MPI tasks per node (= number of GPU requested per node here)
#SBATCH --gres=gpu:3 # number of GPU requested per node (max. 4 for H100 nodes)
# Since here only one GPU per task is requested (i.e., 1/4 of the available GPUs)
# the best way to proceed is to book 1/4 of the node's CPU for each task:
#SBATCH --cpus-per-task=24 # number of CPU per task (1/4 of the CPUs here)
# /!\ Caution, "multithread" in Slurm vocabulary refers to hyperthreading.
#SBATCH --hint=nomultithread # hyperthreading deactived

Note that the default modules are not compatible with the H100 partition. In order to use the software environment dedicated to this partition, you need to load the "arch/h100" module: http://www.idris.fr/eng/jean-zay/cpu/jean-zay-cpu-doc_module-eng.html#modules_compatible_with_gpu_p6_partition. This is needed for your submission scripts but also in your shell when compiling codes.

If you do not have H100 computing hours yet, your project manager may ask for supplementary hours ("au fil de l'eau") on the eDARI portal if necessary.

Do not hesitate to contact assist@idris.fr if needed.

Best regards, The IDRIS support team

Flash Info No 2024-26

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

[TOOL_CALLS]Arrêt électrique : mardi 8 et mercredi 9 octobre 2024

[English version below]

Bonjour,

Une maintenance de l'infrastructure technique de l'IDRIS nécessitera la mise à l'arrêt du centre mardi 8 et mercredi 9 octobre prochains. La machine Jean Zay sera indisponible du mardi 8 octobre à 6h jusqu'au jeudi 10 octobre à 12h. L'espace STORE sera indisponible dès l'après-midi du lundi 7 octobre.

Le service de support aux utilisateurs sera fermé pendant ces deux jours. Le site web restera accessible et vous pourrez suivre la disponibilité des machines sur la page habituelle : http://www.idris.fr/statut.html.

Nous sommes désolés pour la gêne que cette opération pourrait occasionner.

Cordialement, L'équipe support de l'IDRIS


Hello,

A maintenance operation on the technical infrastructure of IDRIS will require the centre to be shut down completely on Tuesday 8th and Wednesday 9th October. The Jean Zay machine will be unavailable from Tuesday 8th October at 6 am until Thursday 10th October at noon. The STORE disk space will be unavailable starting from Monday 7th October in the afternoon.

User support will be closed for these two days. The website will remain accessible and you will be able to check the machine availability on the usual page: http://www.idris.fr/status.html.

We are sorry for any inconvenience this maintenance operation might cause.

Best regards, The IDRIS User Support Team

Flash Info No 2024-25

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.
  • Summary:

  • Panoram'IA: Join us on Friday 27/09 at 10 am

  • IDRIS Training


  • Panoram'IA: Join us on Friday 27/09 at 10 am

IDRIS support invites you this Friday morning 27/09 at 10 am to "Panoram'IA": the monthly live video magazine that covers the scientific and technical news of AI. On the agenda for this session: AI news, TransformerEngine, HyperCloning, and our selection of papers with Papers Storm. The live stream and replays are available on our YouTube channel "Un oeil sur l'IDRIS": https://www.youtube.com/@idriscnrs. The following sessions will take place on 18 October 🎃, 15 November, and 6 December 🎅.

  • IDRIS Training

Register now for the IDRIS training sessions scheduled for the rest of the year:

  • OpenMP, from 16 to 18 October
  • Practical Introduction to Deep Learning, on 4 and 5 November
  • Deep Learning Architectures, on 6 and 7 November
  • Deep Learning Launch Workshop, on 8 November
  • HPC Debugging, on 22 November
  • SIMD Vectorisation, on 26 November
  • Introduction to the PETSc Library, on 5 and 6 December

For more information on the 2024 IDRIS training catalogue and registration procedures: http://www.idris.fr/formations/catalogue.html.


Flash Info No 2024-24

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

Opération sur le gestionnaire de travaux Slurm le 1er octobre

[English version below]

Bonjour,

Dans le cadre de l'intégration de la nouvelle partition H100 à la machine Jean Zay, une opération est prévue sur le gestionnaire de travaux Slurm le mardi 1er octobre 2024 de 8h à 13h. La machine sera indisponible pendant cette période.

Contrairement aux opérations de maintenance habituelles, les travaux en attente qui n'auront pas pu s'exécuter avant la maintenance seront perdus. Il vous faudra les soumettre à nouveau au redémarrage de la machine.

De plus, la base de données contenant l'historique des travaux Slurm sera réinitialisée. Vous n'aurez donc plus accès aux informations concernant les travaux antérieurs à la maintenance via la commande "sacct". Néanmoins cela n'impactera pas la comptabilité des heures consommées visible via la commande "idracct".

Nous sommes désolés pour la gêne que cette opération pourrait occasionner.

Cordialement, L'équipe support de l'IDRIS


Hello,

As part of the integration of the new H100 partition to the Jean Zay machine, an operation is planned on the job scheduler Slurm on Tuesday, October 1st 2024 from 8am to 1pm. The machine will be unavailable during that time.

Unlike the usual maintenance operations, the pending jobs that could not run before the maintenance operation will be lost. You will have to resubmit them after the machine is back online.

Moreover, the database which stores the Slurm jobs history will be reset. This means you will not have access anymore to the information about past jobs using the "sacct" command. However, there will be no impact on the accounting of your computing hours visible using the "idracct" command.

We are sorry for any inconvenience this maintenance operation might cause.

Best regards, The IDRIS User Support Team

Flash Info No 2024-23

IDRIS
IDRIS
Computing center
⚠ INFORMATION
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.

Summary:

  • Next IDRIS UC Meeting: Thursday 26 September 2024
  • IDRIS at the Science Festival on 11 and 12 October 2024
  • IDRIS Training

  • Next IDRIS UC Meeting: Thursday 26 September 2024

The next User Committee (UC) meeting of IDRIS will take place on 26 September 2024 at the IDRIS premises. Do not hesitate to send your requests to: cu-elus at idris.fr. More information: http://www.idris.fr/cu.html

  • IDRIS at the Science Festival on 11 and 12 October 2024

Following the success of previous years, IDRIS is renewing the experience and participating again in the CNRS Unusual Visits organised as part of the Science Festival. Registration is open from 2 to 22 September 2024! For more information: http://www.idris.fr/annonces/idris-fete-de-la-science.html.

  • IDRIS Training

Remember to register now for the IDRIS training sessions planned for the rest of the year:

  • MPI, from 24 to 27 September
  • Jean Zay Workshop, on 3 and 4 October
  • OpenMP, from 16 to 18 October
  • Optimised Deep Learning on Jean Zay, from 22 to 25 October
  • Practical Introduction to Deep Learning, on 4 and 5 November
  • Deep Learning Architectures, on 6 and 7 November
  • Deep Learning Launch Workshop, on 8 November
  • HPC Debugging, on 22 November
  • SIMD Vectorisation, on 26 November
  • Introduction to OpenACC and OpenMP GPU, from 27 to 29 November
  • Introduction to the PETSc Library, on 5 and 6 December

For more information on the 2024 IDRIS training catalogue and registration procedures: http://www.idris.fr/formations/catalogue.html.


Your opinion matters!

To give your feedback, report an error, or suggest an improvement, click here:

quick anonymous questionnaire

This questionnaire is temporary and will take less than a minute, so take the opportunity!