Flash Info No 2024-18
This page was translated by an AI (LLM) with a cursory human check and is awaiting full review.
[TOOL_CALLS]Migration of the STORE on 22 and 23 July
[English version below]
Hello,
The STORE disk space will be completely unavailable on Monday 22 and Tuesday 23 July to migrate it to the new Lustre storage system installed as part of the Jean Zay H100 extension and the expansion of the WORK space. Therefore, please ensure that you do not submit any jobs using the STORE during this period (other jobs will continue to run normally).
As announced on 18 June, there will be a change in the STORE access policy on this occasion. It will no longer be possible to access this space from the compute nodes. Access to the STORE will be restored on Tuesday 23 July in the evening ONLY on the login nodes and on the "prepost", "visu", "compil" and "archive" partitions.
Until the end of August, it will still be possible to access the old STORE in read-only mode using the "$OLDSTORE" environment variable. This access method should be preferred in the weeks following the migration operation. Indeed, the data of the new STORE will then be available only on magnetic tapes, which could significantly slow down data access (up to several hours), while the rotating disk cache is repopulated with the most recently used data. Note that this new environment variable is already set so that you can anticipate the modification of your scripts.
As a reminder, the STORE is a space dedicated to the secure and long-term storage of archived data. Currently, there is redundancy of all data, stored both on rotating disks and magnetic tapes. The presence of data on rotating disks allows for relatively fast read/write access. In the future, only the most recently used data will be available on the rotating disk cache (still with a security copy on magnetic tapes). The rest of the data will be stored only on magnetic tapes (with two copies on different tapes to ensure data security) with much longer access times, incompatible with direct use from computations.
We invite you to modify your submission scripts if you access the STORE space directly from the compute nodes. To guide you, examples have been added at the end of our documentation on multi-step jobs: http://www.idris.fr/jean-zay/cpu/jean-zay-cpu-exec_cascade.html
Best regards, The IDRIS support team
Dear Jean Zay users,
The STORE disk space will be totally unavailable on Monday July 22nd and Tuesday July 23rd in order to migrate its data onto the new Lustre storage system installed in the framework of the Jean Zay H100 extension and the enlargement of the WORK disk space. Please make sure you do not submit any jobs using the STORE during this time (other jobs will continue to run normally).
As announced on June 18th, a change in the STORE access policy will take place after the migration, in that it won't be possible anymore to access this disk space from compute nodes. In turn, access to the STORE disk space will be again possible starting from Tuesday July 23rd evening, but only from login nodes and from the "prepost", "visu", "compil" and "archive" partitions.
Until the end of August, it will remain possible to access the old STORE using the "$OLDSTORE" environment variable. This way to access your archived data will be recommended in the weeks following the migration. Indeed, the data on the new STORE will first be available only on magnetic tape (with long access times, possibly up to several hours), while the rotating disk cache will be repopulated with the most recently used data. Note that this new environment variable is already defined so that you can modify your scripts in advance.
As a reminder, the STORE is a disk space dedicated to long term secured storage of archived data. In the current system, all the data is redundantly stored on rotating disks ("cache") and magnetic tapes, and its availability on rotating disks enables a relatively fast read/write access time. In the future, only the most recently used data will be available on the rotating disk cache, with a security copy on the magnetic tapes. The remainder of the data will be stored only on magnetic tapes (with a double copy on different tapes to guarantee its security) with a much longer access time, incompatible with a direct usage from compute nodes.
We invite you to change your submission scripts if you currently access the STORE space directly from the compute nodes. In order to help you, several examples have been added at the end of the multi-step jobs documentation: http://www.idris.fr/eng/jean-zay/cpu/jean-zay-cpu-exec_cascade-eng.html.
Best regards, The IDRIS support team