smaller
bigger
print

Home |
French |
Search |

Institute for Development and Resources in Intensive Scientific Computing

Navigation du site

IDRIS

Overview
Staff
Supercomputers
Training courses
Contact us
Location Map

Resource Management

Scientific Management
Requesting resource allocations
Account Management
Registration of user machines
Forms
Extranet

For Users

Getting started
Machine availability
Jean Zay
Atomistic simulation
Artificial intelligence
FAQ
User support
Flash Info
Advanced support
Users Committee

News

PRACE Projects

Table des matières

Artificial Intelligence research on Jean Zay

Artificial Intelligence research on Jean Zay

This page lists useful documentation for researchers in artificial intelligence who are working on Jean Zay. The following is an extract from the complete documentation available on the Jean Zay page.

Tools available on Jean Zay

Getting started

Getting Started on Jean Zay for AI users

Requesting resource hours at IDRIS

Computing environment

Software for artificial intelligence
Python
Personal Python environment
Access to JupyterHub (JupyterLab, TensorBoard, ...)
Datasets available in $DSDIR storage space
Database management

Job execution on GPU partitions with Slurm

GPU Slurm partitions
Batch job commands
Interactive execution
Single-GPU code in a batch job
Collection of similar jobs: Job Array
SSH connection to a compute node
Python scripts for automated execution of GPU jobs (idr_pytools)

Visualization and post-processing tools

TensorBoard visualization tool
Profiling tools for TensorFlow and Pytorch applications

Deep neural network learning

Optimisation of GPU acceleration

AMP: Using mixed precision to optimize model learning
Accelerating calculations with the usage of Tensor Cores

Techniques of learning distribution on Jean Zay

Multi-GPU and multi-node distribution for model learning on Jean Zay
Database loading for distributed learning of a model
SyncBN layer for data parallelism

Benchmarks and best practices on Jean Zay

Performance tests of a Deep Learning training with and without Singularity containerisation

LLM usage

Hugging Face Accelerate *NEW*

Other applications in data science, Machine Learning, Big Data

RAPIDS: Accelerated data science on GPUs

CNRS.fr
Extranet
FAQ
Archives
Contacts
Location Map
Legal Notices