Skip to main content

Parallelization of AI codes

Parallelization of AI codes

📄️Data loading for distributed training

Data loading for distributed training

📄️data parallelism

data parallelism

📄️Model parallelism

Model parallelism

📄️Accelerate

Usage of the HuggingFace accelerate library in single and multi-node

📄️Parallélisme hybride (modèle et données)

Parallélisme hybride (modèle et données) multi-nœuds et multi-GPU

Your opinion matters!

To give your feedback, report an error, or suggest an improvement, click here:

quick anonymous questionnaire

This questionnaire is temporary and will take less than a minute, so take the opportunity!