Calcul Québec : Data parallelism on the clusters [online, CIP202]
Date: 26 March 2025 @ 17:30 - 19:30
Registration:: https://www.eventbrite.ca/e/1112677190429
Learn how to submit a large number of small jobs to the scheduler
Managing a large number of short calculations can become a headache when you try to submit hundreds or thousands of jobs to the scheduler, which imposes limitations.
In this workshop, we present various ways to group short calculations in a smaller number of jobs that can be more conveniently submitted to the job scheduler.
Plan:
- Introduction to data parallelism
- Job arrays
- Parameter sweeps with GNU Parallel
- Other tools - META-Farm and GLOST
Keywords: HPC
Venue: Online
Activity log