generated from ENCCS/sphinx-lesson-template
-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
52 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,52 @@ | ||
## For using LEONARDO (EuroHPC) | ||
|
||
Note that the hands-on part was adjusted to LEONARDO from Tetralith (and previous workshops), so there are some differences. | ||
|
||
### User account and login | ||
|
||
See links sent out to the workshop participants for all information. | ||
|
||
### General information | ||
There is some detailed [LEONARDO user documentation available here](https://wiki.u-gov.it/confluence/display/SCAIUS/HPC+User+Guide). | ||
|
||
### Running jobs | ||
In each example for the hands-on part of the workshop, there's a job script available called "run.sh". The job script is submitted to the slurm job queue with | ||
|
||
sbatch run.sh | ||
|
||
one can check its progress with the command | ||
|
||
squeue -u username | ||
|
||
### Example job script | ||
Typically, the workshop job scripts prepared for running on LEONARDO looks like this | ||
|
||
#!/bin/bash | ||
#SBATCH -A EUHPC_TD02_030 | ||
#SBATCH -p boost_usr_prod | ||
#SBATCH --qos=boost_qos_dbg | ||
#SBATCH --time 00:15:00 | ||
#SBATCH -n 8 | ||
#SBATCH --ntasks-per-node=8 | ||
#SBATCH --cpus-per-task=1 | ||
#SBATCH --job-name=vaspjob | ||
|
||
module use /leonardo_scratch/fast/EUHPC_TD02_030/vasp_ws2024/modules | ||
module load VASP-6.4.3-cpu1 | ||
module load intel-oneapi-compilers/2023.2.1 | ||
module load intel-oneapi-mpi/2021.10.0 | ||
module load intel-oneapi-mkl/2023.2.0 | ||
module load hdf5/1.14.3--intel-oneapi-mpi--2021.10.0--oneapi--2023.2.0 | ||
|
||
export SRUN_CPUS_PER_TASK=$SLURM_CPUS_PER_TASK | ||
export OMP_NUM_THREADS=1 | ||
|
||
srun vasp_std | ||
|
||
since the examples are selected to be small and fast, only a few CPU cores (-n 8) on a LEONARDO boost partition node (in total 32 cores and 4 GPUs) is used. | ||
|
||
"module use" is for activating modules which were created for the present workshop, e.g. for VASP. Note that the modules used for building VASP on LEONARDO needs to be loaded (on Tetralith, it's sufficient to load the VASP module). | ||
|
||
While OpenMP was included in the present build, OMP_NUM_THREADS=1 is set since hybrid MPI/OpenMP calculations are not used in the examples. | ||
|
||
A basic analysis of the output can be done on the LEONARDO cluster, further analysis can also be made on a local computer. |