parallelization_tutorials

Using a Remote Cluster for Parallelized ER-MRL

1. Transfer Code to the Remote Cluster

rsync -av ER-MRL/ remote_cluster_address

2. Evolve Reservoirs in Parallel

• Use the provided slurm file for efficient parallelization during the evolution phase. To run it, use this command line and specify the evolution environment :

sbatch parallelized_evolve_res.slurm HalfCheetah-v4

In this example, we launch the evolution phase on the HalfCheetah environment. The other experiment parameters (experiment name, number of training timesteps ...) are already encoded in the slurm file, so you can easiely modify them from there, or add them as arguments of the file and specify them in command line.

3. Test ER-MRL Agents in Parallel

• Employ this slurm file to test ER-MRL agents with evolved reservoirs in parallel. Use this command line to execute it :

sbatch parallelized_test.slurm HalfCheetah-v4

4. Retrieve Experiment Data

Use the following scripts to synchronize data:

• Synchronize Hyperparameters Evolution
• Synchronize ER-MRL Agents' Performance during testing phase

Additional Information

• For detailed usage instructions with more complex evolutions setups (multiple reservoirs, generalization experiments ...), refer to the main readme.