openshift-python-mpi

OpenShift

Instructions for setting this up on OpenShift

Set up the project

Get the project

$ git clone https://github.com/bchardim/openshift-python-mpi
$ cd openshift-python-mpi

Create Openshift Project

$ oc new-project gw-learning

Create the persistent shared storage needed for MPI cluster operation. In this case we are going to use NFS in RWX mode.

$ oc create -f storage/nfs-mpi-pv.yaml
persistentvolume/nfs-pv-mpi created

$ oc create -f storage/nfs-mpi-pvc.yaml
persistentvolumeclaim/nfs-pvc-mpi created

$ oc get pvc
NAME          STATUS   VOLUME       CAPACITY   ACCESS MODES   STORAGECLASS   AGE
nfs-pvc-mpi   Bound    nfs-pv-mpi   2Gi        RWX                           3s

Create needed ConfigMaps and Secrets

$ bash scripts/generate-mpi-configs.sh
$ bash scripts/generate-ssh-configs.sh
$ bash scripts/create-config-maps-and-secrets.sh

Create the OpenShift resources

$ oc process -f mpi-template.yml -p MPI_POD_CPU=1 -p MPI_POD_CPU_LIMIT=2 -p MPI_POD_MEMORY=512Mi -p MPI_POD_MEMORY_LIMIT=1024Mi -p MPI_BASE_IMAGE_URI=https://github.com/bchardim/openshift-python-mpi | oc create -f -

Run MPI Job

Run a sample job against 6 mpi pod cluster

$ oc scale dc mpi --replicas 6 && oc wait dc mpi --for condition=available

$ cd scripts
$ ./run-mpi-script-against-ocp-mpi-pods.sh mpi/mpi-hello-world.py

Calculate pi using 18000000 points against 6 mpi pod cluster

$ oc scale dc mpi --replicas 6 && oc wait dc mpi --for condition=available

$ cd scripts
$ ./run-mpi-script-against-ocp-mpi-pods.sh mpi/pi_mpi_calc.py 18000000
...
...
Calculated pi is 3.1415404000, error is 0.0000522536

Run MPI/ipyparallel Job using Jupyter Notebook

Get project route

$ oc get routes
NAME               HOST/PORT                        PATH   SERVICES         PORT    TERMINATION   WILDCARD
mpi-master-route   gw-learning.apps.ocp4.info.net          mpi-master-svc   <all>   edge          None

Execute sample notebook that calculates pi in parallel against your mpi cluster deployed on Openshift.

https://gw-learning.apps.ocp4.info.net/notebooks/notebooks/pi_calc/pi_calc.ipynb

Enjoy !

References

https://github.com/itewk/openshift-mpi-example