[CI] Use Spack + OCI buildcache when widely available for system MPI

[giordano]

Ref: https://github.com/haampie/spack-oci-buildcache-example

For example:

mose@Moses-MBP ~ % docker run --rm ghcr.io/haampie/spack-oci-buildcache-example:mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4 mpirun --version
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
HYDRA build details:
    Version:                                 3.4.3
    Release Date:                            General Availability Release
    CC:                              /home/runner/work/spack-oci-buildcache-example/spack-oci-buildcache-example/spack/lib/spack/env/gcc/gcc
    Configure options:                       '--disable-option-checking' '--prefix=/home/runner/work/spack-oci-buildcache-example/spack-oci-buildcache-example/spack/opt/spack/linux-ubuntu22.04-x86_64_v2/gcc-12.1.0/mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4' '--enable-shared' '--enable-romio' '--disable-silent-rules' '--disable-new-dtags' '--enable-fortran=all' '--enable-threads=multiple' '--with-ch3-rank-bits=32' '--enable-wrapper-rpath=yes' '--disable-alloca' '--with-pmi=simple' '--enable-fast=all' '--disable-cuda' '--enable-registration-cache' '--with-device=ch4:ofi' 'CC=/home/runner/work/spack-oci-buildcache-example/spack-oci-buildcache-example/spack/lib/spack/env/gcc/gcc' 'CXX=/home/runner/work/spack-oci-buildcache-example/spack-oci-buildcache-example/spack/lib/spack/env/gcc/g++' 'FC=/home/runner/work/spack-oci-buildcache-example/spack-oci-buildcache-example/spack/lib/spack/env/gcc/gfortran' 'F77=/home/runner/work/spack-oci-buildcache-example/spack-oci-buildcache-example/spack/lib/spack/env/gcc/gfortran' '--cache-file=/dev/null' '--srcdir=.' 'CFLAGS= -DNDEBUG -DNVALGRIND -O2' 'LDFLAGS=' 'LIBS=-lm ' 'CPPFLAGS= -DNETMOD_INLINE=__netmod_inline_ofi__ -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/src/mpl/include -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/src/mpl/include -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/modules/yaksa/src/frontend/include -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/modules/yaksa/src/frontend/include -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/modules/json-c -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/modules/json-c -D_REENTRANT -I/tmp/runner/spack-stage/spack-stage-mvapich-3.0b-hoybelw6cwy4n3zdw2hgc3jziwaaisu4/spack-src/src/mpi/romio/include' 'MPLLIBNAME=mpl'
    Process Manager:                         pmi
    Launchers available:                     ssh rsh fork slurm ll lsf sge manual persist
    Topology libraries available:            hwloc
    Resource management kernels available:   user slurm ll lsf sge pbs cobalt
    Demux engines available:                 poll select

This is very work-in-progress at the moment (spack/spack#38358), but it will save us lots of time to install all various system MPI libraries.

CC: @haampie

[giordano]

Can one of the admins of the organisation make packages public, or at least those in https://github.com/JuliaParallel/github-actions-buildcache (settings)? CC: @simonbyrne @vchuravy

[simonbyrne]

Did someone do it? or do i still need to do something?

[giordano]

Valentin did it, now testing in #788