Sync meeting on EESSI test suite (2023 03 10)

EESSI sync meeting on software testing (2023-03-10)

Attending

• Caspar, Sam, Satish, Kenneth

Notes

• implement better support for cmd line specified valid_systems (issue #21)
• GROMACS test
  • control options for GROMACS command
  • gmx vs gmx_mpi => via executable option
• should we keep relying on hpctestlib from ReFrame?
  • not actively maintained?
  • why is gmx not tested in GROMACS test in hpctestlib?
    • asked Victor in ReFrame Slack
  • can we change behaviour of appending of executable_opts in GROMACS test in hpctestlib?
    • Sam will open a PR
• update ReFrame in EESSI pilot 2021.12?
  • can be done, but see https://github.com/EESSI/software-layer/issues/127 + https://github.com/easybuilders/easybuild-easyconfigs/pull/13844
  • Caspar will open PR to EESSI/software-stack to add ReFrame/4.1.0 module to 2021.12
    • see for example OpenFOAM PR: https://github.com/EESSI/software-layer/pull/195
    • need to patch 'bin/reframe' to make it use "python -S"
• better user-facing documentation for using EESSI test suite
  • not in README, but in EESSI docs
  • see https://eessi.github.io/docs/software_testing
  • create configuration file for EESSI test suite
    • see https://github.com/EESSI/test-suite#configuring-gpunon-gpu-partitions-in-your-site-config-file
  • using EESSI
    • module load ReFrame/4.1.0
    • module load EESSI-test-suite/0.1.0
    • • run ReFrame command to run GROMACS test
  • not using EESSI (using own software stack)
    • install ReFrame + EESSI-test-suite with EasyBuild
    • run
• share system-specific configuration files via https://github.com/EESSI/test-suite/tree/main/eessi/reframe/config

Notes 2023-02-23

• get PR #11 merged to improve GROMACS test
• start working on other tests (see eessi-demo)
  • OSU microbenchmarks: Satish
  • OpenFOAM: Caspar
  • Bioconductor: who?
  • TensorFlow: Caspar
• also involve other people involved in testing from MultiXscale in future meetings like this?