Skip to content

meeting 2023 04 06

Bob Dröge edited this page Apr 6, 2023 · 1 revision

Notes for 2023-04-06 meeting

  • date & time: Thu 6 Apr 2023 - 14:00 CEST (12:00 UTC)
    • (every first Thursday of the month)
  • venue: (online, see mail for meeting link, or ask in Slack)
  • agenda:
    • Quick introduction by new people
    • EESSI-related meetings in last month (incl. BioHackathon report)
    • Progress update per EESSI layer (incl. build-and-deploy bot + test suite)
    • EESSI pilot repository
    • AWS/Azure sponsorship update
    • Update on MultiXscale EuroHPC project (incl. kickoff meeting)
    • Upcoming events
    • Q&A

Slides

Meeting notes

(by Kenneth)

Quick introduction by new people

  • ...

EESSI-related meetings in last month

(see slides)

  • difference between EESSI and containers should be covered in our documentation...
    • notes from Australian BioCommons meeting could be a good starting point
    • containers were also raised in CASTIEL2 meeting as a first approach to distribute software developed by CoEs, which got a lot of pushback (see also meeting notes via Alan/Kenneth)
    • can also look at Christian's talk at EuroHPC Summit for what's needed to use containers in HPC context

Progress update per EESSI layer

Filesystem layer

(see slides)

  • we should go ahead with getting rid of EESSI pilot 2021.06 and init 2021.12 instead
Compatibility layer

(see slides)

Software layer

(see slides)

  • are we missing optimization opportunities by not shipping *.pyc files?
  • Alan: missing PR for site-customize.py that EasyBuild includes in the Python installation
    • to fix problem with picking up on .so
    • should be conditional on use of RPATH + not setting $LD_LIBRARY_PATH
  • Kenneth will get in touch with Alan/Bob/Caspar to set up a merge sprint for EasyBuild PRs related to EESSI
    • to be included with upcoming EasyBuild v4.7.2 release...
Build-and-deploy bot

(see slides)

  • lesson learned from efforts with building software layer in NESSI
    • could be beneficial to build in two different setups, to catch problems that pop up in one but not in another
  • short-term NESSI is used for experimenting with bot for building software layer, and learn from what goes wrong
    • long-term the intent is to build stuff on top of EESSI
    • some features are already being in implemented in bot + eessi_container.sh script that facilitate building for a non-EESSI CVMFS repository
EESSI test suite
  • proof-of-concept implementation of GROMACS test is now more general/configurable
    • will be used as blueprint for additional tests
  • should also have a "getting started" page in documentation for EESSI test suite
EESSI pilot repository

(see slides)

AWS/Azure sponsored credits

(see slides)

  • planning to ask AWS for additional sponsored credits by summer as current batch of credits runs out

MultiXscale EU project

(see slides)

  • ...

Upcoming events

Q&A

  • usage tracking
    • init script could be replaced by variant symlink (could be done for 2023.04 script)
    • opens the door for customized init scripts that track how EESSI is used (for example in AWS, Azure, ...)
    • can also include customizations, like UCX environment variables, Lmod configuration, alternate module trees, etc.
  • new sync meeting for compat layer should be planned
    • Tue 11 April 2023 at 13:00 CEST?
  • issue to track which packages should be removed from compat layer
Clone this wiki locally