-
Notifications
You must be signed in to change notification settings - Fork 172
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove RUNDIRS before running CI cases to cover re-run events #3076
Remove RUNDIRS before running CI cases to cover re-run events #3076
Conversation
Checkout Failed on Hera in Build# 2: Error cloning remote repo 'origin' |
Checkout failed for gfs but not for gefs on a basic git command on Hera. Simply restarting CI in attempts to repeat the error. |
CI Passed on Hercules in Build# 1
|
CI Passed on Hercules in Build# 17
|
CI Passed on Hera in Build# 18
|
Checkout Failed on Orion in Build# 19: Error fetching remote repo 'origin' |
1 similar comment
Checkout Failed on Orion in Build# 19: Error fetching remote repo 'origin' |
Massive failure of scm checkout of global-workflow on Orion.
|
PR description needs to be updated before merging. |
…MC#3076) This Pr removes **pslot** dir (with hash) from local archive folder on CI case completion and also adds `cleanup_experiment` function in the BASH utilities to clean up after a CI case runs. This change consolidates cleanup actions and adds functionality to clean the local archive folders. Key changes: - Fixes bug for cleaning up the `RUNDIRS` directory before new experiments are run in the case the pipeline is being ran for a second time - Updated `$HOMEgfs/ci/scripts/check_ci.sh` to use the new `cleanup_experiment` function under the BASH CI system. - Added `cleanup_experiment `function in `$HOMEgfs/ci/scripts/utils/ci_utils.sh` to handle various cleanups including: - COMROOT/EXPDIR per case - ARCDIR and ATADIR directories for archive - STMP/RUNDIRS/${PSLOT} - Added get config var from EXPDIR utility [get_config_var.py](https://github.com/NOAA-EMC/global-workflow/pull/2961/files#diff-b780733ae1d45917730364e09a6c510e79d4cc8cffad6d9020c7961c53b987bc) for getting config values in BASH Resolves NOAA-EMC#2954 Resolves NOAA-EMC#3066
Description
This Pr removes pslot dir (with hash) from local archive folder on CI case completion and also adds
cleanup_experiment
function in the BASH utilities to clean up after a CI case runs. This change consolidates cleanup actions and adds functionality to clean the local archive folders.Key changes:
RUNDIRS
directory before new experiments are run in the case the pipeline is being ran for a second time$HOMEgfs/ci/scripts/check_ci.sh
to use the newcleanup_experiment
function under the BASH CI system.cleanup_experiment
function in$HOMEgfs/ci/scripts/utils/ci_utils.sh
to handle various cleanups including:Resolves #2954, #3066
Type of change
Change characteristics
How has this been tested?
This PR still needs to be tested with the CI system which would effectively be a self-test.
# Checklist