Introduce version file support into develop branch #1644

KateFriedman-NOAA · 2023-05-24T15:56:47Z

Description

This PR introduces the use of version files in the develop branch. This initial introduction will use version files for runtime only. The ability to force version files for build is included but commented out for now. A follow-up PR will turn on build version forcing when ready.

Tagging @DavidHuber-NOAA about Jet/S4 updates.

Resolves #671
Resolves #1625

Changes include:

Update module_base.*.lua modulefiles to use module version variables and remove hardcoded versions.
Introduce build.<platform>.ver, run.<platform>.ver files in the /versions folder.
Update sorc/link_workflow.sh to create build.ver and run.ver under /versions folder based on build.<platform>.ver and run.<platform>.ver.
Introduce sourcing of run.ver in ush/load_fv3gfs_modules.sh
Introduce sourcing of build.ver in sorc/build_all.sh but commented out for now. Components will continue setting their module versions for the time being.
Update HOMEens_tracker in config.vrfy to use tracker_ver from version files.
Replace obsproc version in HOMEobsproc setting in parm/config/gfs/config.base.emc.dyn to use obsproc_run_ver from version files.

Type of change

New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Clone and Build tests on Hera, Orion, WCOSS2 (no build changes though)
Cycled tests on Hera, Orion, WCOSS2 (1.5 cycles - reproduced control with develop)

Checklist

My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code, particularly in hard-to-understand areas
My changes need updates to the documentation. I have made corresponding changes to the documentation
My changes generate no new warnings
New and existing tests pass with my changes
Any dependent changes have been merged and published

- In move to WCOSS2 the transfer*list files were moved into a new transfer folder under the upper-level parm folder. Refs: NOAA-EMC#419

- The transfer*list files were updated in operations during the move from WCOSS1 to WCOSS2. - The beginning of the path within the transfer*list files was updated from: com/gfs/_ENVIR_ to: _COMROOT_/gfs/_SHORTVER_ Refs: NOAA-EMC#419

- Add release notes for GFSv16.1 and GFSv16.2 versions that were added into the operations branch but not yet in the develop branch. Refs: NOAA-EMC#419

* develop: Updated GFS transfer*list files from operations (develop) (NOAA-EMC#918)

- Add /gempak subfolder where needed in gempak ush scripts. - Remove unneeded commented out path settings from older iterations. Refs: NOAA-EMC#419

- Cleaning out older GFS version release notes. - Includes current GFSv16.2.1 release notes, will commit GFSv16.3 release notes with implementation this fall. - Will then keep only the latest release notes moving forward. Refs: NOAA-EMC#419

* develop: Add postsnd job when bufrsnd it on (NOAA-EMC#926)

- New folder called "versions" for holding .ver files - New build.ver for setting versions at buildtime - New run.ver for setting versions at runtime - New $target.ver files for setting additional non-ops developer versions for support target platforms (WCOSS2, Hera, Orion) Refs: NOAA-EMC#419

Refs: NOAA-EMC#419

* develop: Add GDASapp (first wave of JEDI changes) (NOAA-EMC#871)

* develop: WCOSS2 gempak ush scripts updates and cleanup of old release notes (NOAA-EMC#920)

* develop: change gdasechgres dependency to just gdasefcs01 instead of gdasefmn (NOAA-EMC#933) Remove obsolete platforms (WCOSS1, Dell, Cray, Theia) references. (NOAA-EMC#922) Optimize DA clone, build, and link (NOAA-EMC#931)

Refs: NOAA-EMC#419

- Add WCOSS2 block to machine-setup.sh - Update the Hera and Orion blocks to use module reset instead of module purge. - Add version file sourcing (build.ver and $target.ver). Refs: NOAA-EMC#419

Refs: NOAA-EMC#419

- Create modulefile.ww3.wcoss2.lua and workflow_utils.wcoss2.lua with version variables within for building WW3 and workflow_utils. Refs: NOAA-EMC#419

- Replace hardcoded module versions with version variables in runtime and build modulefiles for Hera, Orion, and Jet. - Module versions will be sources from new version files at build or runtime. Refs: NOAA-EMC#671

* develop: Initial commit of directory comparison tools (NOAA-EMC#934) Add preamble, convert to bash, and remove env (NOAA-EMC#929) minimal intervention to create a data-atmosphere xml (NOAA-EMC#936) Remove Cray, Dell, WCOSS1 from module-setup.sh.inc (NOAA-EMC#943) bring GDASApp jjobs and exscripts to global-workflow (NOAA-EMC#941)

- Version updates within build.ver, run.ver and target specific ver files for Hera and Orion. Refs: NOAA-EMC#671, NOAA-EMC#419

- Add version file sourcing to load_fv3gfs_module.sh for use at runtime. - Add WCOSS2 block to load_fv3gfs_module.sh. Refs: NOAA-EMC#419, NOAA-EMC#671

* develop: Remove SDATE=CDATE IAU block in NCO config.base (NOAA-EMC#963) Updates for P8 (NOAA-EMC#946) Fix GLDAS j-job link (NOAA-EMC#954) Add ocean post to archive dependencies (NOAA-EMC#949)

- Updated cmake_ver to 3.20.1 - Remove esmf_ver and cdo_ver; build.ver versions good on Hera Refs: NOAA-EMC#671

- Convert workflow_utils.jet.lua to use version variables instead of hardcoded versions Refs: NOAA-EMC#671

- Change references to "png" to "libpng" in modulefiles. - If using 2022 intel modules then it's libpng. Refs: NOAA-EMC#671

Refs: NOAA-EMC#671

- Build errors without loading w3nco, will reevaluate removing the w3nco module load later. Refs: NOAA-EMC#671

emcbot · 2023-05-27T08:00:50Z