Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates for GEOS-Chem within CESM2 - convective scavenging correction and MPI fixes #1993

Merged
merged 4 commits into from
Oct 19, 2023

Conversation

jimmielin
Copy link
Contributor

@jimmielin jimmielin commented Oct 17, 2023

Name and Institution (Required)

Name: Haipeng Lin
Institution: Harvard U.

Confirm you have reviewed the following documentation

Note, this PR is made based on 14.1.1 as it is targeting a point release under 14.1.x as well as merging into main. Due to changes in ucx_mod, there are merge conflicts against main.

Describe the update

  • Adds Input_Opt%correctConvUTLS for a CESM-only correction of buildup of soluble tracers in the UT/LS due to decoupling of wet scavenging and convective transport
  • Extends existing State_Diag%KppError to GEOS-Chem within CESM
  • Removes MPI_BCast in ucx_mod's NOXCOEFF_INIT in order to move it to a higher level

Changes to the UT/LS correction (implemented in fullchem_mod.F90) are important for results to be scientifically correct in GEOS-Chem within CESM (manuscript in prep.)

The changes to UCX_Mod are essential to supporting the spectral-element dynamical core in CESM, as otherwise the model will hang as mpi_bcast is a collective operation, but on the SE dycore not all cores operate on the same number of domain chunks.

Expected changes

These updates only affect GEOS-Chem within CESM and should be zero-diff for the full-chemistry benchmark simulation.

Reference(s)

Science updates for GEOS-Chem within CESM2 will be in a paper, in prep.

Photolytic SOA sink used for correcting convective scavenging of soluble tracers solely within CESM2 environment is based on Hodzic et al. (2016) ACP (https://acp.copernicus.org/articles/16/7917/2016/acp-16-7917-2016.pdf)

Related Github Issue(s)

Companion PR at geoschem/CAM#27

Copying @lizziel.

Thanks!

@lizziel lizziel self-requested a review October 19, 2023 15:15
@lizziel lizziel self-assigned this Oct 19, 2023
@lizziel lizziel changed the base branch from main to dev/14.1.2 October 19, 2023 15:21
Copy link
Contributor

@lizziel lizziel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Please add a section in the changelog.

@jimmielin jimmielin changed the title [WIP] Updates for GEOS-Chem within CESM2 - convective scavenging correction and MPI fixes Updates for GEOS-Chem within CESM2 - convective scavenging correction and MPI fixes Oct 19, 2023
@jimmielin
Copy link
Contributor Author

Thanks Lizzie, changelog entries added and WIP lifted. Waiting for a test run with the existing f09 (0.9x1.25) grid to finish and confirm it is working right now.

…of soluble tracers, KppError diagnostic

These updates only affect GEOS-Chem within CESM2.

Signed-off-by: Haipeng Lin <[email protected]>
… CESM code.

This is because NOXCOEFF_INIT is called for all chunks, but not all CPUs in the same communicator have the same amount of chunks when running on the spectral-element dycore. This will result in MPI_BCast hanging as not all CPUs in the communicator are participating in a collective call.
A corresponding update inside CESM geoschem/chemistry.F90 is necessary to restore the original functionality and will be in a companion PR.

Signed-off-by: Haipeng Lin <[email protected]>
@jimmielin jimmielin force-pushed the hplin/14.1.1+cesmfix branch from e7c8375 to 0ddcae2 Compare October 19, 2023 16:12
@jimmielin jimmielin force-pushed the hplin/14.1.1+cesmfix branch from 0ddcae2 to f824252 Compare October 19, 2023 16:15
@jimmielin
Copy link
Contributor Author

Changelog updated and tested with f09 (FV dycore) and ne30 (SE dycore) grids. Should be good for review and merge. Thanks!

@lizziel lizziel merged commit b1cae32 into geoschem:dev/14.1.2 Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants