Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QCEFF Table #553

Merged
merged 131 commits into from
Nov 2, 2023
Merged

QCEFF Table #553

merged 131 commits into from
Nov 2, 2023

Commits on Oct 2, 2023

  1. Configuration menu
    Copy the full SHA
    0b24793 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6746fa9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    eb62190 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6d9b013 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5cca696 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    ce94286 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    51591c4 View commit details
    Browse the repository at this point in the history
  8. New subroutine to read through the values in the QCF table and assign…

    … them to the variables in the qcf_table_data_type
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    9821eef View commit details
    Browse the repository at this point in the history
  9. Removing qcf table data types from assim_tools_mod and reorganizing s…

    …o that these type structs are only used in algorithm_info_mod
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    6c52bcf View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    a81234b View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    ecacbe2 View commit details
    Browse the repository at this point in the history
  12. Adding draft subroutine write_qcf_table to test that values are being…

    … read in correctly; removed rowheaders argument from subroutines where not needed
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    4b5312f View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    e90f049 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    705d9b4 View commit details
    Browse the repository at this point in the history
  15. Replacing conditionals and hard coded values with qcf_table_data in o…

    …bs_inc_info subroutine
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    9e1190f View commit details
    Browse the repository at this point in the history
  16. Replacing conditionals and hard coded values with qcf_table_data in o…

    …bs_error_info subroutine
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    6a78ae7 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    0bb0db8 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    0bc2492 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    384bd30 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    b5d27b2 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    fbfe5f3 View commit details
    Browse the repository at this point in the history
  22. Moving the allocation and deallocation of qcf table data from assim_t…

    …ools_mod to filter_main in filter_mod
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    5a093b1 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    54f7ea0 View commit details
    Browse the repository at this point in the history
  24. Configuration menu
    Copy the full SHA
    399d08d View commit details
    Browse the repository at this point in the history
  25. Reorganizing the subroutines so that init_algorithm_info_mod is at th…

    …e top of algorithm_info_mod
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    2a1e7c5 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    c93286a View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    39c9da1 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    00e82ca View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    08b853c View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    ff04086 View commit details
    Browse the repository at this point in the history
  31. Configuration menu
    Copy the full SHA
    7e921e0 View commit details
    Browse the repository at this point in the history
  32. Adding check that all QTYs in the table exist in DART using get_index…

    …_for_quantity; adding checks that upper bounds are greater than lower bounds
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    73ded1d View commit details
    Browse the repository at this point in the history
  33. Replacing open and close of qcf_table file with open_file and close_f…

    …ile of utilities_mod - this fixes the issue with writing to the dart_log
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    61adbdc View commit details
    Browse the repository at this point in the history
  34. Configuration menu
    Copy the full SHA
    58c61e4 View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    ef28acf View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    5721aa7 View commit details
    Browse the repository at this point in the history
  37. Configuration menu
    Copy the full SHA
    9f4a6bd View commit details
    Browse the repository at this point in the history
  38. Configuration menu
    Copy the full SHA
    a1aa775 View commit details
    Browse the repository at this point in the history
  39. Configuration menu
    Copy the full SHA
    a24743c View commit details
    Browse the repository at this point in the history
  40. Removing unnecessary files

    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    fee0969 View commit details
    Browse the repository at this point in the history
  41. Adding the yaml_to_table.py script and example yaml file qcf_table_te…

    …mplate.yaml to the DART repo at /DART/assimilation_code/programs/qcf_table/. The location of these files in the repo may change
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    b97ff55 View commit details
    Browse the repository at this point in the history
  42. Configuration menu
    Copy the full SHA
    cba8c14 View commit details
    Browse the repository at this point in the history
  43. Adjusting the YAML template file; removing trailing spaces from possi…

    …ble_dist_types strings
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    eb6e97e View commit details
    Browse the repository at this point in the history
  44. Configuration menu
    Copy the full SHA
    22931cf View commit details
    Browse the repository at this point in the history
  45. Configuration menu
    Copy the full SHA
    71d1190 View commit details
    Browse the repository at this point in the history
  46. Adding &probit_transform_nml to input.nml files for lorenz 63 and 96 …

    …- this will allow for the build and run lorenz github actions to pass
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    feb74c6 View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    82aa5de View commit details
    Browse the repository at this point in the history
  48. Fixing unintentional additions to lorenx 96 and 63 input.nml files; r…

    …emoving use_algorithm_info_mod nml option
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    80cd943 View commit details
    Browse the repository at this point in the history
  49. Configuration menu
    Copy the full SHA
    bf92ac4 View commit details
    Browse the repository at this point in the history
  50. Adding &probit_transform_nml and qcf_table_filename option to model's…

    … input.nml files (9var, am2, bgrid_solo)
    mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    f3d1826 View commit details
    Browse the repository at this point in the history
  51. Configuration menu
    Copy the full SHA
    78ccc5e View commit details
    Browse the repository at this point in the history
  52. Configuration menu
    Copy the full SHA
    64a9f74 View commit details
    Browse the repository at this point in the history
  53. Configuration menu
    Copy the full SHA
    f9e490c View commit details
    Browse the repository at this point in the history
  54. Configuration menu
    Copy the full SHA
    d4de789 View commit details
    Browse the repository at this point in the history
  55. add tests for various bounds options

    currently the "lower bound only" test is failing
    because the upper < lower check happens always rather then only when
    you have two bounds
    hkershaw-brown authored and mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    7733026 View commit details
    Browse the repository at this point in the history
  56. Configuration menu
    Copy the full SHA
    7271768 View commit details
    Browse the repository at this point in the history
  57. fix: need to check that a qty is bounded above and below before check…

    …ing invalid bounds
    
    otherwise missing_r8 -88888 value for the upper bound is "less than" the lower bound
    hkershaw-brown authored and mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    23a60cf View commit details
    Browse the repository at this point in the history
  58. Configuration menu
    Copy the full SHA
    0960c67 View commit details
    Browse the repository at this point in the history
  59. replace kind with qty

    kind is outdated terminolgy for quantity
    #545 (comment)
    hkershaw-brown authored and mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    aa03af1 View commit details
    Browse the repository at this point in the history
  60. add two tests for table read: incorrect filter kind, incorrect distri…

    …bution
    
    Currently the algorithm_info_mod does not catch these on table read
    hkershaw-brown authored and mjs2369 committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    fb53f56 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Fixing incorrect comments

    mjs2369 committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    bcc657f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    040b82d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d59e3c1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d8addde View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    6a5fbb6 View commit details
    Browse the repository at this point in the history
  6. Moving the conversions for dist_type and filter_kind from string to i…

    …nteger value to read_qcf_table, when the type is filled in
    mjs2369 committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    320caed View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    b46a922 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Configuration menu
    Copy the full SHA
    f2d20b7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5f41368 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. Configuration menu
    Copy the full SHA
    46dbd96 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Removing rectangular_quadtrature and gaussian_likelihood_tails from t…

    …he QCF table and obs_inc_info
    mjs2369 committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    42bec45 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Removed sort_obs_inc from the QCF table; removed code related to the …

    …sort_obs_inc logical from filter_assim and obs_increment in assim_tools_mod.f90 and obs_inc_info in algorithm_info_mod.f90
    mjs2369 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    55e4c6e View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Configuration menu
    Copy the full SHA
    b0a941c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fb045f7 View commit details
    Browse the repository at this point in the history
  3. Updating the documentationc- adding info on the QCF and probit transf…

    …orm tools to DART's main documentation page; removing outdated docs for using these tools
    mjs2369 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    85ecf53 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5573b6d View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Configuration menu
    Copy the full SHA
    bd1aa85 View commit details
    Browse the repository at this point in the history
  2. Revoving global filter_kind from assim_tools_mod and &assim_tools_nml…

    …; making args for obs_inc_info intent(out)
    mjs2369 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    17fb9ed View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4d15ff8 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f19bb1c View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. Configuration menu
    Copy the full SHA
    385777e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4b3dfb7 View commit details
    Browse the repository at this point in the history
  3. More doc fixes

    mjs2369 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    5c03e3c View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. Configuration menu
    Copy the full SHA
    f38ddc7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    24c663c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f45123c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b96593b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    9b3b6fb View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    a0ed835 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c529ecf View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    4481d2d View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    8eaeb5b View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    8fd9632 View commit details
    Browse the repository at this point in the history
  11. Adding the pre-made .csv files for the lorenx 96 tracer examples to /…

    …lorenz_96_tracer_advection/work. Removing the information describing how to download the .csv files from Google Sheets from the QCF examples doc
    mjs2369 committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    8cb0ad8 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Configuration menu
    Copy the full SHA
    8dd039a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    bdfdbb9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    360ab2c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    dfb467f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    a597dd8 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d9cbc8d View commit details
    Browse the repository at this point in the history
  7. Using the public parameters from algorithm_info_mod.f90 for compariso…

    …ns with filter_kind value
    mjs2369 committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    defd770 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    c1f7921 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. Configuration menu
    Copy the full SHA
    dc015b0 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Configuration menu
    Copy the full SHA
    9669bfb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4b8992a View commit details
    Browse the repository at this point in the history
  3. updated developer tests for qceff to match latest qcf_table

    removed columns:
    rectangular_quadrature	gaussian_likelihood_tails	sort_obs_inc	spread_restoration
    hkershaw-brown committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    8764a11 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    728b0be View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d0f2e30 View commit details
    Browse the repository at this point in the history
  6. fix qcf_table_lower_bound_only.txt to match latest

    Currently the when lower_bound=.false. the lower bound is set the value lower_bound rather MISSING_R8
    hkershaw-brown committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    461aa6b View commit details
    Browse the repository at this point in the history
  7. store specified qtys as integers because qtys in dart are integer par…

    …ameters
    
    replace kind with qty
    hkershaw-brown committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    70e296f View commit details
    Browse the repository at this point in the history
  8. Comment tidy: kind, type, qty cleanup and remove out-of-date comment

    whitespace tidy for readability
    hkershaw-brown committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    7935f55 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Configuration menu
    Copy the full SHA
    bbc3b40 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d6ff8f7 View commit details
    Browse the repository at this point in the history
  3. doc: how-to for qcf table

    moved QCEFF out of getting started.
    
    replaced Quantile Conserving and Probit Transform Filtering Tools
    with Quantile Conserving Ensemble Filtering Framework because the
    docs refer to QCEFF
    hkershaw-brown committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    24c4880 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Configuration menu
    Copy the full SHA
    c9b579e View commit details
    Browse the repository at this point in the history
  2. probit_transform defaults

    fix_bound_violations        = .false.,
    use_logit_instead_of_probit = .false.,
    do_inverse_check            = .false.,
    
    removed duplicate &probit_transform_nml
    from lorenz_96_tracer_advection input.nml
    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    61c202b View commit details
    Browse the repository at this point in the history
  3. two qtys are bounded

    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    71cdaf0 View commit details
    Browse the repository at this point in the history
  4. Jeff edits for index.html

    defaults: filter_kind EAKF, dist_type NORMAL_DISTRIBUTION
    code changed to match Jeffs edits.
    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    dac1f96 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5583e39 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    8b77d19 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    7ad9f3c View commit details
    Browse the repository at this point in the history
  8. doc: grammar

    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    c95611e View commit details
    Browse the repository at this point in the history
  9. doc: remove filter_kind from assim_tools_mod namelist info

    update error message (filter_kind not a namelist option)
    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    d67be0a View commit details
    Browse the repository at this point in the history
  10. rename all things qcf to qceff

    The offical name:
    Quantile-Conserving Ensemble Filter Framework
    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    254f59a View commit details
    Browse the repository at this point in the history
  11. developer test for lower case in qceff table

    currently failing
    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    072328a View commit details
    Browse the repository at this point in the history
  12. developer test for lower case dist_type

    currently failing, need to_upper on all string inputs in algorithm_info_mod
    hkershaw-brown committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    2704865 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. fix: upper case for string inputs

    changed if statements to case, so to_upper called once before the
    case statement
    hkershaw-brown committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    43f43a0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8851261 View commit details
    Browse the repository at this point in the history
  3. fix: qceff_table_filename now a namelist option in algorithm_info_mod

    This is so perfect_model_obs and filter_mod can use the algorithm_info_mod
    
    remove obsolete use_algorithm_info_mod namelist option from perfect_model_obs
    perfect model obs initialize and end algorithm_info_mod
    
    qceff_table_filename removed from filter_nml
    algorithm_info_mod example.nml
    
    update example.nmls to match latest options (removed filter_kind)
    adding algorithm_info_nml to model input.nmls
    
    The developer_tests/qceff will not work with this (passing in a filename)
    hkershaw-brown committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    ae9b6d9 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. Configuration menu
    Copy the full SHA
    dd0a96b View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Configuration menu
    Copy the full SHA
    876963e View commit details
    Browse the repository at this point in the history