Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SOM 2011-15 #441

Open
eclee25 opened this issue May 15, 2023 · 12 comments
Open

SOM 2011-15 #441

eclee25 opened this issue May 15, 2023 · 12 comments
Labels
pop_pp Large pop discrepancies between WorldPop and UNWPP means extra post-processing may be required

Comments

@eclee25
Copy link
Collaborator

eclee25 commented May 15, 2023

No description provided.

@QLLZ
Copy link
Collaborator

QLLZ commented Jun 6, 2023

Data pull:
HASH: 6772ea9da4f43ddc3da11c494a573af2ca3dd3c8
config

@QLLZ
Copy link
Collaborator

QLLZ commented Jun 7, 2023

Model run:
HASH: 6772ea9da4f43ddc3da11c494a573af2ca3dd3c8

@javierps
Copy link
Collaborator

All checks look ok. Geometrical pattern in w although very similar values. Incidence rates are very high and homogenous, but consistent with gam input.

Suggestion: accept.

@eclee25
Copy link
Collaborator Author

eclee25 commented Jun 15, 2023

Most diagnostics ok with ~10% of observations and 11% and 8% of admin 1 and admin 2 genquant outputs with high Rhats. This may be because the subnational data are quite limited to one area of the country.

Opinion: Approve

@eclee25
Copy link
Collaborator Author

eclee25 commented Jun 25, 2023

On further investigation, the rates seem very high -- possibly because half the population of Mogadishu is missing so the overall population in the country is a bit low. This sfrac issue has been a problem in the past but we need to investigate further why sfrac is not handling this well...

@QLLZ
Copy link
Collaborator

QLLZ commented Jul 24, 2023

Config

Data pull & Model run:

HASH: 211913e

@QLLZ
Copy link
Collaborator

QLLZ commented Jul 25, 2023

country data report

@QLLZ
Copy link
Collaborator

QLLZ commented Jul 27, 2023

Super high rates, maybe due to underestimated population?

Slight convergency issue. Modeled cases look fine (there are some discrepancies in the observations, thus the modeled cases do not look very close to any of them for some years).

@eclee25 eclee25 added the pop_pp Large pop discrepancies between WorldPop and UNWPP means extra post-processing may be required label Jul 31, 2023
@eclee25
Copy link
Collaborator Author

eclee25 commented Aug 4, 2023

Mild convergence issue with sd_w but all other model diags look good. Population is >25% underestimated in every year which may contribute partially to the super high rates.
Approve with possible pop postprocessing adjustment

@javierps
Copy link
Collaborator

Sep 2023 Production run: convergence issues with std_w and ws, 10% of Rhats above threshold.

Suggestion: no-mixture run.

@eclee25
Copy link
Collaborator Author

eclee25 commented Sep 25, 2023

Table 6 OC 5032 had 10,600 cases in 2013 in the standard setting model run and only 7168 cases in the new no-mixture sd_w model run… There don’t appear to be any changes in data processing or the database so it’s a little odd.

All other diags look good. After reviewing the cause of these data discrepancies, assuming no problem with the data, Approve

@eclee25
Copy link
Collaborator Author

eclee25 commented Oct 24, 2023

@QLLZ determined that the discrepancy is related to differences in selecting which observation gets aggregated in a given set when there is an overlapping TL, TR, and location in the same OC. @javierps will add a branch that first sorts observations descending by sCh and then aggregates. We will not rerun things at the moment.

Approve no-mixture

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pop_pp Large pop discrepancies between WorldPop and UNWPP means extra post-processing may be required
Projects
None yet
Development

No branches or pull requests

3 participants