Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add survey-based testing signals to the map #559

Open
capnrefsmmat opened this issue Oct 9, 2020 · 5 comments
Open

Add survey-based testing signals to the map #559

capnrefsmmat opened this issue Oct 9, 2020 · 5 comments
Labels
enhancement New feature or request Visualization Used to filter issues when synching with Asana

Comments

@capnrefsmmat
Copy link
Contributor

Now that the symptom surveys ask respondents if they have been tested and what the results were, we should consider adding these signals to the map. There are three of interest:

  • Percentage of people who were tested in the last 14 days (testing volume)
  • Percentage of those tests that were positive (test positivity)
  • Of people who were not tested, percentage who wanted to be tested

I'm not sure which of these we should present and how we should present them. For example, if we show test positivity, how do we clearly distinguish that signal from the Quidel signal?

This probably requires some careful thinking about what signals are most useful for public health. @RoniRos, any opinions here?

@capnrefsmmat capnrefsmmat added the enhancement New feature or request label Oct 9, 2020
@RoniRos
Copy link
Member

RoniRos commented Oct 9, 2020

I think that's a feature, not a bug. Antigen testing by one manufacturer is very different than overall testing. But even if it weren't, we are in the business of providing different measurements, not reconciling them. So I think we just need to be very descriptive. E.g. "COVID Antigen Test Positivity (Quidel)" and "COVID Test Positivity (Survey)".

@capnrefsmmat
Copy link
Contributor Author

I agree it's a feature. But from a user's perspective: When would I want to know specifically antigen test positivity, vs. when would I want to know overall positivity from the survey? Does comparing the two side-by-side help me draw any useful conclusions?

I know we've heard from officials that they already have too much data, so I'm wary of just putting more signals on the map without thinking of how we expect users to use them to make decisions, or if they'd be useful for that decision-making.

@RoniRos
Copy link
Member

RoniRos commented Oct 9, 2020

These are fair questions. I guess the answers may differ across different types of users.
Data savvy users may want to know whether the two measurements agree, as a way of assessing their reliability/robustness.
More casual users may prefer that we combine multiple measurements of the same underlying quantities and present only the combined signal.
We are going to face this exact problem also with Doctor Visits (Outpatient) and Hospital Admissions (Inpatient), as soon as our Change HealthCare (CHC) signals are ready.

@SumitDELPHI SumitDELPHI added the Visualization Used to filter issues when synching with Asana label Dec 2, 2020
@sgratzl
Copy link
Member

sgratzl commented Mar 11, 2021

is this issue still valid?

@capnrefsmmat
Copy link
Contributor Author

If we add one, it should be fb-survey smoothed_tested_positive_14d. However, we have not established whether it is comparable to other sources of test positivity rate, or whether it's subject to the same biases some of our other survey signals seem to have. We'd probably want to do that first to better understand it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Visualization Used to filter issues when synching with Asana
Projects
None yet
Development

No branches or pull requests

4 participants