Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cleanup staging #2062

Open
minhkhul opened this issue Sep 18, 2024 · 0 comments
Open

Cleanup staging #2062

minhkhul opened this issue Sep 18, 2024 · 0 comments
Labels
data quality Missing data, weird data, broken data
Milestone
Data patching

Comments

@minhkhul
Copy link
Contributor

Context

This issue is copied from old jira PO board. Here are comments under the issue:

Kathryn Mazaitis
December 15, 2022 at 3:00 PM

Take a look at /common/covidcast/finish_batch_issue.sh on prod and see if that does what you're looking for?

Luke Neureiter
December 14, 2022 at 9:51 PM

Stray directories from data patches have made some indicators on staging contain an overwhelming amount of sub-directories. These should be cleaned up and protocol for maintaining cleaner directories should be included into the data patch protocol.
@minhkhul minhkhul added the data quality Missing data, weird data, broken data label Sep 18, 2024
@minhkhul minhkhul added this to the Data patching milestone Sep 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
data quality Missing data, weird data, broken data
Projects
None yet
Milestone
Data patching
Development

No branches or pull requests
2 participants
@nolangormley @minhkhul