Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate previously ingested Datasets from non-CBA Prod to CBA Prod #273

Closed
7 of 10 tasks
krisstanton opened this issue Oct 11, 2023 · 4 comments
Closed
7 of 10 tasks
Assignees

Comments

@krisstanton
Copy link
Collaborator

krisstanton commented Oct 11, 2023

Migrate previously ingested Datasets from non-CBA Prod to CBA Prod

UPDATE: Please see: Milestone ticket: https://github.com/NASA-IMPACT/csda-project/issues/495

Update: Here are the Child tickets for migrating ingests (also adding these to the milestone) - Each ticket represents an entire dataset to be migrated.

@krisstanton krisstanton self-assigned this Oct 11, 2023
@chuckwondo
Copy link
Collaborator

NOTE: I am working on an improved DiscoverAndQueueGranules workflow that should allow us to ingest each collection with a single rule spanning its entire temporal range, rather than a rule for every year.

@chuckwondo chuckwondo changed the title Migrate previously ingested Datasets from NGAP to CBA Migrate previously ingested Datasets from non-CBA Prod to CBA Prod Nov 7, 2023
@krisstanton
Copy link
Collaborator Author

krisstanton commented Dec 28, 2023

This was a placeholder ticket which is now being replaced by individual dataset tickets like these 2:
#311
#314

From the description, regarding

 Will need to process and compare Manifest files so that we can ingest any granules that were missed during the initial NGAP ingest. 

That work is being handled in another ticket as well: Associated Ticket: #270

It is possible that this ticket should be closed, but I am not sure if there is another parent ticket (or milestone setup) which covers this work.
Edit: Otherwise, this ticket should be the parent ticket for the migration ingests.

@krisstanton
Copy link
Collaborator Author

krisstanton commented Dec 28, 2023

It looks like the item near the end of this ticket, https://github.com/NASA-IMPACT/csda-project/issues/403
covers the migration work (and the previous work leading up to this migration).

@krisstanton
Copy link
Collaborator Author

krisstanton commented Dec 28, 2023

Setting this status to 'In Progress' since we have already been doing some of these migration ingests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants