Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OLD_NGAP - Pull Down Ingest Records from Recent Reingest attempts from S3 #380

Open
krisstanton opened this issue Sep 12, 2024 · 1 comment
Assignees

Comments

@krisstanton
Copy link
Collaborator

krisstanton commented Sep 12, 2024

As a result of ticket #365 and the PSScene ingest, we have a latest record of exactly which granules were ingested and which failed, and why.
These files are stored on S3 right now.
When we close the NGAP server, these files will disappear.
This ticket is for the task of downloading and preserving those records in case we need them in the near future.

Edit for extra info:
The GUIDs and S3 Records that I need to pull down all exist in the new CBA_PROD (5047) (Check the internal bucket)
Only the granules that failed migration live in the OLD_NGAP_PROD account.

@krisstanton
Copy link
Collaborator Author

-Make sure to place the GUIDs in there and save that too.
(This means, save the GUIDs for each of these jobs, if that is feasible) -- This also serves as a map to each of the event files.
It may just be better to write up a tool that goes and grabs all these files and assembles the lists we want, and then add that script to repo. If that is the case, do that here.

@krisstanton krisstanton changed the title OLD_NGAP - Pull Down Ingest Records from Reingest attempts from S3 OLD_NGAP - Pull Down Ingest Records from Recent Reingest attempts from S3 Sep 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant