Skip to content
This repository has been archived by the owner on Feb 1, 2024. It is now read-only.

Partition subset of S3 logs based on date #12

Open
bregard opened this issue Jun 10, 2019 · 0 comments
Open

Partition subset of S3 logs based on date #12

bregard opened this issue Jun 10, 2019 · 0 comments

Comments

@bregard
Copy link

bregard commented Jun 10, 2019

I am working with a large set of S3 access logs (90 days). The first 60 days have been moved to Glacier. I really only need the last 30 days. Its still a large amount of objects (~1.5 million). Could you point me to the easiest way to modify this code base to run for smaller date range? Even one day at a time would suffice. Thanks.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant