Skip to content
This repository has been archived by the owner on Dec 10, 2024. It is now read-only.

Commit

Permalink
S3 async read (#15)
Browse files Browse the repository at this point in the history 
* Async read

* Git instead of local

* Format

* Tokio dependent restructure

* Format, cleanup sink finish

* Unwraps, progress logs, futures unordered

* Format

* Update cargo files

* Revert object store version

* Lint

* Only use object store to read pbfs

* Semaphore to reduce tasks in memory, joinset

* Fix semaphore
  • Loading branch information
@brad-richardson
brad-richardson authored Sep 4, 2024
1 parent 08f3fdd commit 8ed9bab
Show file tree
Hide file tree
Showing 7 changed files with 614 additions and 443 deletions.
Loading

0 comments on commit 8ed9bab

Please sign in to comment.