Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WASMFS fetch backend should support range queries #22922

Open
JoeOsborn opened this issue Nov 14, 2024 · 0 comments
Open

WASMFS fetch backend should support range queries #22922

JoeOsborn opened this issue Nov 14, 2024 · 0 comments
Labels

Comments

@JoeOsborn
Copy link
Contributor

This is a feature request, not a bug, so sorry if this is the wrong channel.

The old createLazyFile synchronous XHR code implemented range queries to only obtain portions of large files over the network instead of doing one massive read into memory; its internal LazyUint8Array stored chunks of files and proxied reads into the chunks, making new network requests to fill the chunks as needed. It would be great if the new WASMFS fetch backend could have configurable min and max network request sizes and, if I may be so bold, memory occupancy limits with LRU deletion of chunks.

If someone were to implement this, would a good start be to copy and modify the fetch backend, merging in relevant parts of the jsfile backend modified so that a file is a bunch of chunks instead of a single typed array?

@sbc100 sbc100 added the wasmfs label Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants