new: Use temporary, backported trivial caching implemention in extism #307
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pr resolves extism from a temporarily-created branch backport-cache off of v0.5.x. More holistic caching improvements are already merged on extism main, which is for the upcoming 1.0 release.
The 1-line change to prompt wasmtime to use caching by default results in significant tool resolution performance gains.
In my testing, trivial calling of
node
goes from ~100ms to ~18.5ms.No config change is needed, wasmtime will do the caching transparently in the background. The behavior can also be optionally disabled by editing the user-global wasmtime config, if issues arise.
Tested on linux, not sure how or if it'll work on Windows.
hyperfine tests: