Skip to content
This repository has been archived by the owner on Jun 27, 2024. It is now read-only.

[cuDNN] Use semaphores to synchronize before/after cuDNN operations #139

Open
ezhulenev opened this issue Jun 14, 2023 · 0 comments
Open
Labels
enhancement New feature or request

Comments

@ezhulenev
Copy link
Contributor

Depends on: #138

Today cuDNN module syncrhonizes with the host after each execute operation and uses synchronous IREE custom call ABI. It should use semaphores to wait/signal completion of launched operations on a dedicated cuDNN stream. See async example in IREE: https://github.com/openxla/iree/tree/main/samples/custom_module/async

@ezhulenev ezhulenev added the enhancement New feature or request label Jun 14, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant