This repository has been archived by the owner on Jun 27, 2024. It is now read-only.
[cuDNN] Use semaphores to synchronize before/after cuDNN operations #139
Labels
enhancement
New feature or request
Depends on: #138
Today cuDNN module syncrhonizes with the host after each execute operation and uses synchronous IREE custom call ABI. It should use semaphores to wait/signal completion of launched operations on a dedicated cuDNN stream. See async example in IREE: https://github.com/openxla/iree/tree/main/samples/custom_module/async
The text was updated successfully, but these errors were encountered: