Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing libtritonserver.so for Deepstream Triton libraries #126

Open
nkinnaird opened this issue Sep 3, 2024 · 1 comment
Open

Missing libtritonserver.so for Deepstream Triton libraries #126

nkinnaird opened this issue Sep 3, 2024 · 1 comment

Comments

@nkinnaird
Copy link

Hi there, I'm trying to add Triton Server into our Yocto build for use with Deepstream. I've been able to add the Triton packages (triton-server triton-core triton-tensorrt-backend triton-client) into the image and spin up the Triton Server without issues. I can also add the Deepstream (deepstream-6.0) package no problem. The problem arises when I try to add the triton package to the PACKAGECONFIG variable inside the deepstream-6.0_6.0.1-1.bb recipe in order to include the libraries:

gstreamer-1.0/deepstream/libnvdsgst_inferserver.so
lib/libnvds_infer_server.so

(I've also added deepstream-6.0-triton to my build image.)

When I try to bitbake my image (or just the deepstream/deepstream-triton components) I run into the error:

ERROR: deepstream-6.0-6.0.1-1-r0 do_package_qa: QA Issue: /opt/nvidia/deepstream/deepstream-6.0/lib/libnvds_infer_server.so contained in package deepstream-6.0-triton requires libtritonserver.so()(64bit), but no providers found in RDEPENDS:deepstream-6.0-triton? [file-rdeps]
ERROR: deepstream-6.0-6.0.1-1-r0 do_package_qa: Fatal QA errors were found, failing task.
ERROR: Logfile of failure stored in: /data/nkinnaird/ccu-yocto-jetpack-4_6_4-fresh/ccu-yocto/build/tmp/work/armv8a_tegra-poky-linux/deepstream-6.0/6.0.1-1-r0/temp/log.do_package_qa.2115363
ERROR: Task (/data/nkinnaird/ccu-yocto-jetpack-4_6_4-fresh/ccu-yocto/meta-tegra-community/recipes-devtools/deepstream/deepstream-6.0_6.0.1-1.bb:do_package_qa) failed with exit code '1'

where there is a missing library libtritonserver.so. Having searched around it appears that this library should be built in the triton-core recipe as long as TRITON_CORE_HEADERS_ONLY=OFF which it is in the corresponding recipe. But it doesn't appear to be included in any way in that recipe, or built at all.

Has anyone run into this issue before? I'm not sure if I'm missing something simple, or if I need to make more custom changes somewhere in order to get things to work.

I'm on commit 1cf7e5d of the kirkstone-l4t-r32.7.x branch for meta-tegra-community.

Thanks!

@ichergui
Copy link
Member

ichergui commented Sep 3, 2024

Hi @nkinnaird
Thanks for reporting this issue. I will check that and will be back to you.
I did work in both DS-6.0 and Trinton awhile ago. I need to refresh my memory.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants