Skip to content

Issues: NVIDIA/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

388 Open 3,406 Closed
388 Open 3,406 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

The trt model is used on different graphics cards
#4259 opened Nov 23, 2024 by wahaha
Cuda Runtime (out of memory) failure of TensorRT 10.3.0 when running trtexec on GPU RTX4060/jetson/etc
#4258 opened Nov 22, 2024 by zargooshifar
[ONNXParser] TensorRT Fails to Load ONNX Checkpoints with Separated Weight and Bias Files
#4257 opened Nov 22, 2024 by theanh-ktmt
Polygraphy: how to compare the precision layer by layer with TensorRT if I have a custom operator in my onnx (and a corresponding plugin in TensorRT)?
#4256 opened Nov 22, 2024 by MyraYu2022
Error Code 10: Internal Error (Could not find any implementation for node failure of TensorRT 8.5 when running on GPU Jetson Xavier NX
#4255 opened Nov 20, 2024 by fettahyildizz
4
User allocator error allocating 86114304000-byte buffer failure of TensorRT 10.6 when running demo_img2vid. py on GPU rtx4090
#4254 opened Nov 19, 2024 by kolyh
3
!config.getFlag(BuilderFlag::kFP16). ) failure of TensorRT 10.6 when running demo_txt2img_flux.py on GPU h20
#4253 opened Nov 19, 2024 by yja1
Linux env TRT_LIBPATH in wrong format when building TensorRT 10.6 OSS
#4251 opened Nov 18, 2024 by Synapsess
Different output with same input between dynamic and static shape model Accuracy Output mismatch between TensorRT and other frameworks internal-bug-tracked Tracked internally, will be fixed in a future release. triaged Issue has been triaged by maintainers
#4250 opened Nov 15, 2024 by smarttowel
@kevinch-nv
3
trt-engine-explorer plot circle in graph of an model engine question Further information is requested triaged Issue has been triaged by maintainers
#4249 opened Nov 15, 2024 by roachsinai
6
Non-Maximal-Suppression (NMS) Layers slow on TensorRT 10.0-10.6 Performance General performance issues triaged Issue has been triaged by maintainers
#4248 opened Nov 14, 2024 by darrin-willis
2
The latency difference between bilinear gridsample and nearest is significant in the same onnx model Performance General performance issues triaged Issue has been triaged by maintainers
#4246 opened Nov 13, 2024 by DaZhUUU
6
TopK 3840 limitation and future plans for this operator triaged Issue has been triaged by maintainers
#4244 opened Nov 12, 2024 by amadeuszsz
1
Optimization of fast-reid infernce using tensorrt triaged Issue has been triaged by maintainers
#4243 opened Nov 11, 2024 by smrutiranjanmohapatra
3
How to quantize Linear/LN/ReLU-like structures with int8. Embedded issues when using TensorRT on embedded platforms Performance General performance issues triaged Issue has been triaged by maintainers
#4242 opened Nov 8, 2024 by WeixiangXu
5
How can I optimize multi-batch and parallel inference in TensorRT for faster performance on high-resolution image patches? Performance General performance issues triaged Issue has been triaged by maintainers
#4241 opened Nov 7, 2024 by Nizam-Drongo-Space
2
RuntimeError: Failed to parse onnx question Further information is requested triaged Issue has been triaged by maintainers
#4240 opened Nov 7, 2024 by wahaha
@poweiw
2
Flux+controlnet triaged Issue has been triaged by maintainers
#4237 opened Nov 5, 2024 by algorithmconquer
1
how to analyze the performance of each operator（myelin）? triaged Issue has been triaged by maintainers
#4236 opened Nov 5, 2024 by cychen3
3
State of affairs for NestedTensor (NJT) inference? triaged Issue has been triaged by maintainers
#4234 opened Nov 2, 2024 by vadimkantorov
5
Given an engine file, how to know what GPU model it is generated on? Enhancement New feature or request triaged Issue has been triaged by maintainers
#4233 opened Nov 1, 2024 by yangdong02
@kevinch-nv
6
How to remove signal and wait layer in the engine? triaged Issue has been triaged by maintainers
#4232 opened Oct 31, 2024 by lijinghaooo
5
Tensor Parallel and Context Parallel Enhancement New feature or request triaged Issue has been triaged by maintainers
#4231 opened Oct 31, 2024 by algorithmconquer
2
Optimize Dynamic Shape Inference for TTS Model with HiFi-GAN Vocoder triaged Issue has been triaged by maintainers
#4230 opened Oct 30, 2024 by UmerrAhsan
1
Global tensors with dynamic slice using python question Further information is requested triaged Issue has been triaged by maintainers
#4229 opened Oct 30, 2024 by zengrh3
1
ProTip! What’s not been updated in a month: updated:<2024-10-23.