Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for TensorRT 10 #66473

Open
plopresti opened this issue Apr 25, 2024 · 1 comment
Open

Add support for TensorRT 10 #66473

plopresti opened this issue Apr 25, 2024 · 1 comment
Assignees
Labels
comp:gpu:tensorrt Issues specific to TensorRT stat:awaiting tensorflower Status - Awaiting response from tensorflower TF 2.16 type:feature Feature requests

Comments

@plopresti
Copy link
Contributor

Issue type

Feature Request

Have you reproduced the bug with TensorFlow Nightly?

Yes

Source

source

TensorFlow version

nightly

Custom code

No

OS platform and distribution

Linux RedHat 9.3

Mobile device

No response

Python version

3.11

Bazel version

6.5.0

GCC/compiler version

13

CUDA/cuDNN version

12.4.1

GPU model and memory

No response

Current behavior?

TensorRT 10 GA has been released (https://developer.nvidia.com/tensorrt/download/10x).

It does not have /usr/include/NvUtils.h as required by third_party/tensorrt/tensorrt_configure.bzl, causing the build to fail.

Standalone code to reproduce the issue

env TF_NEED_TENSORRT=1 ./configure
bazel build

Relevant log output

cp: cannot stat '/usr/include/NvUtils.h': No such file or directory
@SuryanarayanaY
Copy link
Collaborator

Hi @plopresti ,

AFAIK the current TensrRT version that TF tested is 8.X version. 10.X version also will be supported in near future but can't sure of exact timeline.

@SuryanarayanaY SuryanarayanaY added comp:gpu:tensorrt Issues specific to TensorRT TF 2.16 stat:awaiting tensorflower Status - Awaiting response from tensorflower labels Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:gpu:tensorrt Issues specific to TensorRT stat:awaiting tensorflower Status - Awaiting response from tensorflower TF 2.16 type:feature Feature requests
Projects
None yet
Development

No branches or pull requests

2 participants