Fix Torch-TensorRT Bazel build on JetPack#4307
Conversation
|
@Mike-Sagiri can you explain more about the system configuration you are targeting? If it is Jetson Thor / JP 7.0+, you should be able to use SBSA style distributions (aarch64_linux configuration). Or are you targeting Orin JP 6.2? The PR seems to hint at JP7.0+ |
|
@narendasan Thanks for raising this point. Actually, the goal of this PR is not to target a specific JetPack release. The main issue I am addressing is the build configuration under the In principle, both JetPack 6 and JetPack 7 can be supported through That said, for the dependency versions currently used by Torch-TensorRT 2.12, I aligned the JetPack configuration with the versions already used on other architectures (CUDA, PyTorch, and TensorRT). As a result, the default configuration in this PR effectively matches the dependency stack available on JetPack 7. One important consideration is that TensorRT versions available on JetPack 6 do not provide the Therefore, my rationale was to make the default JetPack configuration consistent with the dependency versions already used by other architectures, rather than maintaining a separate JetPack-specific dependency matrix that would still not provide full Torch-TensorRT 2.12 functionality on JetPack 6. |
|
I see. Generally the direction of Jetpack as a whole is to align on SBSA (the |
Description
Update and fix TensorRT Bazel build support on NVIDIA JetPack platforms.
JetPack packages TensorRT headers and libraries differently from standard Linux TensorRT distributions.
This change:
--jetpackto build Torch-TensorRT from source successfullyKnown issue:
add_attentionis not supported by TensorRT 10.14-. So the users may need to addtorch.backends.cuda.enable_flash_sdp(False),torch.backends.cuda.enable_mem_efficient_sdp(False),torch.backends.cuda.enable_math_sdp(True)to solve the problem.Fixes # (issue)
Type of change
Please delete options that are not relevant and/or add your own.
Checklist: