Jetson AGX Orin : NVIDIA TensorRT 11.x 설치

출처

• TensorRT 11.x Download | NVIDIA Developer

현재 설치된 버전 확인

bluesanta@localhost:~$ dpkg -l | grep nvinfer
ii  libnvinfer-bin                                     10.16.2.10-1+cuda13.2                            arm64        TensorRT binaries
ii  libnvinfer-dev                                     10.16.2.10-1+cuda13.2                            arm64        TensorRT development libraries
ii  libnvinfer-dispatch-dev                            10.16.2.10-1+cuda13.2                            arm64        TensorRT development dispatch runtime libraries
ii  libnvinfer-dispatch10                              10.16.2.10-1+cuda13.2                            arm64        TensorRT dispatch runtime library
ii  libnvinfer-headers-dev                             10.16.2.10-1+cuda13.2                            arm64        TensorRT development headers
ii  libnvinfer-headers-plugin-dev                      10.16.2.10-1+cuda13.2                            arm64        TensorRT plugin headers
ii  libnvinfer-headers-python-plugin-dev               10.16.2.10-1+cuda13.2                            arm64        TensorRT Python plugin development headers
ii  libnvinfer-lean-dev                                10.16.2.10-1+cuda13.2                            arm64        TensorRT lean runtime libraries
ii  libnvinfer-lean10                                  10.16.2.10-1+cuda13.2                            arm64        TensorRT lean runtime library
ii  libnvinfer-plugin-dev                              10.16.2.10-1+cuda13.2                            arm64        TensorRT plugin libraries
ii  libnvinfer-plugin10                                10.16.2.10-1+cuda13.2                            arm64        TensorRT plugin libraries
ii  libnvinfer-safe-headers-dev                        10.16.2.10-1+cuda13.2                            arm64        TensorRT safety development headers
ii  libnvinfer-vc-plugin-dev                           10.16.2.10-1+cuda13.2                            arm64        TensorRT vc-plugin library
ii  libnvinfer-vc-plugin10                             10.16.2.10-1+cuda13.2                            arm64        TensorRT vc-plugin library
ii  libnvinfer10                                       10.16.2.10-1+cuda13.2                            arm64        TensorRT runtime libraries
ii  python3-libnvinfer                                 10.16.2.10-1+cuda13.2                            arm64        Python 3 bindings for TensorRT standard runtime
ii  python3-libnvinfer-dev                             10.16.2.10-1+cuda13.2                            arm64        Python 3 development package for TensorRT standard runtime
ii  python3-libnvinfer-dispatch                        10.16.2.10-1+cuda13.2                            arm64        Python 3 bindings for TensorRT dispatch runtime
ii  python3-libnvinfer-lean                            10.16.2.10-1+cuda13.2                            arm64        Python 3 bindings for TensorRT lean runtime

NVIDIA TensorRT 11.x 설치

다운로드

bluesanta@localhost:~$ wget https://developer.download.nvidia.com/compute/tensorrt/11.2.1/local_installers/nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3_1.0-1_arm64.deb

deb 로컬 리포지토리 등록

bluesanta@localhost:~$ sudo dpkg -i nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3_1.0-1_arm64.deb
Selecting previously unselected package nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3.
(Reading database ... 204342 files and directories currently installed.)
Preparing to unpack nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3_1.0-1_arm64.deb ...
Unpacking nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3 (1.0-1) ...
Setting up nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3 (1.0-1) ...
 
The public nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3 GPG key does not appear to be installed.
To install the key, run this command:
sudo cp /var/nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3/nv-tensorrt-local-019AD499-keyring.gpg /usr/share/keyrings/

GPG 키링 복사

bluesanta@localhost:~$ sudo cp /var/nv-tensorrt-local-repo-ubuntu2404-11.2.1-cuda-13.3/nv-tensorrt-local-019AD499-keyring.gpg /usr/share/keyrings/

패키지 인덱스 업데이트 및 TensorRT 11 설치

bluesanta@localhost:~$ sudo apt updateㅍ
bluesanta@localhost:~$ sudo apt remove --purge -y "libnvinfer*" "python3-libnvinfer*" "tensorrt*"
bluesanta@localhost:~$ sudo apt-get autoremove -y
bluesanta@localhost:~$ sudo apt-get install -y libnvinfer11=11.2.1.2-1+cuda13.3 libnvinfer-dev=11.2.1.2-1+cuda13.3 libnvinfer-plugin11=11.2.1.2-1+cuda13.3 libnvinfer-plugin-dev=11.2.1.2-1+cuda13.3 libnvinfer-headers-dev=11.2.1.2-1+cuda13.3 libnvinfer-headers-plugin-dev=11.2.1.2-1+cuda13.3 libnvinfer-safe-headers-dev=11.2.1.2-1+cuda13.3 libnvinfer-lean11=11.2.1.2-1+cuda13.3 libnvinfer-lean-dev=11.2.1.2-1+cuda13.3 libnvinfer-dispatch11=11.2.1.2-1+cuda13.3 libnvinfer-dispatch-dev=11.2.1.2-1+cuda13.3 libnvinfer-vc-plugin11=11.2.1.2-1+cuda13.3 libnvinfer-vc-plugin-dev=11.2.1.2-1+cuda13.3 libnvonnxparsers11=11.2.1.2-1+cuda13.3 libnvonnxparsers-dev=11.2.1.2-1+cuda13.3 python3-libnvinfer=11.2.1.2-1+cuda13.3 python3-libnvinfer-dev=11.2.1.2-1+cuda13.3 python3-libnvinfer-lean=11.2.1.2-1+cuda13.3 python3-libnvinfer-dispatch=11.2.1.2-1+cuda13.3
bluesanta@localhost:~$ dpkg -l | grep nvinfer
ii  libnvinfer-dev                                     11.2.1.2-1+cuda13.3                              arm64        TensorRT development libraries
ii  libnvinfer-dispatch-dev                            11.2.1.2-1+cuda13.3                              arm64        TensorRT development dispatch runtime libraries
ii  libnvinfer-dispatch11                              11.2.1.2-1+cuda13.3                              arm64        TensorRT dispatch runtime library
ii  libnvinfer-headers-dev                             11.2.1.2-1+cuda13.3                              arm64        TensorRT development headers
ii  libnvinfer-headers-plugin-dev                      11.2.1.2-1+cuda13.3                              arm64        TensorRT plugin headers
ii  libnvinfer-lean-dev                                11.2.1.2-1+cuda13.3                              arm64        TensorRT lean runtime libraries
ii  libnvinfer-lean11                                  11.2.1.2-1+cuda13.3                              arm64        TensorRT lean runtime library
ii  libnvinfer-plugin-dev                              11.2.1.2-1+cuda13.3                              arm64        TensorRT plugin libraries
ii  libnvinfer-plugin11                                11.2.1.2-1+cuda13.3                              arm64        TensorRT plugin libraries
ii  libnvinfer-safe-headers-dev                        11.2.1.2-1+cuda13.3                              arm64        TensorRT safety development headers
ii  libnvinfer-vc-plugin-dev                           11.2.1.2-1+cuda13.3                              arm64        TensorRT vc-plugin library
ii  libnvinfer-vc-plugin11                             11.2.1.2-1+cuda13.3                              arm64        TensorRT vc-plugin library
ii  libnvinfer11                                       11.2.1.2-1+cuda13.3                              arm64        TensorRT runtime libraries
ii  python3-libnvinfer                                 11.2.1.2-1+cuda13.3                              arm64        Python 3 bindings for TensorRT standard runtime
ii  python3-libnvinfer-dev                             11.2.1.2-1+cuda13.3                              arm64        Python 3 development package for TensorRT standard runtime
ii  python3-libnvinfer-dispatch                        11.2.1.2-1+cuda13.3                              arm64        Python 3 bindings for TensorRT dispatch runtime
ii  python3-libnvinfer-lean                            11.2.1.2-1+cuda13.3                              arm64        Python 3 bindings for TensorRT lean runtime