Orange Pi 5 Pro (RK3588S) : RKNN-Toolkit2 설치

출처

• 2. NPU — Firefly Wiki

메모리 확인

orangepi@orangepi-desktop:~$ free -h
               total        used        free      shared  buff/cache   available
Mem:            15Gi       983Mi        10Gi        46Mi       4.0Gi        14Gi
Swap:          1.0Gi          0B       1.0Gi

NPU 드라이버 버전 확인

orangepi@orangepi-desktop:~$ sudo cat /sys/kernel/debug/rknpu/version
RKNPU driver: v0.9.6

python 설치

orangepi@orangepi-desktop:~$ sudo apt install python3 python3-pip python3-venv

python 가상 환경 만들기

orangepi@orangepi-desktop:~$ mkdir Llama
orangepi@orangepi-desktop:~$ cd Llama
orangepi@orangepi-desktop:~/Llama$ python3 -m venv .venv
orangepi@orangepi-desktop:~/Llama$ source .venv/bin/activate
(.venv) orangepi@orangepi-desktop:~/Llama$ 

RKNN-Toolkit2

cmake 설치

(.venv) orangepi@orangepi-desktop:~/Llama$ sudo apt install cmake

rknn-toolkit2 설치

(.venv) orangepi@orangepi-desktop:~/Llama$ pip install rknn-toolkit2

rknn-toolkit2 설치 확인

(.venv) orangepi@orangepi-desktop:~/Llama$ python -c "import rknn.api.rknn_base as base; print(base.__file__)"
/home/orangepi/Llama/.venv/lib/python3.10/site-packages/rknn/api/rknn_base.cpython-310-aarch64-linux-gnu.so
(.venv) orangepi@orangepi-desktop:~/Llama$ pip show rknn-toolkit2
Name: rknn-toolkit2
Version: 2.3.2
Summary: Rockchip Neural Network Toolkit2. (commit: c7d6ffcf)
Home-page: https://github.com/airockchip/rknn-toolkit2
Author: ai@rock-chips.com
Author-email: ai@rock-chips.com
License: 
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: fast-histogram, numpy, onnx, onnxoptimizer, onnxruntime, opencv-python, protobuf, psutil, ruamel.yaml, scipy, torch, tqdm
Required-by: 
(.venv) orangepi@orangepi5pro:~/Llama$ pip show torch
Name: torch
Version: 2.2.0
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: filelock, fsspec, jinja2, networkx, sympy, typing-extensions
Required-by: rknn-toolkit2

torchvision 설치 확인

(.venv) orangepi@orangepi5pro:~/Llama$ pip install torchvision==0.17.0 torchaudio==2.2.0
(.venv) orangepi@orangepi5pro:~/Llama$ pip show torchvision
Name: torchvision
Version: 0.17.0
Summary: image and video datasets and models for torch deep learning
Home-page: https://github.com/pytorch/vision
Author: PyTorch Core Team
Author-email: soumith@pytorch.org
License: BSD
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: numpy, pillow, requests, torch
Required-by: 
(.venv) orangepi@orangepi5pro:~/Llama$ pip show torchaudio
Name: torchaudio
Version: 2.2.0
Summary: An audio package for PyTorch
Home-page: https://github.com/pytorch/audio
Author: Soumith Chintala, David Pollack, Sean Naren, Peter Goldsborough, Moto Hira, Caroline Chen, Jeff Hwang, Zhaoheng Ni, Xiaohui Zhang
Author-email: soumith@pytorch.org
License: 
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: torch
Required-by: