Orange Pi 5 Plus (RK3588) : RKNN-Toolkit2 설치

출처

• 2. NPU — Firefly Wiki

리눅스 버전 확인

orangepi@orangepi5plus:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 22.04.5 LTS
Release:        22.04
Codename:       jammy
orangepi@orangepi5plus:~$ free -h
               total        used        free      shared  buff/cache   available
Mem:           7.7Gi       511Mi       6.7Gi        13Mi       592Mi       7.2Gi
Swap:          3.9Gi          0B       3.9Gi

NPU 드라이버 버전 확인

orangepi@orangepi5plus:~$ sudo cat /sys/kernel/debug/rknpu/version
RKNPU driver: v0.9.8

python 설치

orangepi@orangepi5plus:~$ sudo apt install python3 python3-pip python3-venv

python 가상 환경 만들기

orangepi@orangepi5plus:~$ mkdir Llama
orangepi@orangepi5plus:~$ cd Llama
orangepi@orangepi5plus:~/Llama$ python3 -m venv .venv
orangepi@orangepi5plus:~/Llama$ source .venv/bin/activate
(.venv) orangepi@orangepi5plus:~/Llama$ 

RKNN-Toolkit2

cmake 설치

(.venv) orangepi@orangepi5plus:~/Llama$ sudo apt install cmake

rknn-toolkit2 설치

(.venv) orangepi@orangepi5plus:~/Llama$ pip install rknn-toolkit2

rknn-toolkit2 설치 확인

(.venv) orangepi@orangepi5plus:~/Llama$ python -c "import rknn.api.rknn_base as base; print(base.__file__)"
/home/orangepi/Llama/.venv/lib/python3.10/site-packages/rknn/api/rknn_base.cpython-310-aarch64-linux-gnu.so
(.venv) orangepi@orangepi5plus:~/Llama$ pip show rknn-toolkit2
Name: rknn-toolkit2
Version: 2.3.2
Summary: Rockchip Neural Network Toolkit2. (commit: c7d6ffcf)
Home-page: https://github.com/airockchip/rknn-toolkit2
Author: ai@rock-chips.com
Author-email: ai@rock-chips.com
License: 
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: fast-histogram, numpy, onnx, onnxoptimizer, onnxruntime, opencv-python, protobuf, psutil, ruamel.yaml, scipy, torch, tqdm
Required-by: 
(.venv) orangepi@orangepi5plus:~/Llama$  pip show torch
Name: torch
Version: 2.2.0
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: filelock, fsspec, jinja2, networkx, sympy, typing-extensions
Required-by: rknn-toolkit2

torchvision 설치

(.venv) orangepi@orangepi5plus:~/Llama$ pip install torchvision==0.17.0 torchaudio==2.2.0
(.venv) orangepi@orangepi5plus:~/Llama$ pip show torchvision
Name: torchvision
Version: 0.17.0
Summary: image and video datasets and models for torch deep learning
Home-page: https://github.com/pytorch/vision
Author: PyTorch Core Team
Author-email: soumith@pytorch.org
License: BSD
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: numpy, pillow, requests, torch
Required-by: 
(.venv) orangepi@orangepi5plus:~/Llama$ pip show torchaudio
Name: torchaudio
Version: 2.2.0
Summary: An audio package for PyTorch
Home-page: https://github.com/pytorch/audio
Author: Soumith Chintala, David Pollack, Sean Naren, Peter Goldsborough, Moto Hira, Caroline Chen, Jeff Hwang, Zhaoheng Ni, Xiaohui Zhang
Author-email: soumith@pytorch.org
License: 
Location: /home/orangepi/Llama/.venv/lib/python3.10/site-packages
Requires: torch
Required-by: