Ubuntu 24.04 : CUDA 설치

리눅스 버전 확인

bluesanta@bluesanta-A520M-ITX-ac:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 24.04.3 LTS
Release:        24.04
Codename:       noble

NVIDIA 드라이버 버전 확인

bluesanta@bluesanta-A520M-ITX-ac:~$ nvidia-smi
Fri Jan  2 21:13:47 2026       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.95.05              Driver Version: 580.95.05      CUDA Version: 13.0     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4060        Off |   00000000:01:00.0 Off |                  N/A |
|  0%   41C    P8            N/A  /  115W |     378MiB /   8188MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
 
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A            2210      G   /usr/lib/xorg/Xorg                      183MiB |
|    0   N/A  N/A            2428      G   /usr/bin/gnome-shell                    143MiB |
+-----------------------------------------------------------------------------------------+

CUDA 12.4 설치

NVIDIA 저장소 키 및 리스트 등록

bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt update
bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt install build-essential dkms wget
bluesanta@bluesanta-A520M-ITX-ac:~$ wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-ubuntu2404.pin
bluesanta@bluesanta-A520M-ITX-ac:~$ sudo mv cuda-ubuntu2404.pin /etc/apt/preferences.d/cuda-repository-pin-600
bluesanta@bluesanta-A520M-ITX-ac:~$ wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb
bluesanta@bluesanta-A520M-ITX-ac:~$ sudo dpkg -i cuda-keyring_1.1-1_all.deb
bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt update

CUDA 12.4 Toolkit 설치

bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt install cuda-toolkit-12-4

CUDA Toolkit 설치 여부 확인

bluesanta@bluesanta-A520M-ITX-ac:~$ whereis cuda
cuda: /usr/lib/cuda /usr/include/cuda /usr/local/cuda
bluesanta@bluesanta-A520M-ITX-ac:~$ ls -l /usr/local | grep cuda
lrwxrwxrwx  1 root root   22  1월  2 22:32 cuda -> /etc/alternatives/cuda
lrwxrwxrwx  1 root root   25  1월  2 22:32 cuda-12 -> /etc/alternatives/cuda-12
drwxr-xr-x 15 root root 4096  1월  2 22:32 cuda-12.4

환경 변수 등록

설치가 완료되면 /usr/local/cuda-12.4 폴더가 생성됩니다. 이제 시스템이 이 폴더를 인식하도록 설정

bluesanta@bluesanta-A520M-ITX-ac:~$ vi ~/.bashrc

~/.bashrc 내용 추가

# 파일 맨 아래에 다음 세 줄 추가
export PATH=/usr/local/cuda-12.4/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-12.4/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
export CUDA_HOME=/usr/local/cuda-12.4

CUDA Toolkit 설치 (Ubuntu 24.04 기준) - 위에 설치 된것 같지만 다시 확인 필요

bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt update
bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt install build-essential dkms
bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt install nvidia-cuda-toolkit

cuDNN 9 (CUDA 12용) 설치

bluesanta@bluesanta-A520M-ITX-ac:~$ sudo apt install libcudnn9-cuda-12

설치 확인

bluesanta@bluesanta-A520M-ITX-ac:~$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Mar_28_02:18:24_PDT_2024
Cuda compilation tools, release 12.4, V12.4.131
Build cuda_12.4.r12.4/compiler.34097967_0