728x90

출처

물리적 하드웨어 연결

bluesanta@gx10-f6a7:~$ ibdev2netdev
roceP2p1s0f0 port 1 ==> enP2p1s0f0np0 (Down)
roceP2p1s0f1 port 1 ==> enP2p1s0f1np1 (Up)
rocep1s0f0 port 1 ==> enp1s0f0np0 (Down)
rocep1s0f1 port 1 ==> enp1s0f1np1 (Up)

드라이버 다운로드

bluesanta@gx10-f6a7:~$ sudo wget -O /etc/netplan/40-cx7.yaml https://github.com/NVIDIA/dgx-spark-playbooks/raw/main/nvidia/connect-two-sparks/assets/cx7-netplan.yaml

실행 모드 설정

bluesanta@gx10-f6a7:~$ sudo chmod 600 /etc/netplan/40-cx7.yaml

드라이버 적용

bluesanta@gx10-f6a7:~$ sudo netplan apply

IP 확인

서버1

bluesanta@gx10-f6a7:~$ ip addr show enp1s0f1np1
4: enp1s0f1np1:  mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 30:c5:99:bb:f6:a9 brd ff:ff:ff:ff:ff:ff
    inet 169.254.74.248/16 brd 169.254.255.255 scope link noprefixroute enp1s0f1np1
       valid_lft forever preferred_lft forever
    inet6 fe80::32c5:99ff:febb:f6a9/64 scope link 
       valid_lft forever preferred_lft forever

서버2

bluesanta@gx10-3b16:~$ ip addr show enp1s0f1np1
4: enp1s0f1np1:  mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 30:c5:99:3e:3b:18 brd ff:ff:ff:ff:ff:ff
    inet 169.254.74.57/16 brd 169.254.255.255 scope link noprefixroute enp1s0f1np1
       valid_lft forever preferred_lft forever
    inet6 fe80::32c5:99ff:fe3e:3b18/64 scope link 
       valid_lft forever preferred_lft forever

비밀번호 없는 SSH 인증 설정

스크립트 다운로드

bluesanta@gx10-f6a7:~$ wget https://github.com/NVIDIA/dgx-spark-playbooks/raw/refs/heads/main/nvidia/connect-two-sparks/assets/discover-sparks

서버1

bluesanta@gx10-f6a7:~$ bash ./discover-sparks
Found: 169.254.74.248 (gx10-f6a7.local)
Found: 169.254.74.57 (gx10-3b16.local)
 
Setting up shared SSH access across all nodes...
You may be prompted for your password on each node.
Configuring 169.254.74.248...
  ✓ Successfully configured 169.254.74.248 with shared key
Configuring 169.254.74.57...
  ✓ Successfully configured 169.254.74.57 with shared key
 
Shared SSH setup complete!
All nodes can now SSH to each other using the shared key (id_ed25519_shared).

서버2

bluesanta@gx10-3b16:~$ bash ./discover-sparks
Found: 169.254.74.248 (gx10-f6a7.local)
Found: 169.254.74.57 (gx10-3b16.local)
 
Setting up shared SSH access across all nodes...
You may be prompted for your password on each node.
Configuring 169.254.74.248...
  ✓ Successfully configured 169.254.74.248 with shared key
Configuring 169.254.74.57...
  ✓ Successfully configured 169.254.74.57 with shared key
 
Shared SSH setup complete!
All nodes can now SSH to each other using the shared key (id_ed25519_shared).
728x90

+ Recent posts