728x90
출처
- [Mini PC] How to Connect Two ASUS Ascent GX10 | Official Support | ASUS Global
- Connect Two Sparks | DGX Spark
- GB10 시스템으로 2개의 Dell Pro Max를 클러스터링하는 방법(FCM1253) | Dell 대한민국
물리적 하드웨어 연결
bluesanta@gx10-f6a7:~$ ibdev2netdev
roceP2p1s0f0 port 1 ==> enP2p1s0f0np0 (Down)
roceP2p1s0f1 port 1 ==> enP2p1s0f1np1 (Up)
rocep1s0f0 port 1 ==> enp1s0f0np0 (Down)
rocep1s0f1 port 1 ==> enp1s0f1np1 (Up)
드라이버 다운로드
bluesanta@gx10-f6a7:~$ sudo wget -O /etc/netplan/40-cx7.yaml https://github.com/NVIDIA/dgx-spark-playbooks/raw/main/nvidia/connect-two-sparks/assets/cx7-netplan.yaml
실행 모드 설정
bluesanta@gx10-f6a7:~$ sudo chmod 600 /etc/netplan/40-cx7.yaml
드라이버 적용
bluesanta@gx10-f6a7:~$ sudo netplan apply
IP 확인
서버1
bluesanta@gx10-f6a7:~$ ip addr show enp1s0f1np1
4: enp1s0f1np1: mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 30:c5:99:bb:f6:a9 brd ff:ff:ff:ff:ff:ff
inet 169.254.74.248/16 brd 169.254.255.255 scope link noprefixroute enp1s0f1np1
valid_lft forever preferred_lft forever
inet6 fe80::32c5:99ff:febb:f6a9/64 scope link
valid_lft forever preferred_lft forever
서버2
bluesanta@gx10-3b16:~$ ip addr show enp1s0f1np1
4: enp1s0f1np1: mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 30:c5:99:3e:3b:18 brd ff:ff:ff:ff:ff:ff
inet 169.254.74.57/16 brd 169.254.255.255 scope link noprefixroute enp1s0f1np1
valid_lft forever preferred_lft forever
inet6 fe80::32c5:99ff:fe3e:3b18/64 scope link
valid_lft forever preferred_lft forever
비밀번호 없는 SSH 인증 설정
스크립트 다운로드
bluesanta@gx10-f6a7:~$ wget https://github.com/NVIDIA/dgx-spark-playbooks/raw/refs/heads/main/nvidia/connect-two-sparks/assets/discover-sparks
서버1
bluesanta@gx10-f6a7:~$ bash ./discover-sparks
Found: 169.254.74.248 (gx10-f6a7.local)
Found: 169.254.74.57 (gx10-3b16.local)
Setting up shared SSH access across all nodes...
You may be prompted for your password on each node.
Configuring 169.254.74.248...
✓ Successfully configured 169.254.74.248 with shared key
Configuring 169.254.74.57...
✓ Successfully configured 169.254.74.57 with shared key
Shared SSH setup complete!
All nodes can now SSH to each other using the shared key (id_ed25519_shared).
서버2
bluesanta@gx10-3b16:~$ bash ./discover-sparks
Found: 169.254.74.248 (gx10-f6a7.local)
Found: 169.254.74.57 (gx10-3b16.local)
Setting up shared SSH access across all nodes...
You may be prompted for your password on each node.
Configuring 169.254.74.248...
✓ Successfully configured 169.254.74.248 with shared key
Configuring 169.254.74.57...
✓ Successfully configured 169.254.74.57 with shared key
Shared SSH setup complete!
All nodes can now SSH to each other using the shared key (id_ed25519_shared).728x90