Isgaarsiin Wadareed iyo Kediska NCCL

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

1. Muxuu hawlgal-dhimista oo dhan ku qabtaa tababarka la qaybiyey?
   • Waxay isku daraysaa qiyamka dhammaan GPU-yada waxayna siinaysaa GPU kasta natiijada la isku daray
   • Waxay tirtirtaa xogta aan loo baahnayn ee hal GPU
   • Waxay yaraynaysaa xawaaraha saacada GPU si loo badbaadiyo awooda
   • Waxay xogta ka soo dirtaa dhammaan GPU-yada hal saxan oo kaydinta ah
2. Waa maxay macnaha erayga NCCL ee soo gaabiyay?
   • Lakabka Xisaabinta Neural
   • Logic Control Cache Network
   • Maktabadda Isgaadhsiinta Wadareed ee NVIDIA
   • Maktabadda Xisaabinta Convolution Number
3. Why can chunked ring communication be useful for a large tensor?
   • It guarantees constant latency for any number of devices
   • Chunks can be streamed across participating links instead of waiting for one monolithic transfer
   • It makes topology irrelevant
   • It prevents all network contention
4. Hawlgalkee wadajirka ah ee ururinaya qayb kasta oo xogta GPU ah nuqul buuxa oo ay hayaan dhammaan GPU-yada?
   • Baahinta
   • Iska yaree-kala firdhiso
   • Caqabad
   • Dhammaan-urur
5. What does a supported network reduction offload such as SHARP do?
   • Guarantee exactly half the traffic for every collective
   • Remove the need for participating ranks
   • Perform some reduction work in compatible network hardware
   • Turn all-gather into a local memory copy
6. Waa kuwee isku xidhka NCCL sida caadiga ah u adeegsato xidhiidhka ka dhexeeya server-yada (nodes)?
   • InfiniBand ama RoCE
   • Fiilo USB ah
   • Booska PCIe kaliya
   • Wi-Fi
7. Three ranks contribute scalar values 2, 3 and 5 to a sum all-reduce. What value does each receive?
   • Only its own original value
   • 3 for the middle rank and nothing elsewhere
   • The average 3.33 unless requested separately
   • 10
8. Which collective combines contributions but distributes reduced pieces instead of the entire reduced buffer to every rank?
   • Dhammaan-urur
   • Iska yaree-kala firdhiso
   • Baahinta
   • A standalone model checkpoint