Jokkoo bu mbooloo ak NCCL Quiz

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

1. Lan la operaasioŋ buy wàññi lépp di def ci tàggat-yaram buñ séddale?
   • Dafay boole valeur yi ci GPU yépp ba noppi jox GPU bu nekk resultaa biñ boole
   • Dafay efaase done yu bari yi ci benn GPU
   • Dafay wàññi gaawaayu montu GPU ngir sakkanal kuuraŋ
   • Dafay yónnee done yi ci GPU yépp ci benn disk dencukaay
2. Luy tekki akronim NCCL?
   • Couche de cluster de calcul neuronal
   • Logique de contrôle de cache du réseau
   • Bibliothèque de communication collective de NVIDIA
   • Bibliothèque de calcul de convolution numérique
3. Why can chunked ring communication be useful for a large tensor?
   • It guarantees constant latency for any number of devices
   • Chunks can be streamed across participating links instead of waiting for one monolithic transfer
   • It makes topology irrelevant
   • It prevents all network contention
4. Ban liggéey mooy dajale done yu GPU bu nekk ci benn kopi bu mat bu GPU yépp yor?
   • Diffusion
   • Wàññi tasaaroo
   • Barrière
   • Ñépp dajaloo
5. What does a supported network reduction offload such as SHARP do?
   • Guarantee exactly half the traffic for every collective
   • Remove the need for participating ranks
   • Perform some reduction work in compatible network hardware
   • Turn all-gather into a local memory copy
6. Ban lëkkaloo la NCCL di faral di jëfandikoo ngir jokkoo DIGGANTE serwër yi (node yi)?
   • InfiniBand wala RoCE
   • Fiil USB
   • Slot PCIe bi kese
   • Wifi
7. Three ranks contribute scalar values 2, 3 and 5 to a sum all-reduce. What value does each receive?
   • Only its own original value
   • 3 for the middle rank and nothing elsewhere
   • The average 3.33 unless requested separately
   • 10
8. Which collective combines contributions but distributes reduced pieces instead of the entire reduced buffer to every rank?
   • Ñépp dajaloo
   • Wàññi tasaaroo
   • Diffusion
   • A standalone model checkpoint