Quiz buy gëna xéewale politik yu jege

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

1. Ban jafe-jafe la 'dagg' PPO di njëkka saafara?
   • Coppite yu bari ci wàllu politik yuy yàq tàggat yaram
   • Done yu yeex
   • Dayo vokabileer
   • Jëfandikoo mémoire ci diiru inference
2. Ci xeetu làkk RLHF ak PPO, fan la siñaalu neexal bi di faral di jogee?
   • Njortu nit direct ci bepp token
   • ab xeetu neexal buñu tàggat
   • Tolluwaayu jàng bu optimisatër bi
   • Dayo vokabileer bi
3. Lan la penalti KL-divergence di def ci RLHF bu sukkandiko ci PPO?
   • Gaawaay defar ay token
   • Yokk njubte gi ci xeetu neexal bi
   • Dafay tere model biñ defar bu baax baña dem fu sori lool ci modelu royuwaay bi
   • Dina dindi soxla reso bu am solo
4. Lan mooy wareefu reso valeur (critique) ci PPO?
   • Ngir defar mbind mu mujj mi
   • Ngir denc done yiñ tàggat
   • Ngir wecci xeetu neexal bi lëmm
   • Xayma ndàmpaay bi ñuy seentu suko defee ñu mëna xayma njariñ yi
5. Luy 'njariñ' ci PPO?
   • Ñaata jëf moo gëna baax ci li ñu doon seentu ci ndoorte li
   • Tolluwaayu parametru model bi
   • Range de coupe
   • Koeffisien penalti KL
6. What distinguishes GRPO from PPO in the DeepSeekMath paper?
   • It removes all policy sampling and optimizes only supervised labels
   • It estimates relative advantages from groups of sampled responses without a separate value critic
   • It uses a trained reward model as a value network
   • It guarantees zero policy drift after one update
7. What probability ratio does PPO clip in its surrogate objective?
   • The reward divided by the number of prompts
   • The value estimate divided by the KL coefficient
   • The new policy’s action probability divided by the old policy’s action probability
   • The sequence length divided by batch size
8. Why is PPO called an on-policy method in its standard form?
   • It trains only on a static image dataset
   • It never samples actions
   • It updates only a reward model
   • It collects trajectories using the current policy being optimized