Kediska Xulashada Tooska ah

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

1. Maxay DPO baabi'isaa marka la barbar dhigo RLHF-dhaqameedka?
   • Qaabka abaalgudka gaarka ah iyo xoojinta barashada loop
   • Baahida loo qabo xog kasta oo doorbidida aadanaha
   • Qaabka luqadda ee hore loo tababaray
   • Isticmaalka log-probabilities
2. Waa maxay xogta uu ka kooban yahay hal tusaale tababar oo DPO ah?
   • Dhibcaha abaal-marin degdeg ah iyo lambarro
   • Dagdag leh jawaab la doortay iyo mid la diiday
   • Jawaab degdeg ah iyo hal jawaab oo sax ah
   • Kaliya wax soo saarka moodelka abaal-marinta
3. Doorkee buu ka ciyaaraa tusaalaha tixraaca ee DPO?
   • Waxay abuurtaa jawaabaha la diiday
   • Waxay ku dhalisaa jawaabaha abaal-marinno cad
   • Waa saldhigga barafsan ee siyaasadda lagu cabbiro si loo xaddido qulqulka
   • Waxay beddeshaa xogta tababarka
4. How does the DPO loss use a labeled preference pair?
   • It regresses both responses to the same scalar target
   • It trains a separate value critic to predict token-level returns
   • It maximizes the rejected response without a reference
   • It increases the chosen response’s policy-versus-reference log-ratio relative to the rejected response
5. Waa maxay qiyaasta beta (heerkulka) ee DPO?
   • Sida xooggan ee siyaasadda loogu hayo habka tixraaca
   • Heerka wax-barashada ee hagaajinta
   • Tirada lammaanaha doorbidida
   • Cabbirka ereyada
6. Which alignment objective can learn from binary feedback that an output is desirable or undesirable?
   • PPO, which requires a value critic for every label
   • KTO, a prospect-theoretic objective for binary desirability feedback
   • DARTS, which searches differentiable network cells
   • Beam search, which changes model weights from rankings
7. In a standard DPO preference example, which response is preferred?
   • The response with more tokens by definition
   • The response with the lowest reference likelihood
   • The response selected by the preference labeler for the given prompt
   • A random response unrelated to the prompt
8. In DPO, what expression serves as the implicit reward for a response, up to an input-dependent constant?
   • A separately trained scalar reward-model head
   • A human-written point score for each token
   • The average sequence length of preference data
   • Beta times the policy/reference log-probability ratio