Kedis ku xidhan hagaha · Adag Heerka

Kediska Hagaajinta Siyaasadda Qaraabada Kooxda

Dalbo abaalmarinta kooxda GRPO caadiyeynta, ka saarida dhaleeceynta, iyo habaynta siyaasadda tixraaca, oo ay ku jiraan faa'iidooyinka qaraabada ah macnaheedu waa hal degdeg.

Wadooyinka haga ee la xidhiidhaHorumarinta Siyaasadda Qaraabada ee Kooxda
Su'aal 1 ee 8

Which separately learned estimator does the original GRPO approach avoid training?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. Which separately learned estimator does the original GRPO approach avoid training?
    • The policy that generates completions
    • A value or critic model
    • Every possible reward function
    • The reference policy’s vocabulary
  2. Sidee GRPO u xisaabisaa faa'iidada dhamaystirka la siiyay?
    • Adiga oo waydiinaya madaxa qiimaha la bartay calaamad kasta
    • Adigoo isticmaalaya abaal-marin cayriin ah oo aan caadi ahayn
    • Iyadoo la barbar dhigayo dhamaystirka dardar kale
    • Iyada oo la jaan-qaadaysa abaal-marinteeda ka dhanka ah celceliska iyo weecashada heerka kooxeed ee dhammaystirka walaalaha
  3. Qaabkee ayaa GRPO si fiican u yaqaan?
    • DeepSeek's DeepSeekMath iyo DeepSeek-R1 moodooyinka sababaynta
    • Taxanaha GPT-2 OpenAI
    • Google BERT ee asalka ahaa
    • Meta's Llama 2 moodooyinka salka
  4. Doorkee ayuu ereyga KL-kala-duwanaanshaha ku leeyahay GRPO?
    • Waxay abuurtaa kooxda dhamaystirka
    • Waxay beddeshaa qaabka abaalmarinta
    • Waxay ka ilaalinaysaa siyaasadda la tababaray inay aad uga fogaato qaabka tixraaca ee la qaboojiyey
    • Waxay xisaabinaysaa qiyaasta qiimaha calaamad kasta
  5. Waa maxay sababta GRPO ay si gaar ah ugu soo jiidanayso moodooyinka sababaynta tababarka ee xisaabta ama koodka?
    • Uma baahna calaamad abaal marin haba yaraatee
    • Waxa kaliya oo ay la shaqeysaa calaamadaha doorbidida aadanaha
    • Ma isticmaali karto dhamaystir muunad la sameeyay
    • Waxay si dabiici ah ugu shaqeysaa abaal-marinno la xaqiijin karo, qaanuun-ku-saleysan (tusaale, jawaabtu ma is-waafajisay ama imtixaanaadkii baa gudbay) oo laga dhaliyay guud ahaan koox xalal muunad ah
  6. Waa maxay eexda la og yahay ee shaqada daba-galka ah (sida Dr. GRPO) isku daydo inay ku saxdo vanilj GRPO?
    • U janjeerta in la iska indho tiro abaal-marinta gabi ahaanba
    • Dhererka iyo eexda dhibka leh ee ay soo bandhigtay sida abaal-marinaha loo caadiyeeyo
    • Awood la'aanta in la tijaabiyo wax ka badan hal dhammaystir
    • Shuruud looga baahan yahay shabakad naqdiya oo aad u weyn
  7. Three GRPO completions for one prompt receive rewards 2, 4, and 6. Which completion has zero centered advantage?
    • The completion rewarded 2
    • The completion rewarded 6
    • The completion rewarded 4
    • All completions because rewards differ
  8. Why compare GRPO reward statistics among completions of the same prompt?
    • They provide a relative baseline for alternative answers to that prompt
    • They require unrelated prompts to have equal difficulty
    • They replace checking whether an answer is correct
    • They make the highest reward identical across all tasks