Guide-yakabatana mibvunzo · Zvakaoma Nhanho

Yekufungidzira Kutenderera uye Multi-Token Prediction Quiz

Inotarisa zvikumbiro zvekudhirowa, kutariswa kwechinangwa, prefixes inogamuchirwa, misoro-yechiratidzo yakawanda uye nei chiyero chekugamuchirwa chichikanganisa kukurumidza kudhirodha.

Nzira dzekutungamira dzinoenderanaYekufungidzira Kutenderera uye Multi Token Prediction
Mubvunzo 1 ye 8

Nei yakajairwa autoregressive decoding ichiwanzononoka paGPU?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. Nei yakajairwa autoregressive decoding ichiwanzononoka paGPU?
    • Tokeni anogadzirwa imwe panguva, achisiya iyo GPU isingashandiswe padanho
    • Iyo GPU inopera mundangariro nekukasira
    • Inofanira kudzokorora pane imwe neimwe chiratidzo
    • Mashoko acho idiki
  2. Ko 'mudhirowa' anoita sei mukufungidzira decoding?
    • Inonyora mhinduro yekupedzisira yega
    • Inokurudzira akati wandei emangwana tokens zvakachipa
    • Inobvisa zviratidzo zvishoma-zvingangoita
    • Inomanikidza maremu emuenzaniso
  3. Hunhu hwekubuda hunochengetedzwa sei mukufungidzira decoding?
    • Nekutenderedza zvingangoitika ku zero
    • Nokushandisa mashoko akakura
    • Nekusimbisa iyo inobvuma chete tokeni dzinoenderana nekugovera kwakanangwa
    • Nekudarika ongororo zvachose
  4. Chii chinosiyanisa Medusa-maitiro akawanda-token kufanotaura kubva kukirasi yekufungidzira decoding?
    • Inoda mhando mbiri dzakakura dzakasiyana
    • Inongoshanda chete kugadzira mufananidzo
    • Inobvisa kudiwa kwese kupfuudza mberi
    • Iyo inowedzera yakawedzera kureruka kufembera misoro kuitira kuti modhi imwe inyore uye inosimbisa
  5. Sei transformer ichigonesa zvigaro zvakawanda zvevamiriri zvakachipa seimwe panguva yekunyora?
    • Nekuti decoding indangariro-bandwidth yakasungwa, kwete compute yakasungwa
    • Nekuti inobata internet yese
    • Nekuti verification inodarika iyo yekutarisisa maseru
    • Nekuti iyo GPU wachi yekumhanyisa inowedzera kaviri
  6. Chii chinonyanya kutarisisa kukurumidza kubva kunzira dzekufungidzira kana dzakawanda-tokeni?
    • Ruvara rweGPU
    • Avhareji yenhamba yematokeni inogamuchirwa padanho
    • Hurefu hwezita remuenzaniso
    • Saizi ye diski
  7. A draft proposes tokens A, B and C, but target verification first disagrees at B. Which proposal prefix can be accepted?
    • A, B and C
    • B and C only
    • A, the matching prefix before the first mismatch
    • None, even if A matches
  8. Why can speculative decoding preserve the target model’s output distribution?
    • The drafter is guaranteed to be identical to the target
    • The target model is never run
    • All proposed tokens are accepted unconditionally
    • A verification and correction rule accepts or rejects draft tokens according to the target distribution