Ikibazo gihuza ibibazo · Biragoye Urwego

Ikigereranyo Cyimyidagaduro na Multi-Token Ihanurwa Ikibazo

Kugenzura umushinga w'ibyifuzo, kugenzura intego, kwemeza prefixes, imitwe myinshi-n'impamvu igipimo cyo kwemerwa kigira ingaruka kumuvuduko wa decoding.

Ikibazo 1 Bya 8

Ni ukubera iki decode isanzwe ya autoregressive akenshi itinda kuri GPU?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ni ukubera iki decode isanzwe ya autoregressive akenshi itinda kuri GPU?
    • Tokens ikorwa icyarimwe, hasigara GPU idakoreshwa kuri buri ntambwe
    • GPU ibura kwibuka ako kanya
    • Igomba kongera imyitozo kuri buri kimenyetso
    • Amagambo ni mato cyane
  2. Niki 'uwashushanyije' akora muri decoding spekulifike?
    • Yandika igisubizo cyanyuma wenyine
    • Itanga abakandida benshi ibimenyetso bizaza bihendutse
    • Isiba ibimenyetso bike-bishoboka
    • Ihagarika uburemere bw'icyitegererezo
  3. Nigute ubuziranenge bwibisohoka bubitswe muri decoding?
    • Kuzenguruka amahirwe kuri zeru
    • Ukoresheje amagambo manini
    • Kugenzura kwemera ibimenyetso gusa bihuye nintego yo kugabura
    • Mugusiba verisiyo rwose
  4. Niki gitandukanya Medusa-yuburyo bwinshi bwo guhanura hamwe na decoding ya classique ya classique?
    • Irasaba moderi ebyiri zitandukanye
    • Ikora gusa kubyara amashusho
    • Ikuraho ibikenewe byose imbere
    • Yongeyeho imitwe yoroheje yo guhanura imitwe kuburyo icyitegererezo kimwe gishushanya kandi kigenzura
  5. Kuki transformateur ishobora kugenzura imyanya myinshi yabakandida hafi ya bihendutse nkimwe mugihe cya decoding?
    • Kuberako decoding ari memoire-bandwidth iboshye, ntabwo ibarwa
    • Kuberako ifata interineti yose
    • Kuberako verisiyo isimbuka ibitekerezo
    • Kuberako umuvuduko wamasaha ya GPU wikubye kabiri
  6. Niki cyambere kigena umuvuduko uva muburyo bwo gutekerezaho cyangwa ibimenyetso byinshi?
    • Ibara rya GPU
    • Impuzandengo y'ibimenyetso byemewe kuri buri ntambwe
    • Uburebure bwizina ryikitegererezo
    • Ingano ya disiki
  7. A draft proposes tokens A, B and C, but target verification first disagrees at B. Which proposal prefix can be accepted?
    • A, B and C
    • B and C only
    • A, the matching prefix before the first mismatch
    • None, even if A matches
  8. Why can speculative decoding preserve the target model’s output distribution?
    • The drafter is guaranteed to be identical to the target
    • The target model is never run
    • All proposed tokens are accepted unconditionally
    • A verification and correction rule accepts or rejects draft tokens according to the target distribution