quiz bu lëkkale ak tegtal · Dëgër Niveau

Streaming buy xalaat ak quiz buy wax luy am ci token yu bari

Saytu projet de proposition yi, xool bu baax, prefix yiñ nangu, boppu token yu bari ak li tax tax ñu nangu ko dafay indi jafe-jafe ci gaawaayu dekodage bi.

Yooni njiit yu jëm ciStreaming buy xalaat ak wax luy am ci token yu bari
Laaj 1 de 8

Lan moo waral dekodage autorégressif buñ miin di yeex ci GPU bi?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. Lan moo waral dekodage autorégressif buñ miin di yeex ci GPU bi?
    • Token yi dañu leen di defar benn-benn, bàyyi GPU bi ñu jëfandikoowul bu baax ci jéego bu nekk
    • GPU bi dafay jeexal memory ci saasi
    • Dafa wara tàggataat ci token bu nekk
    • Baatu-baatu bi dafa tuuti lool
  2. Lu 'defarkat' di def ci dekodaas speculatif?
    • Dafay bind tontu bu mujj bi kese
    • Dafay proposer ay jeton ëlëg yu yomb
    • Dafay efaase ay jeton yu am probabilite bu néew
    • Dafay komprime diisaayu model bi
  3. naka lañuy denc kalite génne ci dekodaas speculatif?
    • Ni ñuy wërloo probabilite yi ba nul
    • Jëfandikoo vocabulaire bu gëna mag
    • Ci firndeel ni nangu rek ay token yu méngoo ak séddale biñ bëgga
    • Soo sànnee xool bu baax
  4. Lan moo wuutale Medusa ak dekodage speculatif bu yàgg bi?
    • Dafay laaj ñaari model yu mag yu wuute
    • Dafay dox ludul ci defar nataal
    • Dina dindi bépp paas bu jëm kanam
    • Dafay yokk yeneen boppu prediction yu woyof suko defee benn model defar te xool
  5. Lan moo waral transformateur bi mëna xool position candidat yu bari ci njëg yu yomb ni benn ci decodage bi?
    • Ndax dekodage mingi aju ci yaatuwaayu mémoire bi, nekkul ci ordinatër bi
    • Ndax dafay cache internet bi yépp
    • Ndax xool dafay sànni ay layers attention
    • Ndax gaawaayu montu GPU bi dafay yokk ñaari yoon
  6. Lan mooy njëkka wane gaawaay bi ci pexe spekulatif wala multi-token?
    • Kulòoru GPU bi
    • Limu token yiñ nangu ci jéego bu nekk
    • Guddaayig tur model bi
    • Dayo disk bi
  7. A draft proposes tokens A, B and C, but target verification first disagrees at B. Which proposal prefix can be accepted?
    • A, B and C
    • B and C only
    • A, the matching prefix before the first mismatch
    • None, even if A matches
  8. Why can speculative decoding preserve the target model’s output distribution?
    • The drafter is guaranteed to be identical to the target
    • The target model is never run
    • All proposed tokens are accepted unconditionally
    • A verification and correction rule accepts or rejects draft tokens according to the target distribution