Ikibazo gihuza ibibazo · Hagati Urwego

Medusa Decoding Imitwe Ikibazo

Ongera usubiremo Medusa imitwe myinshi yo guhanura imitwe, ibiti by'abakandida, kugenzura ibiti-kwitondera, kwemererwa-prefix kwemerwa, no kubika gukwirakwiza.

Inzira zijyanye no kuyoboraUmutwe wa Medusa
Ikibazo 1 Bya 8

Niki imitwe yinyongera ya Medusa ihanura?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Niki imitwe yinyongera ya Medusa ihanura?
    • Ibimenyetso byinshi bizaza kumwanya utandukanye imbere
    • Gutakaza imyitozo yicyitegererezo
    • Nibihe GPU yo gukoresha
    • Igishushanyo cyanditseho ikimenyetso
  2. Under which Medusa configuration does the paper describe lossless inference acceleration?
    • Ihagarika uburemere bwikitegererezo neza
    • Medusa-1 with a frozen backbone and exact verification against the original model
    • Ntabwo ikora amakosa mu kibonezamvugo
    • Ikuraho ibikenewe byamagambo
  3. Ni ubuhe buryo abakandida ba Medusa bakomeza kugira ngo bagenzurwe?
    • Urutonde ruringaniye rwatsinze umwe umwe
    • Imbonerahamwe ya hash
    • Igiti cyatsindiye muri pass imwe hamwe na mask yo kwitondera igiti
    • Gusubiramo inshuro kuri buri kimenyetso
  4. Ni izihe nyungu zingenzi za Medusa kurenza umushinga-moderi udasanzwe?
    • Irasaba moderi ebyiri zitandukanye
    • Ikora kumashusho gusa
    • Isiba icyitegererezo cyibanze nyuma yo gukoreshwa
    • Irinda gukenera umushinga wihariye wongeyeho imitwe kuririho
  5. Hafi ya niyihe umuvuduko Medusa atangaza?
    • Hafi ya 2-3x
    • Hafi ya 0.5x (gahoro)
    • Nukuri 100x
    • Nta mpinduka zifatika
  6. Ni uwuhe mutwe wa Medusa ku giti cye, mubwubatsi?
    • Impinduramatwara yuzuye
    • Agace gato gasigaye kugaburira-imbere (MLP) hejuru yibice byihishe leta
    • Kode yerekana ishusho
    • Ikimenyetso gitandukanye
  7. What does Medusa accept from a verified candidate tree?
    • Every speculative branch regardless of verification
    • Only the shortest candidate token
    • The longest prefix consistent with the base model’s decoding result
    • A random leaf from the tree
  8. How do Medusa’s prediction-head offsets differ?
    • Every head predicts the same next token
    • Each head predicts a different vocabulary
    • The heads predict tokens only after decoding is complete
    • Each head predicts a token at a different position ahead in the sequence