Ikibazo gihuza ibibazo · Hagati Urwego

Induction Imitwe muri Transformers Ikibazo

Ongera usuzume induction ibanziriza guhuza, amakuru yabanjirije, imirongo yambukiranya imipaka, kwitegereza amahugurwa, nimbibi zuburyo bwo kwiga.

Inzira zijyanye no kuyoboraInduction Imitwe muri Transformers
Ikibazo 1 Bya 8

Ni irihe tegeko umutwe wa induction ushyira mubikorwa?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ni irihe tegeko umutwe wa induction ushyira mubikorwa?
    • Vuga ibimenyetso bikunze kugaragara mururimi
    • Buri gihe wandukure ibimenyetso byabanjirije bidahindutse
    • Mubisanzwe uhindure ibimenyetso byerekana imiterere
    • Reba [A] [B] mbere, hanyuma kuri [A] ongera uhanure [B]
  2. What capability was linked to induction-head behavior in the cited 2022 study?
    • In-context learning in the examined models, with broader large-model claims framed as hypotheses
    • A proof that every form of reasoning uses only one identical circuit
    • Changing the tokenizer vocabulary during every prompt
    • Permanent weight updates whenever a repeated token appears
  3. Ni uruhe ruhare 'umutwe-wambere-ikimenyetso' ugira uruhare muri induction?
    • Itanga softmax yanyuma
    • Ikuraho amakuru yumwanya
    • Ikoporora buri kimenyetso cyabanjirije amakuru imbere kugirango guhuza bishobora kubaho
    • Nibisanzwe uburemere bwibitekerezo
  4. Ni bangahe imitwe yitabwaho mubisanzwe bigira uruhare mukuzunguruka kwa Canonical?
    • Nukuri
    • Babiri, bigizwe hejuru
    • Amajana murwego rumwe
    • Zeru; ni kugaburira-imbere gusa
  5. What training relationship did the induction-head study report in the models it examined?
    • Head formation coincided with changes in loss behavior and increased in-context learning
    • All heads were fully formed before any training
    • Induction behavior could only appear after every parameter was frozen forever
    • The same exact training transition must occur in every future model
  6. Ni uwuhe murimo umutwe wa induction wakemura cyane?
    • Kubara icyiciro cya numero
    • Kugabanya uburemere bw'icyitegererezo
    • Shishoza ikibazo cyinjiza
    • Gusubiramo urukurikirane wandukuye ibyakurikiye ibimenyetso bihuye mbere
  7. What roles do query-key matching and the output-value path play in the canonical induction circuit?
    • Query-key computations generate the final text filename; output-value computations train the tokenizer
    • Query-key computations select the matching context position; output-value computations promote the token information there
    • Both paths only count the total number of context words
    • The output-value path selects a position without any attention pattern
  8. Does a demonstrated two-head induction circuit prove that every large-model in-context task uses that mechanism alone?
    • Yes; every architecture and prompt has already been causally tested
    • Yes; no other network computation can influence a prediction
    • No; the wider explanation remains a hypothesis needing model- and task-specific evidence
    • Only the number of parameters determines whether the proof is universal