Ikibazo gihuza ibibazo · Hagati Urwego

Ikibazo Cyururimi Cyerekana Ikibazo

Sobanukirwa nicyitegererezo cyururimi rwerekana, BERT ya token-gutoranya gahunda hanyuma ubundi buryo bwo kwitegura byombi.

Inzira zijyanye no kuyoboraKwerekana Ururimi
Ikibazo 1 Bya 8

Ni ubuhe butumwa bwibanze bwo guhugura mu kwerekana ururimi rwihishwa?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ni ubuhe butumwa bwibanze bwo guhugura mu kwerekana ururimi rwihishwa?
    • Guteganya amagambo yihishe nkana uhereye kumiterere
    • Guteganya ijambo rikurikira nyuma yinteruro
    • Guhindura inyandiko hagati yindimi ebyiri
    • Gutondekanya interuro ukurikije ikibonezamvugo
  2. Hafi ya ijanisha ryibimenyetso BERT isanzwe ihisha mugihe cyo kwitegura?
    • Abagera kuri 50%
    • Abagera kuri 15%
    • Hafi ya 1%
    • Abagera kuri 90%
  3. Kuki MLM itanga icyitegererezo cyicyerekezo cyombi?
    • Isoma interuro inyuma
    • Ikoresha uburyo bubiri butandukanye
    • Buri kimenyetso cyitabira amagambo ibumoso n'iburyo
    • Ireba gusa ijambo ryabanjirije
  4. Muri gahunda ya mask ya BERT, bigenda bite nka 10% yimyanya yatoranijwe aho kuba [MASK]?
    • Zasibwe burundu
    • Bariganye
    • Byanditswe mu nyuguti nkuru
    • Basimbuwe nijambo ridasanzwe
  5. Ni iyihe myanya igihombo cya MLM kibarwa?
    • Imyanya yapfunditswe gusa
    • Ikimenyetso cyose mu nteruro
    • Gusa icyambere nicyanyuma
    • Utumenyetso two kuruhuka gusa
  6. Ugereranije nubutaha-ibimenyetso, MLM igurisha iki?
    • Ubushobozi bwo gukoresha imiterere
    • Ubushobozi bwo kubyara inyandiko neza ibumoso-iburyo
    • Kugera ku magambo
    • Gukoresha ibitekerezo
  7. How does RoBERTa’s dynamic masking differ from BERT’s original setup?
    • It masks only the first token of every sentence
    • It predicts future tokens with a causal decoder
    • The masked positions can be regenerated across training passes instead of remaining fixed
    • It replaces all masked tokens with random numbers
  8. What auxiliary objective did the original BERT pretraining recipe combine with MLM?
    • Image patch reconstruction
    • Audio speaker diarization
    • A reward model for code generation
    • Next-sentence prediction