Ikibazo gihuza ibibazo · Hagati Urwego
Ikibazo Cyururimi Cyerekana Ikibazo
Sobanukirwa nicyitegererezo cyururimi rwerekana, BERT ya token-gutoranya gahunda hanyuma ubundi buryo bwo kwitegura byombi.
Ikibazo 1 Bya 8
Ni ubuhe butumwa bwibanze bwo guhugura mu kwerekana ururimi rwihishwa?
Reba buri kibazo8 ibibazo
Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.
- Ni ubuhe butumwa bwibanze bwo guhugura mu kwerekana ururimi rwihishwa?
- Guteganya amagambo yihishe nkana uhereye kumiterere
- Guteganya ijambo rikurikira nyuma yinteruro
- Guhindura inyandiko hagati yindimi ebyiri
- Gutondekanya interuro ukurikije ikibonezamvugo
- Hafi ya ijanisha ryibimenyetso BERT isanzwe ihisha mugihe cyo kwitegura?
- Abagera kuri 50%
- Abagera kuri 15%
- Hafi ya 1%
- Abagera kuri 90%
- Kuki MLM itanga icyitegererezo cyicyerekezo cyombi?
- Isoma interuro inyuma
- Ikoresha uburyo bubiri butandukanye
- Buri kimenyetso cyitabira amagambo ibumoso n'iburyo
- Ireba gusa ijambo ryabanjirije
- Muri gahunda ya mask ya BERT, bigenda bite nka 10% yimyanya yatoranijwe aho kuba [MASK]?
- Zasibwe burundu
- Bariganye
- Byanditswe mu nyuguti nkuru
- Basimbuwe nijambo ridasanzwe
- Ni iyihe myanya igihombo cya MLM kibarwa?
- Imyanya yapfunditswe gusa
- Ikimenyetso cyose mu nteruro
- Gusa icyambere nicyanyuma
- Utumenyetso two kuruhuka gusa
- Ugereranije nubutaha-ibimenyetso, MLM igurisha iki?
- Ubushobozi bwo gukoresha imiterere
- Ubushobozi bwo kubyara inyandiko neza ibumoso-iburyo
- Kugera ku magambo
- Gukoresha ibitekerezo
- How does RoBERTa’s dynamic masking differ from BERT’s original setup?
- It masks only the first token of every sentence
- It predicts future tokens with a causal decoder
- The masked positions can be regenerated across training passes instead of remaining fixed
- It replaces all masked tokens with random numbers
- What auxiliary objective did the original BERT pretraining recipe combine with MLM?
- Image patch reconstruction
- Audio speaker diarization
- A reward model for code generation
- Next-sentence prediction