quiz bu lëkkale ak tegtal · Diggante Niveau
Quiz biy waaja tàggat ELECTRA
Dafay leeral gis-gis biñ wecci token, cër generatër ak diskriminatër, jàng ci position token yi, ak yam ci méngale ordinatër.
Laaj 1 de 8
Ban liggéey la ELECTRA di jëfandikoo ci palaasu modelu làkk bu maske?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- Ban liggéey la ELECTRA di jëfandikoo ci palaasu modelu làkk bu maske?
- ñu wecci gis-gis token
- Prediction frase bi ci topp
- Xalaatal baat bu ci topp buy dellu ginaaw
- Modelu làkku permutasioŋ
- Lu tax ELECTRA gëna am njariñ ci xayma BERT?
- Dafay jëfandikoo vocabulaire bu gëna ndaw
- Dafay xayma siñaal jàng ci kaw jeton yépp, du ci kaw yiñ maske rek
- Dafay tàggat ci 15% ci jeton yiñ maske
- Dafay teggi mekaniismu bàyyi xel bi
- Ban cër la reso generatër bu ndaw bi di def ci ELECTRA?
- Dafay rang produit yu mujj yi ci kalite
- Dafay kompresse model bi ginaaw biñu ko tàggatee
- Dafay defar ay token yuñ mëna wecci ngir kiy xeex mën àtte
- Dafay tekki mbind diggante làkk yi
- Lan mooy dall generatër bi ginaaw bi ñu tàggatee ba noppi?
- Dañu ko jagleel liggéey bi ci suuf
- Dafa boole ak diskriminatër bi
- Dafay nekk decodeur ngir jamono
- Dañu koy sànni; diskriminatër bi kese lañuy jëfandikoo
- Gëstukat yu bawoo ci ban mbootaay ñoo njëkka defar ELECTRA?
- Google and Stanford
- AI ak NYU
- OpenAI ak Microsoft
- Deepmind ak Oxford
- Ban model ci ginaaw moo yokk xalaatu ELECTRA ci gis-token buñ wecci?
- GPT-2
- Deberta-v3
- T5
- Word2Vec
- What happens if ELECTRA’s generator proposes the original token at a position?
- It is always labeled replaced because the generator proposed it
- The position is removed from the input
- That token is treated as original by the discriminator’s replaced-token label
- The whole sequence is discarded
- When comparing ELECTRA with another pretraining method, what makes a compute claim meaningful?
- Compare model names alone
- Assume every ELECTRA run uses one fixed compute ratio
- Ignore generator training cost
- Specify model size, data, training budget, and evaluation setting