ELECTRA Kwitegura
ELECTRA nuburyo bwiza cyane bwo kwerekana imiterere yindimi ubigisha kubona amagambo yimpimbano aho gukeka ayihishe.
Incamake
It matches BERT's quality using a fraction of the compute.
Kwibira cyane
ELECTRA (Kwiga neza Encoder Itondekanya Gusimbuza Token neza), yatangijwe na Google na Stanford muri 2020, isimbuza BERT akazi kerekana ururimi-rwerekana-imvugo yerekana 'gusimbuza ibimenyetso.' Umuyoboro muto wa generator uhinduranya amagambo amwe mumurongo kugirango bishoboke, kandi icyitegererezo nyamukuru (ivangura) cyiga guhitamo, kuri buri kimenyetso kimwe, cyaba umwimerere cyangwa cyasimbuwe. Kuberako icyitegererezo cyitoza kubimenyetso byose aho kuba ~ 15% gusa masike ya BERT, yiga vuba cyane. ELECTRA-Ntoya yavuzwe ko irusha GPT ifite ubunini bugereranije yatojwe hamwe na compte 30x, naho ELECTRA-Kinini irwanya RoBERTa na XLNet ku gipimo cya GLUE mugihe ikoresha hafi kimwe cya kane cya compte.
Ubushishozi
Impinduka ebyiri zihugura hamwe. Imashini itanga imvugo yerekana imvugo kandi itanga ibimenyetso byo gusimbuza; ivangura rikora ibyiciro bibiri (nyabyo va byasimbuwe) kuri buri mwanya. Icy'ingenzi, igihombo kibarwa ku bimenyetso byose, ntabwo bipfutse gusa, bitanga ibimenyetso byimbitse. Ibice bibiri byerekana ibimenyetso, moteri ikomeza kuba nto (akenshi kimwe cya kane kugeza kimwe cya kabiri cy'ubunini bw'ivangura), hanyuma nyuma yo kwitegura generator ikajugunywa - gusa ivangura ryateguwe neza hepfo.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza ha ELECTRA Gutegura
Igitekerezo cya ELECTRA cyasimbuwe-token-detection cyagize ingaruka kuri kodegisi ikora neza nka DeBERTa-v3, ikayihuza hamwe no kutitandukanya kubisubizo bigezweho. Mugihe amashyirahamwe yita cyane kubiciro byamahugurwa hamwe nibirenge bya karubone, intego yo gutandukanya ivangura ikuramo ibimenyetso kuri buri kimenyetso ikomeza kuba nziza mu kubaka kodegisi zikomeye. Tegereza uburyo bwo gukomeza kumenyesha ibintu bito, byihuse kubushakashatsi bwibikoresho, gutondekanya, no kugarura aho moderi nini zitanga umusaruro.
Gushyira mu bikorwa Isi
Guha imbaraga inyandiko yihuta gutondekanya no gusesengura amarangamutima aho bikenewe, kodegisi yuzuye
Gukora nkumugongo wubushakashatsi bujyanye na sisitemu yo gutondekanya inyandiko
Kuringaniza neza ELECTRA-Ntoya kubikoresho cyangwa ibikoresho bito bya NLP hamwe na compte nkeya
Gukora nkibanze byibanze kuri kodegisi yo kumenyekana-kumenyekanisha no gusubiza ibibazo nkibipimo nka SQuAD na GLUE
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ELECTRA Pretraining quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Icyitegererezo cya XLNet
Ibibazo bikunze kubazwa
What is ELECTRA Pretraining?
ELECTRA nuburyo bwiza cyane bwo kwerekana imiterere yindimi ubigisha kubona amagambo yimpimbano aho gukeka ayihishe. Ihuye nubwiza bwa BERT ukoresheje agace ka compte.
Ni ikihe gikorwa cyo kwitegura ELECTRA ikoresha aho kwerekana imvugo yerekana mask?
ELECTRA itoza icyitegererezo kugirango imenye ibimenyetso byasimbuwe na generator, aho guhanura amagambo yapfutse.
Ni ukubera iki ELECTRA ikora neza kurusha BERT?
Ivangura rishyira ikimenyetso cyose nkukuri cyangwa cyasimbuwe, icyitegererezo rero cyigira kumyanya 100% aho kuba masketi gusa.
Ni uruhe ruhare umuyoboro muto wa generator ugira muri ELECTRA?
Imashini itanga imashini yerekana imvugo kandi itanga ibimenyetso bifatika, bigakora umurimo wo kuvangura.
Bigenda bite kuri generator nyuma yo kwitegura irangiye?
Gusa ivangura rirabikwa kandi rigakurikiranwa neza kubikorwa byo hasi; amashanyarazi ajugunywa kure.
ELECTRA yatejwe imbere cyane cyane nabashakashatsi baturutse mumiryango ki?
ELECTRA yatangijwe mu 2020 n'abashakashatsi bo muri Google na kaminuza ya Stanford.