ELECTRA Tababarka ka Hor
ELECTRA waa hab wax ku ool ah oo lagu hormariyo moodooyinka luqadda iyadoo la barayo inay ogaadaan kelmadaha been abuurka ah halkii ay ka qiyaasi lahaayeen kuwa qarsoon.
Dulmar
It matches BERT's quality using a fraction of the compute.
quusid qoto dheer
ELECTRA (Si hufan u Barashada Cod-bixiye si sax ah u kala saara beddelka calaamadeeyaha), oo ay soo bandhigeen Google iyo Stanford sanadka 2020, waxay BERT ku bedeshaa qaabaynta-qaabaynta luuqadda waji-xidhan ee 'soo saarista calaamada beddelka'. Shabakadda koronto-dhaliyaha yar ayaa kelmado jumlad ah u beddela qaar ka mid ah beddelka macquulka ah, iyo qaabka ugu weyn (kala-takoorku) wuxuu bartaa inuu go'aan ka gaaro, calaamad kasta, haddii ay asal tahay ama la beddelo. Sababtoo ah moodelku wuxuu ku tababaraa dhammaan calaamadaha halkii uu ka ahaan lahaa kaliya ~ 15% ee BERT maaskaro, waxay u barataa si dhakhso leh. ELECTRA-Small ayaa lagu soo warramey in ay ka sarreyso GPT la mid ah oo lagu tababaray 30x kombuyuutar dheeri ah, iyo ELECTRA-Large RoBERTa iyo XLNet oo ku xifaaltamay GLUE bartilmaameedka iyadoo la isticmaalayo qiyaas ahaan rubuc kombuyuutarka.
Aragtida Farsamada
Laba transformer ayaa si wadajir ah u tabobaran. Koronto-dhaliye wuxuu sameeyaa qaabaynta luqadda waji-xidhan wuxuuna soo jeedinayaa beddelka calaamadaha; Takoorku wuxuu sameeyaa kala soocida binary (dhab vs. bedelay) meel kasta. Muhiimad gaar ah, khasaaraha waxaa lagu xisaabiyaa dhammaan calaamadaha, ma aha oo kaliya kuwa waji-xidhan, taasoo siinaysa calaamad waxbarasho oo cufan. Labada calaamadood ee wadaaga ah, koronto-dhaliyaha ayaa lagu hayaa mid yar (badanaa rubuc ilaa kala badh cabbirka takoorka), ka dib markii hore loo tababaray koronto-dhaliye waa la tuuray - kaliya takooriyuhu si fiican ayuu u hagaajiyay dhinaca hoose.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Tababarka Hordhaca ah ee ELECTRA
Fikradda ELECTRA ee beddelka-calaamad-helidda waxay saameyn ku yeelatay cod-bixiyeyaal wax-ku-ool ah oo dambe sida DeBERTa-v3, kaas oo ay ku dareen dareen-la'aaneed natiijooyinka casriga ah. Sida ururadu aad u daneeyaan kharashka tababarka iyo raadraaca kaarboonka, ujeedooyinka tababbarka horudhaca ah ee takoorka ah ee ka tuujiya calaamada calaamad kasta ayaa ah mid soo jiidasho leh si loo dhiso codeeyayaal adag. Filo habka lagu sii wargelinayo moodooyinka yaryar ee degdega ah ee goobidda aaladda, kala soocidda, iyo soo celinta halkaasoo moodooyinka wax-soo-saarka ee waaweyni ay yihiin kuwo xad-dhaaf ah.
Dhaqangelinta Adduunka-dhabta ah
Awoodaynta kala soocida qoraalka degdega ah iyo falanqaynta dareenka halka loo baahan yahay codeer sax ah oo kooban
U adeegida sidii laf dhabarta ku habboon raadinta iyo nidaamyada darajo dukumeenti
Hagaajinta ELECTRA-yar ee qalabka ama hawlaha NLP daahsoon ee hooseeya oo leh xisaab xaddidan
Ku shaqaynta sidii cod-bixiye xooggan oo aasaasi ah oo loogu talagalay aqoonsiga cidda- magacaaban iyo bartilmaameedyada su'aalaha-jawaabista sida SQuAD iyo glue
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ELECTRA Pretraining quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Qaabaynta Permutation XLNet
Su'aalaha soo noqnoqda
What is ELECTRA Pretraining?
ELECTRA waa hab wax ku ool ah oo lagu hormariyo moodooyinka luqadda iyadoo la barayo inay ogaadaan kelmadaha been abuurka ah halkii ay ka qiyaasi lahaayeen kuwa qarsoon. Waxay la mid tahay tayada BERT iyadoo la isticmaalayo qayb ka mid ah xisaabinta.
Waa maxay hawsha tababarka ka hor ay ELECTRA isticmaashaa halkii ay ka isticmaali lahayd qaabaynta luqadda waji-xidhan?
ELECTRA waxay ku tababartaa qaabka si loo ogaado calaamadaha lagu beddelay koronto-dhaliye, halkii ay saadaalin lahaayeen ereyada daboolan.
Maxay ELECTRA uga waxtar badan tahay xisaabinta BERT?
Takooruhu waxa uu calaamad kasta u kala saarayaa mid run ah ama la bedelay, marka moodeelku waxa uu wax ka bartaa 100% boosaska halkii uu ka ahaan lahaa qaybta hoose ee daboolan.
Door intee le'eg ayay ka ciyaartaa shabakadda koronto-dhaliye ee ELECTRA?
Koronto-dhaliyuhu waxa uu sameeyaa qaabaynta luqadda daboolan oo waxa uu keenaa calaamado been abuur ah oo macquul ah, isaga oo hawsha u abuuraya takoorista.
Maxaa ku dhacaya koronto-dhaliyaha ka dib markii tababarka hore la dhammeeyo?
Kaliya takooraha ayaa la hayaa oo si fiican loo habeeyey hawlaha hoose; matoorkii waa la tuuray.
ELECTRA waxaa hormariyay cilmi-baarayaal ka socda hay'adee?
ELECTRA waxaa lagu soo bandhigay 2020 cilmi-baarayaal jooga Google iyo Jaamacadda Stanford.