BERT na Encoder Model
BERT nicyitegererezo cyururimi rusoma inyandiko mubyerekezo byombi icyarimwe kugirango wubake ibintu byinshi byerekana ibisobanuro.
Incamake
As an encoder model, it excels at understanding text rather than generating it, powering tasks like search, classification, and question answering.
Kwibira cyane
Yarekuwe na Google muri 2018, BERT (Guhagararira Encoder Guhagararirwa na Transformers) yahinduye gutunganya ururimi karemano hafi ijoro ryose. Bitandukanye na GPT-moderi isoma ibumoso ugana iburyo kugirango uhanure ijambo rikurikira, BERT isoma interuro yose icyarimwe, ukoresheje imiterere kuva kumpande zombi za buri jambo. Ibi byerekezo byombi bituma birushaho kuba byiza gusobanukirwa ibisobanuro. Kumenyereza ubu buryo, BERT ikoresha imvugo yerekana maskike: ihisha ku buryo butemewe guhisha hafi 15 ku ijana by'ibimenyetso kandi ikiga kuzuza ibibanza ikoresheje imiterere ikikije. Yatojwe kandi guhanura-interuro ikurikira kugirango yumve isano iri hagati yinteruro. Igitekerezo cyibanze cyari prerain-hanyuma-finetune: gutoza icyitegererezo kinini kumyandiko minini itanditse, hanyuma uyihuze bihendutse kubikorwa byihariye hamwe na dataset ntoya. BERT ni kodegisi yonyine, bityo itanga ibyashizwemo, ntabwo ari inyandiko-yubusa.
Ubushishozi
BERT ikoresha kodegisi ya kimwe cya kabiri cya transformateur, hamwe no kwiyitaho kureka buri kimenyetso cyitabira ikindi kimenyetso mubyerekezo byombi icyarimwe. Kuberako intego isanzwe ibumoso-iburyo yemerera icyitegererezo cyibice bibiri kubona igisubizo, BERT yerekana ibimenyetso kandi irabihanura, bihatira gusobanukirwa kwukuri. Nyuma yo kwitoza, mubisanzwe wongeyeho umurimo muto-wihariye umutwe hanyuma ugahuza neza icyitegererezo cyose. Abasimbuye nka RoBERTa batezimbere amahugurwa, mugihe DistilBERT na ALBERT bagabanije icyitegererezo cyihuta kandi neza.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka BERT na Encoder Model
Moderi ya Encoder ikomeza kuba inkingi yimirimo ikeneye gusobanukirwa kuruta ibisekuruza, nko gushakisha ibisobanuro, gushakisha, gutondekanya, no gutondekanya murwego. Mugihe moderi yerekana decoder ifata imitwe, BERT-umuryango wa kodegisi ya sisitemu itanga amashanyarazi atuje harimo Google Shakisha. Ibihe bizaza byerekeza kuri kodegisi ikora neza, indimi nyinshi hamwe na domaine yihariye, hamwe no guhuza byimazeyo hamwe nogusubirana-byongerewe imiyoboro, aho kodegisi yihuta ibona ibyangombwa byerekana uburyo bunini bwo kubyara noneho bukoresha mugusubiza.
Gushyira mu bikorwa Isi
Guha imbaraga Google Shakisha kugirango wumve neza intego yibibazo byibiganiro
Gukora interuro yashizwemo kugirango vector base ibone ibisobanuro bisa nibisobanuro
Gutondekanya abakiriya basubiramo nkibintu byiza cyangwa bibi kubisesengura amarangamutima kurwego
Gukuramo ibisubizo bivuye mu gice gikuramo ibibazo-bisubiza
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the BERT and Encoder Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Urutonde-Kuri-Urutonde
Ibibazo bikunze kubazwa
What is BERT and Encoder Models?
BERT nicyitegererezo cyururimi rusoma inyandiko mubyerekezo byombi icyarimwe kugirango wubake ibintu byinshi byerekana ibisobanuro. Nka moderi ya kodegisi, irusha gusobanukirwa inyandiko aho kuyitanga, imbaraga zakazi nko gushakisha, gutondekanya, no gusubiza ibibazo.
Niki 'byerekezo byombi' muri BERT bivuga?
Bitandukanye n'ibumoso-iburyo, BERT isuzuma imiterere yuzuye kumpande zombi za buri jambo icyarimwe, ikayiha kumva neza ibisobanuro.
Niyihe ntego nyamukuru yo kwitegura ituma BERT ibyerekezo byombi?
BERT ihisha hafi 15 ku ijana by'ibimenyetso kandi yiga kubihanura uhereye hafi, bisaba gukoresha ibyerekezo byombi kandi bikabuza kubona igisubizo gito.
Niki gice cyububiko bwa transformateur BERT ikoresha?
BERT nicyitegererezo cya kodegisi gusa, niyo mpamvu kabuhariwe mugutanga ibyerekana kugirango byumvikane aho kubyara inyandiko-yubusa.
Nubuhe buryo bwa 'pretrain-hanyuma-finetune' BERT ikunzwe?
BERT yateguwe ku nyandiko nini idashyizweho ikimenyetso, hanyuma igahuzwa neza na dataset ntoya yanditse kuri buri gikorwa cyo hasi, ikiza imbaraga nyinshi.
Ni ubuhe bwoko bw'ibisohoka BERT yagenewe kubyara umusaruro?
Nka kodegisi, BERT irusha abandi gukora ibyashizwe mubikorwa nko gutondekanya, gushakisha, no gusubiza ibibazo, ntabwo bitanga inyandiko ndende.