BERT da Model Encoder
BERT babban samfurin harshe ne wanda ke karanta rubutu a bangarorin biyu lokaci guda don gina ingantacciyar ma'ana.
Dubawa
As an encoder model, it excels at understanding text rather than generating it, powering tasks like search, classification, and question answering.
Zurfafa nutsewa
An sake shi ta Google a cikin 2018, BERT (Wakilan Encoder na Bidirectional daga Masu Canjawa) sun canza sarrafa harshe na halitta kusan dare ɗaya. Ba kamar nau'ikan nau'ikan GPT waɗanda ke karanta hagu zuwa dama don tsinkayar kalma ta gaba ba, BERT tana karanta jimlar gabaɗaya a lokaci ɗaya, ta amfani da mahallin daga bangarorin biyu na kowace kalma. Wannan ra'ayi na bidirection yana sa ya fi kyau a fahimtar ma'ana. Don horar da wannan hanyar, BERT tana amfani da ƙirar harshe da aka rufe: tana ɓoye kusan kashi 15 cikin 100 na alamomi ba da gangan ba kuma ta koyi cike gurbi ta amfani da mahallin kewaye. An kuma horar da shi kan hasashen jumla na gaba don fahimtar alakar da ke tsakanin jimloli. Tunanin ci gaba shine pretrain-to-finetune: horar da babban samfuri akan babban rubutu mara lakabi, sannan daidaita shi da rahusa zuwa takamaiman ayyuka tare da ƙaramin alamar bayanai. BERT ƙirar ƙira ce kawai, don haka tana samar da abubuwan haɗawa, ba rubutu mai gudana kyauta ba.
Fahimtar Fasaha
BERT yana amfani da maɓalli ne kawai na rabin na'ura, tare da kulawar kai wanda ke ba da damar kowane alamar ta halarci kowane alamar a kowane kwatance a lokaci guda. Saboda manufar hagu-dama na al'ada na yau da kullun zai bari samfurin bidirection ya ga amsar da sauƙi, BERT ya rufe alamun da tsinkayar su, wanda ke tilasta fahimtar gaskiya. Bayan riga-kafi, yawanci kuna ƙara ƙaramin kan takamammen ɗawainiya kuma ku daidaita tsarin gaba ɗaya. Masu nasara kamar RoBERTa sun inganta girke-girke na horo, yayin da DistilBERT da ALBERT suka rushe samfurin don sauri da inganci.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar BERT da Model Encoder
Samfuran maɓalli sun kasance ƙashin bayan ayyuka waɗanda ke buƙatar fahimta maimakon tsarawa, kamar bincike na ma'ana, dawo da, sakewa, da rarrabuwa a ma'auni. Yayin da ƙirar ƙirar ƙirar ƙira ke ɗaukar kanun labarai, BERT-iyali suna ruɗar tsarin samar da wutar lantarki cikin nutsuwa gami da Google Bincika. Na gaba yana nuni zuwa ga ingantaccen encoders, harsuna da yawa da takamaiman bambance-bambancen yanki, da ƙaƙƙarfan haɗin kai tare da haɓaka bututun tsarawa, inda mai rikodin rikodin sauri ya sami takaddun dacewa waɗanda mafi girman ƙirar ƙira ke amfani da su don amsawa.
Aiwatar da Gaskiyar Duniya
Ƙarfafa Google Bincika don ƙarin fahimtar manufar tambayoyin tattaunawa
Ƙirƙirar abubuwan shigar da jumla ta yadda ma'aunin bayanai na vector zai iya samun takaddun kamanceceniya ta ma'ana
Rarraba sake dubawa na abokin ciniki azaman tabbatacce ko mara kyau don nazarin jin daɗi a sikelin
Ana fitar da amsoshi daga nassi a cikin tsarin amsa tambayoyi masu tsauri
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the BERT and Encoder Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Samfuran Jeri-zuwa-Jeri
Tambayoyin da ake yawan yi
What is BERT and Encoder Models?
BERT babban samfurin harshe ne wanda ke karanta rubutu a bangarorin biyu lokaci guda don gina ingantacciyar ma'ana. A matsayin abin ƙira, ya yi fice wajen fahimtar rubutu maimakon samar da shi, yana ƙarfafa ayyuka kamar bincike, rarrabuwa, da amsa tambaya.
Menene 'bidirectional' a cikin BERT ke nufi?
Ba kamar ƙirar hagu-da-dama ba, BERT tana la'akari da cikakken mahallin a ɓangarorin kowane kalma a lokaci guda, yana ba ta ƙarin fahimtar ma'ana.
Menene babban makasudin horaswar da ke sa BERT ta zama bidirectional?
BERT yana ɓoye kusan kashi 15 cikin ɗari na alamun kuma ya koyi yin tsinkaya daga mahallin da ke kewaye, wanda ke buƙatar amfani da duka kwatance kuma yana hana shi ganin amsar da sauƙi.
Wanne bangare na gine-ginen transfoma ke amfani da BERT?
BERT ƙirar ƙira ce kawai, wanda shine dalilin da ya sa ya ƙware wajen samar da wakilci don fahimta maimakon samar da rubutu mai gudana kyauta.
Menene tsarin 'pretrain-the-finetune' BERT ya shahara?
BERT an riga an horar da shi akan babban rubutu mara lakabi, sannan an daidaita shi tare da ƙaramin saitin bayanai don kowane aiki na ƙasa, yana adana babban ƙoƙari.
Wane irin fitarwa ne BERT da farko ƙera don samarwa?
A matsayin encoder, BERT ta yi fice wajen samar da abubuwan haɗawa don ayyuka kamar rarrabuwa, bincike, da amsa tambaya, ba wajen samar da dogon rubutu ba.