Jumlada-BERT Isku-xidhka
Jumlada-BERT (SBERT) waxay la qabsataa BERT si ay u soo saarto halbeeg dhererkiisu go'an yahay jumlad dhan, marka macnuhu waxa la barbar dhigi karaa isu ekaanshiyaha cosine ee degdega ah.
Dulmar
It made semantic search and clustering over millions of sentences practical, turning a job that took BERT hours into milliseconds.
quusid qoto dheer
Plain BERT waxay is barbardhigi kartaa laba jumladood oo isku mid ah, laakiin kaliya iyada oo la wada quudiyo labadaba shabakadda, taas oo aad u gaabis ah qiyaasta: marka la barbardhigo 10,000 jumladood oo isku dhafan waxay u baahan tahay 50 milyan oo baas oo hore ah. Sentence-BERT, oo ay soo bandhigeen 2019 Reimers iyo Gurevych, ayaa tan ku hagaajiya iyagoo isticmaalaya shabakad siamese (mataano ah): laba munaaradood oo BERT ah oo leh miisaan la wadaago mid kastaa wuxuu si madaxbanaan u qeexayaa hal jumlad, ka dib tillaabo isku-duubni (caadiyan macnaheedu waa isku-biirsiga calaamadaynta) waxay soo saartaa hal vector jumlad kasta. Qaabka ayaa si fiican loo habeeyey si jumlado macne ahaan la mid ah ay u soo degaan meel u dhaw. Hadda jumlad kasta hal mar ayaa lagu dhejiyay dhejin dib loo isticmaali karo, isku ekaanshahana waxa ay noqotaa shey dhibco jaban, oo awood u siinaya raadinta, kala-saarista, iyo ururinta miisaan weyn.
Aragtida Farsamada
SBERT waxaa sida caadiga ah lagu tababaraa qaab dhismeedka siamese iyo ujeedo ka soo horjeeda ama saddex geesood ah. Xogta Dabiiciga ah ee Af-dabiiciga ah waa mid caadi ah: lammaanaha xiisaha leh waa la wada jiidaa, isburinayana waa la kala fogeynayaa. Labada munaaradood waxay wadaagaan miisaan, markaa codayntu waa summetrical. Macnaha isu geynta calaamada ugu dambeeya guud ahaan way ka wanaagsan tahay iyadoo la isticmaalayo calaamadda [CLS] oo keliya, taasoo soo saarta isku-xidhka halka isku midka ah ee cosine ay si kalsooni leh ula socoto isu-dhowaanshaha semantiga.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Weedhaha-BERT Ku-xidhnaanta
SBERT-style-ka-koobiyeyaasha hadda waxay xoojiyaan dib-u-soo-celinta-jiilka la kordhiyey, taasoo quudinaysa macnaha ku habboon moodooyinka luqadaha waaweyn. Goobtu waxa ay u socotaa moodooyinka wax-ku-xidhka ee wax-barida-la-habboon, ku-xidhka luuqadaha badan iyo hababka-badan, iyo matalayaasha Matryoshka oo cabbirkooda lagu gooyn karo xawaaraha. Tuubooyinka isku-dhafan waxay laba-laabanayaan soo-celinta degdegga ah ee laba-kodeeye-ku-soo-celinta oo leh dib-u-qiimeyn tartiib tartiib ah, isku-darka miisaanka SBERT iyo saxnaanta sare ee musharraxiinta sare.
Dhaqangelinta Adduunka-dhabta ah
Matoorada raadinta semantic waxay gundhigeen waydiinta iyo dukumeentiyada oo dhan, ka dib waxay soo celiyaan vector-ka ugu dhow halkii ay ku tiirsanaan lahaayeen isku dhafka kelmadaha.
Nidaamyada jiilka ee dib-u-soo-celinta-soo-celinta-kordhinta loo isticmaalo waxay isticmaalaan gundhigga SBERT si ay u keenaan tuducyo khuseeya jawaabaha chatbot-ka.
Aaladaha taageerada macmiilku waxa ay ururiyaan tigidhada soo galaya iyaga oo si toos ah ugu dhejinaya la mid ahaanshaha kooxda nuqul ama arrimaha la xidhiidha.
Maktabadda Python-ka beddelka jumlada waxay bixisaa moodooyinka SBERT ee horay loo sii tababaray ee macdan qodista iyo kala-soocidda qoraal isku mid ah.
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Sentence-BERT Embeddings quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Ku-xidhnaanshaha Dukumentiga mala-awaalka ah ee HyDE
Su'aalaha soo noqnoqda
What is Sentence-BERT Embeddings?
Jumlada-BERT (SBERT) waxay la qabsataa BERT si ay u soo saarto halbeeg dhererkiisu go'an yahay jumlad dhan, marka macnuhu waxa la barbar dhigi karaa isu ekaanshiyaha cosine ee degdega ah. Waxa ay samaysay baadhitaan macnawi ah iyo ururinta malaayiin jumladood oo wax ku ool ah, iyada oo u rogtay shaqo qaadatay saacadaha BERT millise seconds.
Waa maxay dhibatada udub-dhexaadka u ah BERT ee cad ee uu xalliyo jumlada-BERT?
BERT ee cad waa in ay si wadajir ah u habeeyaan jumladaha lammaane, sidaas awgeed isbarbardhigga cabbirka ballaaran ee laba-geesoodka ah waa wax aan macquul ahayn; SBERT waxay jumlad kasta hal mar ku dhejisaa vector dib loo isticmaali karo.
Waa maxay qaab-dhismeedka shabakadeed ee uu isticmaalo Sentence-BERT?
SBERT waxay isticmaashaa qaab-dhismeed siamese (mataan) ah halkaas oo laba cod-bixiyeyaal BERT ay wadaagaan miisaanka oo mid kastaa si madax-bannaan u gunto hal jumlad.
Istaraatiijiyadee is-biirsiyeedka ayaa inta badan lagula taliyaa ku-xidhka SBERT?
Macnaha isu geynta ka sarreeya calaamadihii ugu dambeeyay guud ahaan way ka wanaagsan tahay iyadoo la isticmaalayo calaamadda [CLS] oo keliya ee jumlada dhexda.
Marka weedhaha la dhex dhigo, sidee isku mid ahaanshahooda loo cabbiraa?
Dhammaan qodobka SBERT ayaa ah in isku ekaanshaha uu hoos u dhaco isbarbardhigga badeecada cosine/dhibcaha raqiis ah ee u dhexeeya vectors la sii xisaabiyay.
Waa maxay nooca xogta loo isticmaalo in lagu hagaajiyo SBERT?
Xogta NLI ayaa si weyn loo isticmaalaa: lammaane isku dhafan ayaa la isku soo jiidaa oo iska hor imaadyada ayaa la kala fogeeyaa, iyaga oo qaabeynaya meel la isku dhejiyo oo macno leh.