Ku-xidhka Kelmad-hoosaadka FastText
FastText waa habka Facebook AI ee 2016 kaas oo u taagan erey kasta sida boorso n-grams jilayaasha ah, si ay u dhisto vectors xitaa ereyada aysan waligood arkin inta lagu jiro tababarka.
Dulmar
This subword approach excels at morphologically rich languages, typos, and rare words where Word2Vec and GloVe fail.
quusid qoto dheer
FastText, oo ay soo saartay Facebook AI Research (Bojanowski, Grave, Joulin, Mikolov) ee 2016, waxay kordhisaa qaabka Skip-Gram iyadoo kelmad kasta u jebinaysa n-garaamyada dabeecadda. Erayga "meesha" ee leh n-grams dhererkiisu yahay 3 wuxuu noqonayaa <wh, wh, her, ere, re> oo lagu daray calaamadda ereyga oo buuxa, halkaas oo guntimaha xagasha ay ku calaamadiyaan xuduudaha ereyga. Halbeegga kelmadu waa wadarta unugyada n-gram. Tani waxay ka dhigan tahay FastText waxay u qori kartaa vector erey ka baxsan ereyada sida "la rumaysan karo" oo ka soo jeeda qaybo hoose oo la yaqaan, waxayna qabataa morphology la wadaago, sidaas darteed "orodka," "orodeeyaha," iyo "orodku" waxay la xiriiraan si dabiici ah. Isla mashruucan waxa kale oo uu raraa soociye qoraal toos ah oo degdeg ah ("fastText" qaabka la kormeero) ee loo isticmaalo hawlaha sida aqoonsiga luqadda iyo ku calaamadaynta cabbirka ballaaran.
Aragtida Farsamada
Dabeecad kasta n-gram waxa lagu haadiyaa miis baaldi cabbirkeedu go'an yahay waxaana loo qoondeeyey vector u gaar ah; Matalaadda kelmada waa wadarta qaybaheeda n-gram vectors, oo lagu tababaray muunada xun-xun ee ujeeddada Skip-Gram ee Word2Vec. Wadaagistan halbeegyada kelmad-hoosaadka ee guud ahaan kelmadaha ayaa ah sababta qaab-dhismeedka qaab-dhismeedku isu beddelo iyo sababta kelmadaha aan la arkin ay weli u helayaan fallaaro macquul ah. Kala soocida la kormeero waxay isticmaashaa moodal-bac-sifadeed la mid ah oo leh softmax heersare ah, taasoo ka dhigaysa mid aad ugu degdegsan CPU-yada.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Qoraal-hoosaadka FastText
Fikradda kelmad-hoosaadka FastText waxay caddeeyeen aasaas: transformers casri ah waxay isticmaalaan farsamooyinka la xidhiidha sida Byte-Pair Encoding iyo WordPiece tokenization si ay u maareeyaan wax kasta oo la geli karo iyada oo aan lahayn erayo go'an. Facebook ayaa sii daayay vectors FastText oo horay loo sii tababaray oo loogu talagalay 157 luqadood, iyada oo ku ilaalinaysa gundhigga gundhigga ee luuqadaha badan iyo kheyraadka hoose ee NLP halkaas oo moodooyinka waaweyni ay yihiin kuwo aan macquul ahayn. Maaddaama moodooyinka aaladaha yar yar iyo kuwa cidhifyada ahi ay helaan muhiimad, FastText raadkiisa yar iyo xawaaraha CPU waxay ku ilaalinayaan inay ku habboon tahay soocidda qoraalka.
Dhaqangelinta Adduunka-dhabta ah
Soo saarista faleebo loogu talagalay ereyada si khaldan loo higaadiyay ama aan waligood hore loo arag sida "runta" ama magacyo cusub
Isha furan ee Facebook ayaa horay loo tababaray oo daboolaya 157 luqadood oo loogu talagalay raadinta iyo ku dhejinta luqadaha badan
Aqoonsiga luqadda xawaaraha sare leh iyo kala soocida spam/mawduucyada mawduuca CPU iyada oo aan lahayn GPU
La tacaalida luqadaha hodanka ku ah qaab-dhismeedka sida Finnishka ama Turkiga halkaasoo erayadu ay ka kooban yihiin qaabab badan oo isbedbeddelaya
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the FastText Subword Embeddings quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Ku-xidhnaanshaha Matalaadda Matryoshka
Su'aalaha soo noqnoqda
What is FastText Subword Embeddings?
FastText waa habka Facebook AI ee 2016 kaas oo u taagan erey kasta sida boorso n-grams jilayaasha ah, si ay u dhisto vectors xitaa ereyada aysan waligood arkin inta lagu jiro tababarka. Habkan kelmad-hoosaadku waxa uu aad uga sarreeyaa afafka hodanka ku ah morphologically, qoraal-qoraal, iyo erayo naadir ah oo Word2Vec iyo GloVe ay ku fashilmaan.
Sidee buu FastText u metelaa kelmad keliya?
FastText waxay u kala jajabisaa kelmad kasta n-gram-yada jilayaasha waxayna isu keentaa faleebo si ay u sameeyaan matalaadda ereyga.
Waa maxay xaddidaadda weyn ee Word2Vec iyo GloVe ayaa FastText ka adkaadaa?
Sababtoo ah FastText waxay ka kooban tahay qaybo ka mid ah ereyada-hoosaadka, waxay dhisi kartaa matalaadda ereyada aysan waligood ku arag tababarka.
Erayga "halkee" oo leh 3-dabeecadood n-gram, kaas oo ah n-gram sax ah (oo leh calaamado xuduud)?
"meesha" waxay keentaa trigrams sida <wh, whe, her, ere, re>, oo lagu daray ereyga oo buuxa; "whe" waa mid ka mid ah.
Waa kuwee ujeeddada tababarka hoose ee FastText's ku-xidhka moodelku ku dhisayo?
FastText waxay ku fidisaa Skip-Gram oo leh ujeedo muunad taban, isaga oo ku daraya ereyada hoose ee n-gram vectors.
Waa maxay sababta FastText ay si gaar ah faa'iido ugu leedahay luqadaha sida Finnishka ama Turkiga?
Afafka hodanka ku ah morphological waxay soo saaraan qaabab kelmeed oo badan; Wadaagista ereyada hoose ee vectors waxay u ogolaataa FastText inay si dabiici ah ula xiriirto.