Ijambo2Vec Skip-Gram na CBOW
Word2Vec ni tekinike ya 2013 kuva Google yiga ibice byuzuye byamagambo mu guhanura amagambo yabaturanyi babo, guhindura ururimi muri geometrie aho amagambo asa yicaye hamwe.
Incamake
It made the famous "king - man + woman ≈ queen" analogy possible and kicked off the modern embedding era.
Kwibira cyane
Ijambo2Vec, ryatangijwe na Tomas Mikolov na bagenzi be kuri Google muri 2013, ryiga vector (mubisanzwe imibare 100-300) kuri buri jambo uhugura urusobe rudasanzwe rw'imitsi ibiri ku idirishya. Iza muburyo bubiri. CBOW (Umufuka uhoraho wamagambo) ufata amagambo akikije amagambo kandi uhanura ijambo ryabuze hagati, ugereranije ibice byerekanwe hamwe. Skip-Gram ihindura ibi: ifata ijambo hagati kandi igerageza guhanura buri jambo rikikije ijambo. Icyitegererezo nticyigera cyita kubikorwa byo guhanura ubwabyo; intego nuburemere matrix yiga munzira, imirongo yayo ihinduka ijambo vectors. Amagambo agaragara mubice bisa birangirana na vectors, ifata ibisobanuro gusa bivuye hamwe.
Ubushishozi
Kumenyereza software yuzuye hejuru yamagambo manini biratinda cyane, Word2Vec rero ikoresha amayeri nkurugero rwiza, rusubiramo ibyahanuwe nkibice bibiri: tandukanya ijambo ryukuri ryukuri namagambo make "mabi". Irasubiramo kandi amagambo akunze gukoreshwa nka "the" kandi ikoresha unigram-yazamuye-kuri-0,75 kugirango igabanye ibibi. CBOW irihuta kandi nziza kumagambo akunze; Skip-Gram hamwe nicyitegererezo cyiza gikora amagambo adasanzwe na corpora nto neza.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Word2Vec Skip-Gram na CBOW
Kwinjiza bihamye nka Word2Vec byasimbuwe ahanini nicyitegererezo (ELMo, BERT, transformateur) gitanga ijambo ibice bitandukanye ukurikije imiterere yinteruro, bikemura ikibazo cya polysemy aho "banki" ifite icyerekezo kimwe gihamye. Nyamara Word2Vec yihanganira aho umuvuduko, ubworoherane, hamwe no gusobanurwa: sisitemu yo gutanga inama, gushakisha, kandi nkishingiro ryigisha. Igitekerezo cyacyo cyibanze, icyo gisobanuro kiva mubibare bibaye hamwe, bikomeza kuba uburiri bwurugero rwindimi zose zigezweho.
Gushyira mu bikorwa Isi
Spotify na Airbnb bahinduye Skip-Gram kugirango bige gushira indirimbo hamwe nurutonde ("ingingo2vec") uhereye kumurongo wabakoresha kugirango bakore ibyifuzo
Imbaraga zo gushakisha ibisobanuro no kwagura ibisobanuro bityo ikibazo cya "laptop" nacyo kigaragara "ikaye" na "mudasobwa"
Gutahura ibigereranyo nubusabane mubyanditswe, nkumurwa mukuru wibihugu byombi (Paris nu Bufaransa nkuko Tokiyo iri mu Buyapani)
Gutangiza ibyinjijwemo imiyoboro minini ya NLP yo gusesengura amarangamutima no gutondekanya inyandiko ku makuru make
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Word2Vec Skip-Gram and CBOW quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Imiyoboro Yumuhanda no Gusimbuka
Ibibazo bikunze kubazwa
What is Word2Vec Skip-Gram and CBOW?
Word2Vec ni tekinike ya 2013 kuva Google yiga ibice byuzuye byamagambo mu guhanura amagambo yabaturanyi babo, guhindura ururimi muri geometrie aho amagambo asa yicaye hamwe. Byatumye igereranya rizwi cyane "umwami - umugabo + umugore ≈ umwamikazi" rishoboka kandi ritangiza ibihe bigezweho.
Ubwubatsi bwa Skip-Gram buteganya iki?
Skip-Gram ifata ijambo rimwe hagati kandi igerageza guhanura buri jambo ryarikikije, ibinyuranye na CBOW.
Nibihe bisubizo bifatika byamahugurwa ya Word2Vec?
Igikorwa cyo guhanura nuburyo bwo kurangiza; intego ni matrike yize yize umurongo umurongo uhinduka ijambo ryuzuye.
Kuki Word2Vec ikoresha icyitegererezo kibi?
Icyitegererezo kibi gisubiramo ikibazo nkibiri gutondekanya amagambo make atunguranye, wirinda softmax ihenze kumagambo ibihumbi mirongo.
Ni ubuhe bwoko bwa Word2Vec bukora neza kumagambo adasanzwe na dataseti nto?
Skip-Gram hamwe nicyitegererezo cyiza gikunda gufata amagambo adasanzwe neza, mugihe CBOW irihuta kandi ikunda amagambo kenshi.
Ni uwuhe mutungo uzwi wa Word2Vec vectors werekanwa n "" umwami - umugabo + umugore ≈ umwamikazi "?
Ijambo2Vec ibice byerekana umubano kugirango ibigereranyo bisobanurwe bishobora gukemurwa hamwe byoroshye byongeweho no gukuramo.