Ururimi AI

Ijambo2Vec Skip-Gram na CBOW

Word2Vec ni tekinike ya 2013 kuva Google yiga ibice byuzuye byamagambo mu guhanura amagambo yabaturanyi babo, guhindura ururimi muri geometrie aho amagambo asa yicaye hamwe.

2 min somaIbiherutse kuvugururwa

Incamake

It made the famous "king - man + woman ≈ queen" analogy possible and kicked off the modern embedding era.

Kwibira cyane

Ijambo2Vec, ryatangijwe na Tomas Mikolov na bagenzi be kuri Google muri 2013, ryiga vector (mubisanzwe imibare 100-300) kuri buri jambo uhugura urusobe rudasanzwe rw'imitsi ibiri ku idirishya. Iza muburyo bubiri. CBOW (Umufuka uhoraho wamagambo) ufata amagambo akikije amagambo kandi uhanura ijambo ryabuze hagati, ugereranije ibice byerekanwe hamwe. Skip-Gram ihindura ibi: ifata ijambo hagati kandi igerageza guhanura buri jambo rikikije ijambo. Icyitegererezo nticyigera cyita kubikorwa byo guhanura ubwabyo; intego nuburemere matrix yiga munzira, imirongo yayo ihinduka ijambo vectors. Amagambo agaragara mubice bisa birangirana na vectors, ifata ibisobanuro gusa bivuye hamwe.

Ubushishozi

Kumenyereza software yuzuye hejuru yamagambo manini biratinda cyane, Word2Vec rero ikoresha amayeri nkurugero rwiza, rusubiramo ibyahanuwe nkibice bibiri: tandukanya ijambo ryukuri ryukuri namagambo make "mabi". Irasubiramo kandi amagambo akunze gukoreshwa nka "the" kandi ikoresha unigram-yazamuye-kuri-0,75 kugirango igabanye ibibi. CBOW irihuta kandi nziza kumagambo akunze; Skip-Gram hamwe nicyitegererezo cyiza gikora amagambo adasanzwe na corpora nto neza.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.

Kugera no kugera

Yagura uburyo bwindimi nuburyo bwo gutumanaho.

Ibyemezo bisobanutse

Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Kazoza ka Word2Vec Skip-Gram na CBOW

Kwinjiza bihamye nka Word2Vec byasimbuwe ahanini nicyitegererezo (ELMo, BERT, transformateur) gitanga ijambo ibice bitandukanye ukurikije imiterere yinteruro, bikemura ikibazo cya polysemy aho "banki" ifite icyerekezo kimwe gihamye. Nyamara Word2Vec yihanganira aho umuvuduko, ubworoherane, hamwe no gusobanurwa: sisitemu yo gutanga inama, gushakisha, kandi nkishingiro ryigisha. Igitekerezo cyacyo cyibanze, icyo gisobanuro kiva mubibare bibaye hamwe, bikomeza kuba uburiri bwurugero rwindimi zose zigezweho.

Gushyira mu bikorwa Isi

Spotify na Airbnb bahinduye Skip-Gram kugirango bige gushira indirimbo hamwe nurutonde ("ingingo2vec") uhereye kumurongo wabakoresha kugirango bakore ibyifuzo

Imbaraga zo gushakisha ibisobanuro no kwagura ibisobanuro bityo ikibazo cya "laptop" nacyo kigaragara "ikaye" na "mudasobwa"

Gutahura ibigereranyo nubusabane mubyanditswe, nkumurwa mukuru wibihugu byombi (Paris nu Bufaransa nkuko Tokiyo iri mu Buyapani)

Gutangiza ibyinjijwemo imiyoboro minini ya NLP yo gusesengura amarangamutima no gutondekanya inyandiko ku makuru make

Ingaruka & Kurinda

Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.

Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.

Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Igishushanyo mbonera

1

Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.

2

Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.

3

Komeza kugenzura abantu kugenzura ibisubizo byinshi.

4

Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Word2Vec Skip-Gram and CBOW quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Imiyoboro Yumuhanda no Gusimbuka

Ibibazo bikunze kubazwa

What is Word2Vec Skip-Gram and CBOW?

Word2Vec ni tekinike ya 2013 kuva Google yiga ibice byuzuye byamagambo mu guhanura amagambo yabaturanyi babo, guhindura ururimi muri geometrie aho amagambo asa yicaye hamwe. Byatumye igereranya rizwi cyane "umwami - umugabo + umugore ≈ umwamikazi" rishoboka kandi ritangiza ibihe bigezweho.

Ubwubatsi bwa Skip-Gram buteganya iki?

Skip-Gram ifata ijambo rimwe hagati kandi igerageza guhanura buri jambo ryarikikije, ibinyuranye na CBOW.

Nibihe bisubizo bifatika byamahugurwa ya Word2Vec?

Igikorwa cyo guhanura nuburyo bwo kurangiza; intego ni matrike yize yize umurongo umurongo uhinduka ijambo ryuzuye.

Kuki Word2Vec ikoresha icyitegererezo kibi?

Icyitegererezo kibi gisubiramo ikibazo nkibiri gutondekanya amagambo make atunguranye, wirinda softmax ihenze kumagambo ibihumbi mirongo.

Ni ubuhe bwoko bwa Word2Vec bukora neza kumagambo adasanzwe na dataseti nto?

Skip-Gram hamwe nicyitegererezo cyiza gikunda gufata amagambo adasanzwe neza, mugihe CBOW irihuta kandi ikunda amagambo kenshi.

Ni uwuhe mutungo uzwi wa Word2Vec vectors werekanwa n "" umwami - umugabo + umugore ≈ umwamikazi "?

Ijambo2Vec ibice byerekana umubano kugirango ibigereranyo bisobanurwe bishobora gukemurwa hamwe byoroshye byongeweho no gukuramo.