Ururimi AI

GloVe Vector

GloVe (Global Vectors for Word Guhagararira Ijambo) nuburyo bwo gushiramo Stanford 2014 bwiga ibice byijambo biturutse kumibare iboneka kwisi yose kuri corpus yose, aho kuva mumadirishya yo guhanura.

2 min somaIbiherutse kuvugururwa

Incamake

It combines the statistical strengths of count-based methods with the meaningful vector geometry of Word2Vec.

Kwibira cyane

GloVe, yakozwe na Jeffrey Pennington, Richard Socher, na Christopher Manning i Stanford mu 2014, yubaka matrike nini ibara inshuro nyinshi ijambo ryose rifatanya n'andi magambo yose mu idirishya ry'imiterere hirya no hino. Ubushishozi bwibanze ni uko ikigereranyo cyibishobora kubaho, atari kubara mbisi, bitwara ibisobanuro: kumagambo "urubura" na "icyuka," igipimo P (gikomeye | urubura) / P (gikomeye | icyuka) ni kinini, mugihe P (gaze | ...) irabihindura. GloVe itoza ibice kugirango ibicuruzwa byadomo byamagambo abiri bigereranya logarithm yo kubara kwabo. Igisubizo ni ugushushanya bifata imibare ya corpus yisi yose hamwe nuburyo bwo kugereranya umurongo wamamaye na Word2Vec, akenshi ugakora amarushanwa kubijyanye nijambo-bisa nibipimo ngenderwaho.

Ubushishozi

GloVe igabanya igihombo kiremereye cyane-kare aho buri (ijambo i, ijambo j) ryombi ritanga inshuro f (X_ij) inshuro ikosa ryakorewe hagati (vector_i · vector_j + kubogama) na log (X_ij). Igikorwa cyo kuremerera f cyerekana ingaruka zabantu benshi cyane nka "" "na" ya "kandi birengagiza kubara zeru, kubwibyo bidasanzwe-ariko-bitanga amakuru ntibishobora kurohama. Kuberako igereranya matrise ibarwa, imyitozo ni matrisa yibintu aho guhanura kumurongo.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.

Kugera no kugera

Yagura uburyo bwindimi nuburyo bwo gutumanaho.

Ibyemezo bisobanutse

Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Ejo hazaza ha GloVe Vector

Kimwe na Word2Vec, GloVe itanga ibice bihamye, bidafite imiterere-karemano kandi yarengewe na transformateur ya contexteur yibikorwa bya kijyambere. Stanford yateguwe mbere ya GloVe (yatojwe kuri Wikipedia, Gigaword, na Common Crawl) ikomeje gukururwa cyane kubushakashatsi, prototyping, hamwe nibikoresho bikoreshwa. Umusanzu wacyo wibitekerezo, werekana ko imibare yo kubara kwisi yose hamwe nuburyo bushingiye ku guhanura bifitanye isano rya bugufi, ikomeje kumenyesha uburyo abashakashatsi batekereza kubyo gushira mubyukuri.

Gushyira mu bikorwa Isi

Ibikoresho bya Stanford bishobora gukururwa byateganijwe (urugero: 6B na 840B byerekana ibimenyetso) bikoreshwa nkibikoresho byo kumanura imishinga itabarika ya NLP.

Gukora nkurwego rwo gushiramo amarangamutima hamwe na sisitemu yo kumenyekanisha ibintu

Ibipimo byerekana ijambo-bisa nibikorwa bisa na Word2Vec mubushakashatsi bwamasomo

Bootstrapping inyandiko ihuriro hamwe nubushakashatsi bwinsanganyamatsiko aho byihuse, byateguwe, bitarimo imiterere ihagije

Ingaruka & Kurinda

Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.

Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.

Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Igishushanyo mbonera

1

Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.

2

Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.

3

Komeza kugenzura abantu kugenzura ibisubizo byinshi.

4

Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the GloVe Global Vectors quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

ColBERT na Multi-Vector Kubona

Ibibazo bikunze kubazwa

What is GloVe Global Vectors?

GloVe (Global Vectors for Word Guhagararira Ijambo) nuburyo bwo gushiramo Stanford 2014 bwiga ibice byijambo biturutse kumibare iboneka kwisi yose kuri corpus yose, aho kuva mumadirishya yo guhanura. Ihuza imbaraga zishingiye ku mibare yuburyo bushingiye kubara hamwe na geometrike ifite akamaro ya Word2Vec.

Ni ubuhe buryo bwibanze bwamakuru GloVe yubaka kuva muri corpus?

GloVe ibanza kubaka matrix ibara inshuro buri jambo rifatanije nandi magambo yose kuri corpus yose.

Dukurikije GloVe, ibicuruzwa byadomo byamagambo abiri yamagambo bigishwa kugereranya iki?

Intego ya GloVe ishyiraho akadomo k'ibicuruzwa (hiyongereyeho kubogama kubiri) hafi yumubare wibara hamwe.

Ni ubuhe bwoko bw'ingenzi GloVe avuga ko bufite ibisobanuro bisobanura?

Ubushishozi bwibanze bwa GloVe ni uko ibipimo byenda kubaho bitandukanya ibisobanuro byijambo, nkibarafu hamwe na parike.

Niyihe ntego yo gukora uburemere bwa GloVe f (X_ij)?

Imikorere yo kuremerera ibuza abantu benshi cyane kuganza no gusimbuka ibice bitigera bibaho.

GloVe yatejwe he kandi ryari?

GloVe yatangijwe na Pennington, Socher, na Manning i Stanford mu 2014, umwaka umwe nyuma ya Word2Vec.