Èdè AI Itọsọna

GloVe Agbaye Vectors

GloVe (Awọn Vectors Agbaye fun Aṣoju Ọrọ) jẹ ọna ifibọ Stanford kan ti 2014 ti o kọ ẹkọ awọn olutọpa ọrọ taara lati awọn iṣiro-iṣẹlẹ agbaye ni gbogbo kopu, dipo lati awọn window asọtẹlẹ agbegbe.

2 min kakẹhin imudojuiwọn

Akopọ

It combines the statistical strengths of count-based methods with the meaningful vector geometry of Word2Vec.

Jin Dive

GloVe, ti a ṣẹda nipasẹ Jeffrey Pennington, Richard Socher, ati Christopher Manning ni Stanford ni ọdun 2014, kọ matrix omiran kan kika iye igba ti gbogbo ọrọ n waye pẹlu gbogbo ọrọ miiran laarin ferese ọrọ kan kọja gbogbo corpus. Ìjìnlẹ̀ òye kọ́kọ́rọ́ rẹ̀ ni pé ìpín àwọn iṣeeṣe ìṣẹ̀lẹ̀ ìṣẹ̀lẹ̀, kìí ṣe iye aise, ń gbé ìtumọ̀: fún àwọn ọ̀rọ̀ “yinyin” àti “ìyọ̀,” ìpín P(solid|ice)/P(solid|steam) tóbi, nígbà tí P(gas|...) ń yí i padà. GloVe ṣe ikẹkọ awọn onijakidijagan ki ọja aami ti awọn fekito ọrọ meji isunmọ logarithm ti iye-iṣẹlẹ wọn. Abajade jẹ awọn ifibọ ti o gba awọn iṣiro kopu agbaye mejeeji ati eto afiwe laini ti a ṣe olokiki nipasẹ Word2Vec, nigbagbogbo n ṣiṣẹ ni ifigagbaga lori ibajọra ọrọ ati awọn ipilẹ afiwe.

Imọ-imọ-ẹrọ

GloVe dinku ipadanu awọn onigun mẹrin ti o kere julọ nibiti ọkọọkan (ọrọ i, ọrọ j) bata ṣe alabapin f (X_ij) awọn akoko aṣiṣe onigun mẹrin laarin (vector_i · vector_j + abosi) ati log(X_ij). Iṣẹ iwuwo f awọn ipa ti awọn orisii loorekoore pupọ bi “awọn” ati “ti” ati kọju awọn iṣiro odo, nitorinaa awọn iṣẹlẹ-iṣẹlẹ-ṣoki-ṣugbọn alaye alaye ko ni rì. Nitoripe o ṣe iwọn matrix kika ti a ti ṣajọ tẹlẹ, ikẹkọ jẹ iṣelọpọ matrix pataki kuku ju asọtẹlẹ ori ayelujara lọ.

Ipa Ilana

Iyara ati iwọn

Ṣiṣan iṣẹ ede le gbe ni iyara laisi irubọ aitasera.

Wiwọle ati arọwọto

O faagun iraye si kọja awọn ede ati awọn aza ibaraẹnisọrọ.

Awọn ipinnu diẹ sii

Awọn ẹgbẹ le lo akoko diẹ sii lori idajọ lakoko ti adaṣe n kapa atunwi.

Ojo iwaju ti GloVe Global Vectors

Bii Word2Vec, GloVe n ṣe agbejade aimi, awọn aiṣedeede ti ko ni ọrọ-ọrọ ati pe o ti bori nipasẹ awọn ifibọ oluyipada ọrọ-ọrọ fun awọn iṣẹ-ṣiṣe-ti-ti-aworan. Stanford's pretrained GloVe vectors (ti a gba ikẹkọ lori Wikipedia, Gigaword, ati Crawl Wọpọ) jẹ awọn ipilẹ ti a ṣe igbasilẹ lọpọlọpọ fun iwadii, ṣiṣe apẹẹrẹ, ati awọn ohun elo ti o ni agbara awọn orisun. Ilowosi imọran rẹ, ti n fihan pe awọn iṣiro kika agbaye ati awọn ọna ti o da lori asọtẹlẹ jẹ ibatan jinna, tẹsiwaju lati sọ fun bi awọn oniwadi ṣe n ronu nipa kini awọn ifibọ ti kọ ẹkọ.

Real-World imuse

Stanford ti o ṣe igbasilẹ awọn adaṣe ti a ti kọkọ tẹlẹ (fun apẹẹrẹ 6B ati awọn eto ami ami 840B) ti a lo bi awọn ẹya ifisilẹ fun awọn iṣẹ akanṣe NLP ainiye

Ṣiṣẹ bi Layer ifisinu ni awọn ikasi itara ati awọn ọna ṣiṣe idanimọ nkan

Ibajọra ọrọ-ọrọ ati awọn iṣẹ afọwọṣe lẹgbẹẹ Word2Vec ninu iwadii ẹkọ

Iṣakojọpọ iwe-iṣiro ati iṣawakiri koko nibiti iyara, ikẹkọ tẹlẹ, ifisinu-ọfẹ ọrọ-ọrọ ti to.

Awọn ewu & Awọn ọna iṣọ

Awọn otitọ ti a sọ di mimọ le tẹ awọn ijabọ sii ni idakẹjẹ, awọn ṣiṣan atilẹyin, tabi awọn abajade iwadii.

Ifamọ kiakia le ṣẹda awọn abajade aisedede kọja awọn ibeere ti o jọra.

Awọn data ọrọ ifarabalẹ le farahan ti awọn idari wiwọle ko lagbara.

Ilana Ilana imuse

1

Ṣetumo ọna kika iṣẹjade, ohun orin, ati awọn iṣedede didara ṣaaju ṣiṣejade.

2

Awọn idahun ilẹ pẹlu awọn orisun ti o gbẹkẹle nigbakugba ti deede ba ṣe pataki.

3

Jeki aaye ayẹwo atunyẹwo eniyan fun awọn abajade ti o ga julọ.

4

Tọpinpin awọn ilana ikuna ati tunṣe awọn itọsi tabi ṣiṣan iṣẹ nigbagbogbo.

Tesiwaju Ṣiṣawari

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the GloVe Global Vectors quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Bẹrẹ adanwo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Itọsọna atẹle

ColBERT ati Olona-Vector igbapada

Awọn ibeere ti a beere nigbagbogbo

What is GloVe Global Vectors?

GloVe (Awọn Vectors Agbaye fun Aṣoju Ọrọ) jẹ ọna ifibọ Stanford kan ti 2014 ti o kọ ẹkọ awọn olutọpa ọrọ taara lati awọn iṣiro-iṣẹlẹ agbaye ni gbogbo kopu, dipo lati awọn window asọtẹlẹ agbegbe. O darapọ awọn agbara iṣiro ti awọn ọna orisun kika pẹlu jiometirika fekito ti o nilari ti Word2Vec.

Eto data mojuto wo ni GloVe kọ lati inu koposi naa?

GloVe kọkọ kọ matrix kika iye igba ti ọrọ kọọkan n waye pẹlu gbogbo ọrọ miiran kọja gbogbo corpus.

Gẹgẹbi GloVe, ọja aami ti awọn olutọpa ọrọ meji jẹ ikẹkọ lati isunmọ kini?

Idi ti GloVe ṣeto ọja aami (pẹlu awọn ofin aiṣedeede) isunmọ si akọọlẹ ti iṣiro-iṣẹlẹ.

Opoiye bọtini wo ni GloVe jiyan gbe itumo atunmọ?

Imọye aarin ti GloVe ni pe awọn ipin ti awọn iṣeeṣe iṣe-iṣẹlẹ isẹlẹ ṣe iyatọ awọn itumọ ọrọ, bii pẹlu yinyin dipo nyanu.

Kini idi ti iṣẹ iwuwo GloVe f(X_ij)?

Iṣẹ iwuwo ṣe idilọwọ awọn orisii ti o wọpọ pupọ lati jẹ gaba lori ati fo awọn orisii ti ko waye rara.

Nibo ati nigbawo ni idagbasoke GloVe?

GloVe jẹ ifihan nipasẹ Pennington, Socher, ati Manning ni Stanford ni ọdun 2014, ọdun kan lẹhin Word2Vec.