GloVe Agbaye Vectors
GloVe (Awọn Vectors Agbaye fun Aṣoju Ọrọ) jẹ ọna ifibọ Stanford kan ti 2014 ti o kọ ẹkọ awọn olutọpa ọrọ taara lati awọn iṣiro-iṣẹlẹ agbaye ni gbogbo kopu, dipo lati awọn window asọtẹlẹ agbegbe.
Akopọ
It combines the statistical strengths of count-based methods with the meaningful vector geometry of Word2Vec.
Jin Dive
GloVe, ti a ṣẹda nipasẹ Jeffrey Pennington, Richard Socher, ati Christopher Manning ni Stanford ni ọdun 2014, kọ matrix omiran kan kika iye igba ti gbogbo ọrọ n waye pẹlu gbogbo ọrọ miiran laarin ferese ọrọ kan kọja gbogbo corpus. Ìjìnlẹ̀ òye kọ́kọ́rọ́ rẹ̀ ni pé ìpín àwọn iṣeeṣe ìṣẹ̀lẹ̀ ìṣẹ̀lẹ̀, kìí ṣe iye aise, ń gbé ìtumọ̀: fún àwọn ọ̀rọ̀ “yinyin” àti “ìyọ̀,” ìpín P(solid|ice)/P(solid|steam) tóbi, nígbà tí P(gas|...) ń yí i padà. GloVe ṣe ikẹkọ awọn onijakidijagan ki ọja aami ti awọn fekito ọrọ meji isunmọ logarithm ti iye-iṣẹlẹ wọn. Abajade jẹ awọn ifibọ ti o gba awọn iṣiro kopu agbaye mejeeji ati eto afiwe laini ti a ṣe olokiki nipasẹ Word2Vec, nigbagbogbo n ṣiṣẹ ni ifigagbaga lori ibajọra ọrọ ati awọn ipilẹ afiwe.
Imọ-imọ-ẹrọ
GloVe dinku ipadanu awọn onigun mẹrin ti o kere julọ nibiti ọkọọkan (ọrọ i, ọrọ j) bata ṣe alabapin f (X_ij) awọn akoko aṣiṣe onigun mẹrin laarin (vector_i · vector_j + abosi) ati log(X_ij). Iṣẹ iwuwo f awọn ipa ti awọn orisii loorekoore pupọ bi “awọn” ati “ti” ati kọju awọn iṣiro odo, nitorinaa awọn iṣẹlẹ-iṣẹlẹ-ṣoki-ṣugbọn alaye alaye ko ni rì. Nitoripe o ṣe iwọn matrix kika ti a ti ṣajọ tẹlẹ, ikẹkọ jẹ iṣelọpọ matrix pataki kuku ju asọtẹlẹ ori ayelujara lọ.
Ipa Ilana
Iyara ati iwọn
Ṣiṣan iṣẹ ede le gbe ni iyara laisi irubọ aitasera.
Wiwọle ati arọwọto
O faagun iraye si kọja awọn ede ati awọn aza ibaraẹnisọrọ.
Awọn ipinnu diẹ sii
Awọn ẹgbẹ le lo akoko diẹ sii lori idajọ lakoko ti adaṣe n kapa atunwi.
Ojo iwaju ti GloVe Global Vectors
Bii Word2Vec, GloVe n ṣe agbejade aimi, awọn aiṣedeede ti ko ni ọrọ-ọrọ ati pe o ti bori nipasẹ awọn ifibọ oluyipada ọrọ-ọrọ fun awọn iṣẹ-ṣiṣe-ti-ti-aworan. Stanford's pretrained GloVe vectors (ti a gba ikẹkọ lori Wikipedia, Gigaword, ati Crawl Wọpọ) jẹ awọn ipilẹ ti a ṣe igbasilẹ lọpọlọpọ fun iwadii, ṣiṣe apẹẹrẹ, ati awọn ohun elo ti o ni agbara awọn orisun. Ilowosi imọran rẹ, ti n fihan pe awọn iṣiro kika agbaye ati awọn ọna ti o da lori asọtẹlẹ jẹ ibatan jinna, tẹsiwaju lati sọ fun bi awọn oniwadi ṣe n ronu nipa kini awọn ifibọ ti kọ ẹkọ.
Real-World imuse
Stanford ti o ṣe igbasilẹ awọn adaṣe ti a ti kọkọ tẹlẹ (fun apẹẹrẹ 6B ati awọn eto ami ami 840B) ti a lo bi awọn ẹya ifisilẹ fun awọn iṣẹ akanṣe NLP ainiye
Ṣiṣẹ bi Layer ifisinu ni awọn ikasi itara ati awọn ọna ṣiṣe idanimọ nkan
Ibajọra ọrọ-ọrọ ati awọn iṣẹ afọwọṣe lẹgbẹẹ Word2Vec ninu iwadii ẹkọ
Iṣakojọpọ iwe-iṣiro ati iṣawakiri koko nibiti iyara, ikẹkọ tẹlẹ, ifisinu-ọfẹ ọrọ-ọrọ ti to.
Awọn ewu & Awọn ọna iṣọ
Awọn otitọ ti a sọ di mimọ le tẹ awọn ijabọ sii ni idakẹjẹ, awọn ṣiṣan atilẹyin, tabi awọn abajade iwadii.
Ifamọ kiakia le ṣẹda awọn abajade aisedede kọja awọn ibeere ti o jọra.
Awọn data ọrọ ifarabalẹ le farahan ti awọn idari wiwọle ko lagbara.
Ilana Ilana imuse
Ṣetumo ọna kika iṣẹjade, ohun orin, ati awọn iṣedede didara ṣaaju ṣiṣejade.
Awọn idahun ilẹ pẹlu awọn orisun ti o gbẹkẹle nigbakugba ti deede ba ṣe pataki.
Jeki aaye ayẹwo atunyẹwo eniyan fun awọn abajade ti o ga julọ.
Tọpinpin awọn ilana ikuna ati tunṣe awọn itọsi tabi ṣiṣan iṣẹ nigbagbogbo.
Tesiwaju Ṣiṣawari
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the GloVe Global Vectors quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Itọsọna atẹle
ColBERT ati Olona-Vector igbapada
Awọn ibeere ti a beere nigbagbogbo
What is GloVe Global Vectors?
GloVe (Awọn Vectors Agbaye fun Aṣoju Ọrọ) jẹ ọna ifibọ Stanford kan ti 2014 ti o kọ ẹkọ awọn olutọpa ọrọ taara lati awọn iṣiro-iṣẹlẹ agbaye ni gbogbo kopu, dipo lati awọn window asọtẹlẹ agbegbe. O darapọ awọn agbara iṣiro ti awọn ọna orisun kika pẹlu jiometirika fekito ti o nilari ti Word2Vec.
Eto data mojuto wo ni GloVe kọ lati inu koposi naa?
GloVe kọkọ kọ matrix kika iye igba ti ọrọ kọọkan n waye pẹlu gbogbo ọrọ miiran kọja gbogbo corpus.
Gẹgẹbi GloVe, ọja aami ti awọn olutọpa ọrọ meji jẹ ikẹkọ lati isunmọ kini?
Idi ti GloVe ṣeto ọja aami (pẹlu awọn ofin aiṣedeede) isunmọ si akọọlẹ ti iṣiro-iṣẹlẹ.
Opoiye bọtini wo ni GloVe jiyan gbe itumo atunmọ?
Imọye aarin ti GloVe ni pe awọn ipin ti awọn iṣeeṣe iṣe-iṣẹlẹ isẹlẹ ṣe iyatọ awọn itumọ ọrọ, bii pẹlu yinyin dipo nyanu.
Kini idi ti iṣẹ iwuwo GloVe f(X_ij)?
Iṣẹ iwuwo ṣe idilọwọ awọn orisii ti o wọpọ pupọ lati jẹ gaba lori ati fo awọn orisii ti ko waye rara.
Nibo ati nigbawo ni idagbasoke GloVe?
GloVe jẹ ifihan nipasẹ Pennington, Socher, ati Manning ni Stanford ni ọdun 2014, ọdun kan lẹhin Word2Vec.