Vecteur global
GloVe (Vecteur Global ngir Representation Word) 2014 Stanford njuréef la buy jàng vecteur baat yi ci lim co-occurrence global ci corpus bi yépp, du ci palanteer yiy wax luy am ci gox bi.
Résumé
It combines the statistical strengths of count-based methods with the meaningful vector geometry of Word2Vec.
Plongeur bu xóot
GloVe, bi Jeffrey Pennington, Richard Socher, ak Christopher Manning defar ci Stanford ci 2014, dafa tabax benn matrix bu mag buy lim ñaata yoon la baat bu nekk di daje ak beneen baat ci biir benn palanteer ci biir corpus bi yépp. Li gëna am solo ci gis-gis bi mooy ni rasio probabilite co-occurrence, du lim raw, yor lu muy tekki: ngir baat "glace" ak "vapeur," ratio bi P(solid|glace)/P(solid|vapër) dafa yaatu, fekk P(gas|...) dafay soppi. GloVe dafay tàggat vecteur yi ci anam wuy tax produit point bu ñaari vecteur baat jege logarithm bi ci seen limu co-occurrence. Resultaa bi mooy ay embeddings yuy jàpp lim corpus global ak structure analogie lineaire bi Word2Vec siiwal, di faral di def ay compétition ci nuru baat ak analogie benchmarks.
Gis-gis xarala
GloVe dafay wàññi perte bu gëna ndaw ci kaare yi, fu bu nekk (baat i, baat j) ñaar di jàppale f(X_ij) yoon njuumte kaare bi diggante (vecteur_i · vecteur_j + biais) ak log(X_ij). Fonction pondération f dafay tënk influens bu ñaari mbir yu bari yu melni "the" ak "of" te du bàyyi xel ci lim zero, kon co-occurrences yu bariwul waaye yu am xibaar duñu jeex. Ndax dafay factoriser ab matrix lim buñu njëkka xayma, taggat bi ci yoon sax factorisasioŋ matrix la, du wax luy waaja am ci net bi.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu vecteur global GloVe
GloVe melni Word2Vec, dafay defar ay vecteur yu amul benn contexte, te dañu ko romb ay transformateur contextuel ngir liggéey yu bees yi. Vecteur GloVe yiñ njëkka tàggat ci Stanford (ñu tàggat leen ci Wikipedia, Gigaword, ak Common Crawl) ñu ngi wéy di nekk li ñuy jëfandikoo ngir gëstu, defar ay xeetu mbir, ak jëfandikoo ay jumtukaay yu néew. Limu indi ci xalaatam, di wane ni lim lim yi ci àdduna bi ak pexe yi lalu ci wax luy waaja am dañu lëkkaloo bu baax, di wéyal di leeral ni gëstukat yi di xalaatee ci li embeddings yi di jàng.
Doxal ci àdduna dëgg
Vecteur yiñ mëna yebbi ci Stanford (lu melni ensemble token 6B ak 840B) ñu ngi koy jëfandikoo ci ay projet NLP yu bari
Liggéey ni couche embedding ci classifier sentiment yi ak sistemu xàmmee entite yu am tur
Benchmarking nuru baat ak liggéey analogie ci wetu Word2Vec ci gëstu akademik
Bootstrapping dokimaa clustering ak topic exploration fu gaaw, tàggat bu njëkk, dugal ci muy doy
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the GloVe Global Vectors quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
ColBERT ak seet vecteur yu bari
Laaj yi ñuy faral di laaj
What is GloVe Global Vectors?
GloVe (Vecteur Global ngir Representation Word) 2014 Stanford njuréef la buy jàng vecteur baat yi ci lim co-occurrence global ci corpus bi yépp, du ci palanteer yiy wax luy am ci gox bi. Dafa boole dooley lim yi ci pexe yu lalu ci lim ak geometrie vecteur bu am solo bu Word2Vec.
Ban xeetu done la GloVe tabax ci corpus bi?
GloVe dafa njëkka defar benn matrix buy lim ñaata yoon la baat bu nekk di daje ak beneen baat ci biir corpus bi yépp.
Sunu sukkandikoo ci GloVe, produit dot bi ci ñaari vecteur yu baat ñu ngi koy tàggat ngir xayma lan?
Mébetu GloVe mooy tëral produit dot bi (ak ay terme bias) mu jege log biy lim co-occurrence bi.
Ban limu key la GloVe wax ni moo yor lu muy tekki ci semantik?
Li gëna am solo ci GloVe mooy ni rasio probabilite yiy xew ñoom ñaar ñooy wuutale lu baat yi di tekki, lu melni glaas ak vapër.
Luy njariñu fonction pondération bu GloVe f(X_ij)?
Fonction pondération dafay tere pairs yu bari lool ñu ëpp doole ba noppi salte pairs yu musul am.
Fan ak kañ lañu defar GloVe?
Pennington, Socher, ak Manning ñoo dugal GloVe ci Stanford ci 2014, at ginaaw Word2Vec.