GloVe Global Vectors
GloVe (Global Vectors for Word Representation) bụ usoro ntinye Stanford nke 2014 nke na-amụta vectors okwu ozugbo site na ọnụ ọgụgụ na-emekọ ọnụ zuru ụwa ọnụ n'ofe corpus dum, kama site na windo amụma mpaghara.
Nchịkọta
Ọ na-ejikọta ike ọnụ ọgụgụ nke ụzọ dabere na ọnụ ọgụgụ na geometry vector bara uru nke Word2Vec.
Ime miri emi
GloVe, nke Jeffrey Pennington, Richard Socher, na Christopher Manning mepụtara na Stanford na 2014, na-ewulite nnukwu matrix na-agụta ugboro ole okwu ọ bụla na-emekọ ọnụ na okwu ọ bụla ọzọ n'ime windo gburugburu n'ofe akụkụ ahụ dum. Nghọta ya bụ isi bụ na oke nke ihe gbasara omume na-emekọ ihe, ọ bụghị ọnụ ọgụgụ raw, na-ebu ihe ọ pụtara: maka okwu "ice" na "steam," oke P ( siri ike | ice) / P ( siri ike | uzuoku ) buru ibu, ebe P (gas |...) na-atụgharị ya. GloVe na-azụ vectors ka ntụpọ ntụpọ nke okwu abụọ vector dị ka logarithm nke ọnụ ọgụgụ ha na-emekọ ọnụ. Nsonaazụ bụ ntinye na-ejide ma ndekọ ọnụ ọgụgụ corpus zuru ụwa ọnụ yana usoro ntụnyere ahịrị nke Word2Vec mere ka ama ama, na-emekarị asọmpi na myiri okwu yana akara ntule.
Nghọta nka nka
GloVe na-ebelata mfu obere-squares dị arọ ebe nke ọ bụla (okwu i, okwu j) ụzọ abụọ na-enye f(X_ij) ugboro mperi squared n'etiti (vector_i · vector_j + biases) na log(X_ij). Ọrụ ịdị arọ f na-egbochi mmetụta nke ụzọ abụọ na-adịkarịkarị dị ka "nke" na "nke" ma na-eleghara ọnụ ọgụgụ efu anya, ya mere, ihe omume na-adịghị ahụkebe ma na-enye ihe ọmụma anaghị ekpochapụ mmiri. N'ihi na ọ na-emepụta matriks agụọbu agbakọọ, ọzụzụ bụ n'ezie matriks factorization kama ibu amụma n'ịntanetị.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke GloVe Global Vectors
Dị ka Word2Vec, GloVe na-emepụta vectors na-enweghị ihe ọ bụla ma ọ bụrụ na etinyere ihe ngbanwe ọnọdụ maka ọrụ ọgbara ọhụrụ. Stanford's pretrained GloVe vector (nke a zụrụ na Wikipedia, Gigaword, na Crawl A na-ahụkarị) ka na-anọgide na-abụ usoro ebudatara n'ọtụtụ ebe maka nyocha, ihe nleba anya, na ngwa nwere ikike. Ntụnye echiche ya, na-egosi na ọnụ ọgụgụ zuru ụwa ọnụ na ụzọ ndị dabere na amụma nwere njikọ chiri anya, na-aga n'ihu na-akọwa otú ndị nchọpụta si eche echiche banyere ihe ntinye n'ezie na-amụta.
Mmejuputa n'ezie n'ụwa
Vectors a zụrụ azụ nke Stanford (dịka 6B na 840B token set) ejiri dị ka njirimara ntinye maka ọrụ NLP na-enweghị atụ.
Na-eje ozi dị ka oyi akwa na-etinye n'ime klaasị mmetụta na sistemụ njirimara aha
Benchmarking myiri okwu na ọrụ ntụnyere Word2Vec na nyocha agụmakwụkwọ
Nchịkọta akwụkwọ na nyocha isiokwu ebe ntinye ngwa ngwa, nke a zụrụ azụ, ntinye na-enweghị ọnọdụ zuru ezu.
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the GloVe Global Vectors quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
ColBERT na Mweghachi Multi-Vector
Ajụjụ a na-ajụkarị
Kedu ihe bụ GloVe Global Vectors?
GloVe (Global Vectors for Word Representation) bụ usoro ntinye Stanford nke 2014 nke na-amụta vectors okwu ozugbo site na ọnụ ọgụgụ na-emekọ ọnụ zuru ụwa ọnụ n'ofe corpus dum, kama site na windo amụma mpaghara. Ọ na-ejikọta ike ọnụ ọgụgụ nke ụzọ dabere na ọnụ ọgụgụ na geometry vector bara uru nke Word2Vec.
Kedu isi ihe nhazi data GloVe na-ewulite site na corpus?
GloVe na-ebu ụzọ wuo matriks na-agụta ugboro ole okwu ọ bụla na-emekọ ọnụ na okwu ọ bụla ọzọ n'ofe akụkụ ahụ dum.
Dị ka GloVe si kwuo, a zụrụ ngwaahịa ntụpọ nke vector abụọ ka ọ bụrụ ihe dị ka gịnị?
Ebumnobi GloVe na-edobe ngwaahịa ntụpọ (gbakwunyere okwu mkparị) nso na ndekọ ọnụ ọgụgụ ndị na-emekọ ihe.
Kedu ọnụọgụ igodo GloVe na-arụ na-ebu mpụtara semantik?
Nghọta dị n'etiti GloVe bụ na oke nke ihe omume imekọ ihe na-amata ihe pụtara okwu, dị ka ice na uzuoku.
Gịnị bụ ebumnobi nke ọrụ ịdị arọ nke GloVe f(X_ij)?
Ọrụ ịdị arọ na-egbochi ụzọ abụọ a na-ahụkarị ka ha na-achị ma na-amapụ ụzọ abụọ na-adịghị emekọ ọnụ.
Ebee na mgbe ewepụtara GloVe?
Pennington, Socher na Manning webatara GloVe na Stanford na 2014, otu afọ ka Word2Vec gachara.