Mgbakwunye ELMo Contextual
ELMo (Embeddings si na Ụdị Asụsụ) bụ ọganihu 2018 nke nyere okwu ọ bụla ihe nnọchiteanya nke ejiri ahịrịokwu ya mee, ya mere 'bank' na 'osimiri osimiri' dị iche na 'ụlọ akụ' na 'ego nchekwa.' Ọ kara akara ngbanwe site na vectors okwu kwụ ọtọ gaa na NLP gburugburu-mara.
Ime miri emi
ELMo, nke Allen Institute for AI na-eme nchọpụta (Peters et al., 2018) webatara, na-emepụta ihe ngosi okwu site na iji ahịrịokwu site na ụdị asụsụ LSTM miri emi nke bidirectional zụrụ azụ na ijeri okwu corpus. N'adịghị ka Word2Vec ma ọ bụ GloVe, nke na-ekenye otu vector edoziri n'otu okwu, ELMo na-agbakọ vector ọhụrụ maka ihe omume ọ bụla dabere na gburugburu. N'ụzọ dị mkpa, ELMo na-ejikọta ọkwa LSTM niile dị n'ime site na mmụta, arụrụ ọrụ akọwapụtara kama iji naanị akwa elu. N'ígwé dị ala na-ejidekarị syntax (akụkụ akụkụ nke okwu, nhazi) ebe ọkwa dị elu na-ejide ihe ọmụmụ na nghọta okwu. Ịtinye ELMo na ụdị dị adị rụpụtara nnukwu uru n'ofe ọrụ benchmark isii, gụnyere ịza ajụjụ, nyocha mmetụta, na njirimara aha.
Nghọta nka nka
ELMo na-akwakọba LSTM abụọ: ụdị asụsụ na-aga n'ihu na-ebu amụma okwu na-esote yana azụ nke na-ebu amụma okwu gara aga, nke ọ bụla karịa ntinye CNN n'ọkwa agwa (ya mere ọ na-ejikwa okwu ndị a na-adịghị ahụ anya). Maka ọrụ dị n'okpuru ala, ELMo na-akụtu ihe nnochi anya oyi akwa site na iji softmax-normalized arọ gbakwunyere scalar, ha niile mụtara n'oge a na-emegharị mma. Nke a pụtara na ọrụ ọ bụla nwere ike ikpebi ole syntactic na akara semantic ọ chọrọ site na biLM a zụrụ azụ nke oyi.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke ELMo Contextual Embeddings
Echiche bụ isi nke ELMo, ihe nnochite anya gburugburu site na nkuzi ụdị asụsụ, ghọrọ ntọala, mana ihe nrụpụta LSTM ya na-emegharị ngwa ngwa bụ ụdị dabere na mgbanwe dị ka BERT na ngwụcha afọ 2018, bụ nke na-agụ ahịrịokwu niile n'otu n'otu na nha ka mma. Taa ELMo bụ nke kachasị mkpa akụkọ ihe mere eme na mmụta, ọ bụ ezie na njikwa ndenye agwa CNN na echiche ịdị arọ ka na-emetụta ọrụ ntinye pụrụ iche n'asụsụ ndị nwere obere akụ na ọdịdị ọdịdị.
Mmejuputa n'ezie n'ụwa
Imelite sistemụ njirimara aha nke ga-agwarịrị ma 'Washington' na-ezo aka na mmadụ, steeti, ma ọ bụ obodo dabere na okwu ndị gbara ya gburugburu.
Ịkwalite nyocha mmetụta site n'ijide na 'ọrịa' pụtara adịghị mma na 'Ana m arịa ọrịa' mana ọ dị mma na slang 'nke ahụ na-arịa ọrịa'
Ịkwalite sistemu azịza ajụjụ na akara SQuAD site n'ịnye vectors nke nwere mmetụta n'ime onye na-agụ ya.
Ntụgharị uche okwu na ntụgharị igwe ka okwu polysem dị ka 'osisi' tụgharịrị atụgharị nke ọma nyere ọnọdụ
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ELMo Contextual Embeddings quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ntinye Okwu
Ajụjụ a na-ajụkarị
Kedu ihe bụ ELMo Contextual Embeddings?
ELMo (Embeddings si na Ụdị Asụsụ) bụ ọganihu 2018 nke nyere okwu ọ bụla ihe nnọchiteanya nke ejiri ahịrịokwu ya mee, ya mere 'bank' na 'osimiri osimiri' dị iche na 'ụlọ akụ' na 'ego nchekwa.' Ọ kara akara ngbanwe site na vectors okwu kwụ ọtọ gaa na NLP gburugburu-mara.
Kedu ihe dị iche n'etiti ELMo na ntinye mbụ dị ka Word2Vec?
ELMo na-emepụta ihe mgbakwunye gburugburu: vector maka mkpụrụ okwu na-agbanwe dabere na ahịrịokwu gbara ya gburugburu, n'adịghị ka otu vector kwụ ọtọ Word2Vec kwa okwu.
Kedu ihe nrụpụta akwara ozi ELMo na-eji agụ ederede?
Ewuru ELMo na LSTM bidirectional miri emi a zụrụ azụ dị ka ụdị asụsụ, usoro nhazi ugboro ugboro.
Kedu ka ELMo si ejikọta ọkwa dị n'ime ya maka ọrụ mgbada?
ELMo na-amụta ihe arụrụ arụ arụrụ arụ softmax-normalized iji jikọta ọkwa biLM niile, na-ahapụ ọrụ ọ bụla mesie syntax ma ọ bụ semantics ike dị ka achọrọ.
Kedu ihe ELMo na-eji dị ka nkeji ntinye ya iji jikwa okwu ndị a na-adịghị ahụ anya?
ELMo na-ewulite ntinye okwu site na CNN ọkwa agwa, yabụ ọ nwere ike ịnọchite anya okwu ọ hụtụbeghị n'oge ọzụzụ.
Ogologo oge ole ka ewepụtara ELMo na onye?
E bipụtara ELMo na 2018 site na Peters et al. na Allen Institute for AI (AI2).