Nlereanya Permutation XLNet
XLNet na-agwakọta ọnọdụ bidirectional nke BERT na amụma autoregressive nke GPT site n'ịzụ usoro iwu okwu na-enweghị usoro.
Nchịkọta
This permutation trick lets it learn from all positions without ever masking tokens.
Ime miri emi
XLNet, nke Carnegie Mellon webatara na 2019 na Google Brain, ka emebere iji dozie ntụpọ na ọzụzụ ụdị BERT. BERT na-ekpuchi ihe nkpuchi ma buru amụma ha, mana akara ngosi [MASK] anaghị apụta n'oge nhazi nke ọma, na-emepụta ụgbọ oloko/ule adabaghị, na BERT na-eche na akara mkpuchi nwere onwe ya. Kama XLNet na-eji 'ịgbanwe asụsụ permutation': ọ na-ebuli ohere ndekọ a na-atụ anya ya karịa ịtụnye mkpụrụokwu niile n'usoro. Site n'ịkọ akara ngosi ọ bụla enyere obere usoro nke ndị ọzọ, ihe nlereanya a na-ahụ nke ọma ọnọdụ bidirectional ka ọ na-anọgide na-abụ ezigbo autoregressive nlereanya na-enweghị ihe mkpuchi. Ewuru na azụ azụ Transformer-XL maka ebe nchekwa dị ogologo, XLNet rụpụtara BERT na gburugburu ọrụ 20 gụnyere ịza ajụjụ, nyocha mmetụta, na ogo akwụkwọ.
Nghọta nka nka
XLNet anaghị emegharị okwu n'anụ ahụ; ọ na-eme ka usoro mmepụta ihe site na nkpuchi anya, ya mere a na-echekwa ozi ọnọdụ. Iji rụọ ọrụ a, ọ na-eji 'nlebara anya onwe-iyi-abụọ': iyi ọdịnaya nke na-etinye koodu ma akara ngosi yana ihe gbara ya gburugburu, na iyi ajụjụ nke maara ọnọdụ ebumnuche mana ọ bụghị ọdịnaya ya, na-eme ka amụma na-enweghị ihichapụ azịza ya. Ntugharị nke Transformer-XL na ngbanwe ọnọdụ ọnọdụ na-enye ya ebe nchekwa n'akụkụ ogologo, na-eme ka njikwa akwụkwọ dị ogologo.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke XLNet Permutation Modeling
XLNet bụ ihe akaebe nwere mmetụta na ebumnobi na-akpaghasị onwe ya nwere ike weghara ọnọdụ bidirectional, na-eme ka nkewa BERT na GPT ghara ịdị. Ọ bụ ezie na ogige ahụ gbakọtara nke ọma gburugburu ma ọ bụ ihe mkpuchi mkpuchi ma ọ bụ nnukwu ihe ndozi autoregressive, echiche nke XLNet na nlọghachite Transformer-XL mere ka ọrụ mechaa na-arụ ọrụ n'ichepụta ogologo ọnọdụ na ebumnuche izizi dị n'otu. Nghọta ya ka dị mkpa ka ndị na-eme nchọpụta na-achọ ihe owuwu ụlọ na-ejikọta ime ihe ngosi siri ike yana ọgbọ na-enweghị mkpuchi.
Mmejuputa n'ezie n'ụwa
Na-enweta nsonaazụ kacha elu na akara nzacha ajụjụ dịka SQuAD
Ijikwa ọrụ ogologo akwụkwọ dị ka ule nghọta ọgụgụ RACE site na ebe nchekwa Transformer-XL
Na-akwado ogo akwụkwọ na sistemu iweghachi ozi
Na-emewanye nhazi nke mmetụta na nhazi ederede n'usoro ntọala BERT
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the XLNet Permutation Modeling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nlereanya isiokwu
Ajụjụ a na-ajụkarị
What is XLNet Permutation Modeling?
XLNet na-agwakọta ọnọdụ bidirectional nke BERT na amụma autoregressive nke GPT site n'ịzụ usoro iwu okwu na-enweghị usoro. Aghọ aghụghọ a na-eme ka ọ mụta n'ọkwa niile na-enweghị mkpuchi mkpuchi.
Kedu ebumnuche nkuzi mbụ XLNet na-eji?
XLNet na-ebuli ohere log-atụ anya karịa ngbanwe niile nke usoro nrụpụta token, nke a na-akpọ nhazi asụsụ permutation.
Kedu adịghị ike BERT ka emebere XLNet ka o lebara anya?
Akara BERT's artificial [MASK] adịghị apụta n'oge a na-emegharị mma yana ọ na-ewere amụma mkpuchi mkpuchi dị ka onye nwere onwe ya; XLNet na-ezere okwu abụọ ahụ.
Kedu ihe nlebara anya onwe-iyi iyi abụọ nke XLNet kewapụrụ?
Ọdịnaya iyi ahụ na-etinye akara ngosi na ihe gbara ya gburugburu, ebe iyi ajụjụ ahụ maara ọnọdụ ebumnuche mana ọ bụghị ọdịnaya ya, na-eme ka amụma na-enweghị ntapu.
XLNet ọ na-emegharị mkpụrụokwu ndị dị n'ahịrịokwu?
XLNet na-akwado amụma amụma (factorization) site na nlebara anya; A na-echekwa ọnọdụ akara ngosi izizi site na ntinye ọnọdụ.
Kedu ụlọ ọrụ na-arụ ọrụ dị ka ọkpụkpụ azụ XLNet maka ogologo ogologo?
XLNet na-ewuli elu na Transformer-XL, nke na-agbakwunye nlọghachi nke akụkụ yana ntinye ọnọdụ maka ijikwa usoro ogologo.