XLNet Permutation Modeling
XLNet ya haɗu da mahallin mahallin BERT tare da tsinkayar GPT ta autoregressive ta hanyar horarwa akan oda bazuwar kalma.
Dubawa
This permutation trick lets it learn from all positions without ever masking tokens.
Zurfafa nutsewa
XLNet, wanda Carnegie Mellon ya gabatar a cikin 2019 da Google Kwakwalwa, an ƙera shi don gyara aibi a cikin horon da ya dace da salon BERT. BERT yana rufe alamomi kuma yana tsinkayar su, amma alamar wucin gadi [MASK] ba ta bayyana a lokacin daidaitawa, ƙirƙirar rashin daidaituwar jirgin ƙasa/gwaji, kuma BERT tana ɗaukar alamun rufe fuska masu zaman kansu. A maimakon haka XLNet yana amfani da 'samuwar ƙirar harshe': yana haɓaka da yuwuwar yuwuwar yin odar kalmomin a jere. Ta hanyar tsinkayar kowane alamar da aka ba da bazuwar juzu'in sauran, ƙirar tana ganin yadda ya kamata mahallin bidirectional yayin da ya kasance ingantaccen samfurin autoregressive ba tare da abin rufe fuska ba. An gina shi akan kashin baya na Transformer-XL don ƙwaƙwalwar ajiya mai tsayi, XLNet ya fi BERT akan ayyuka kusan 20 ciki har da amsa tambaya, nazarin jin daɗi, da matsayi na takarda.
Fahimtar Fasaha
XLNet baya karkatar da kalmomi a zahiri; yana ba da oda mai ƙarfi ta hanyar abin rufe fuska, don haka ana adana bayanan matsayi. Don yin wannan aikin, yana amfani da 'hankalin kai na rafi biyu': rafin abun ciki wanda ke ɓoye alamar alama da mahallinsa, da rafin tambaya wanda ya san matsayin manufa amma ba abun ciki ba, yana ba da damar hasashen ba tare da faɗuwar amsar ba. Maimaituwar Transformer-XL da ƙwanƙolin matsayi na dangi suna ba shi ƙwaƙwalwar ajiya a cikin dogayen sassa, inganta sarrafa dogayen takardu.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Samfuran Ƙimar XLNet
XLNet wata hujja ce mai tasiri da ke nuna makasudin kai-da-kai na iya ɗaukar mahallin mahallin biyu, yana ɓatar da rarrabuwar BERT-da-GPT. Yayin da filin ya kasance mai ƙarfi a kusa da ko dai masu ɓoye ɓoye ko manyan na'urori masu ɗaukar hoto, ra'ayin permutation na XLNet da maimaituwar Transformer-XL sun sanar da aiki daga baya akan ƙirar ƙira mai tsayi da haɗin kai. Bayanansa sun kasance masu dacewa yayin da masu bincike ke neman gine-ginen gine-ginen da suka haɗu da ƙirar mahallin mai ƙarfi tare da ingantaccen, tsara wanda ba abin rufe fuska.
Aiwatar da Gaskiyar Duniya
Samun babban sakamako akan ma'auni na amsa tambaya kamar SQuAD
Gudanar da ayyuka na dogon lokaci kamar gwajin fahimtar karatun RACE ta hanyar ƙwaƙwalwar Transformer-XL.
Ƙimar daftarin aiki da tsarin dawo da bayanai
Inganta rarrabuwar ra'ayi da rarrabuwar rubutu akan tushen tushen BERT
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the XLNet Permutation Modeling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Taken Modeling
Tambayoyin da ake yawan yi
What is XLNet Permutation Modeling?
XLNet ya haɗu da mahallin mahallin BERT tare da tsinkayar GPT ta autoregressive ta hanyar horarwa akan oda bazuwar kalma. Wannan dabarar juzu'i tana ba shi damar koyo daga kowane matsayi ba tare da rufe alamun ba.
Wace manufar horon farko XLNet ke amfani da ita?
XLNet yana haɓaka daman log-saman akan duk abubuwan da suka faru na odar ƙididdiga ta alama, wanda ake kira ƙirar ƙirar harshe na permutation.
Wane rauni na BERT aka tsara musamman don magancewa?
Alamar wucin gadi [MASK] ta BERT ba ta bayyana yayin daidaitawa kuma tana ɗaukar tsinkayar abin rufe fuska a matsayin mai zaman kanta; XLNet yana guje wa batutuwa biyu.
Menene rafi biyu na XLNet ya raba hankalin kai?
Rafin abun ciki yana ɓoye alamar alama da mahallin, yayin da rafin tambaya ya san matsayin manufa amma ba abun ciki ba, yana ba da damar hasashen ba tare da yabo ba.
Shin XLNet yana jujjuya kalmomin a cikin jumla?
XLNet yana haɓaka odar hasashen (factorization) ta hanyar abin rufe fuska; ana adana ma'aunin alamar asali ta hanyar rikodi na matsayi.
Wanne gine-gine ke aiki azaman kashin bayan XLNet don mahallin dogon zango?
XLNet yana ginawa akan Transformer-XL, wanda ke ƙara maimaita sashi da kuma ɓoye matsayi na dangi don sarrafa dogayen jeri.