Jagoran Harshe AI

ELMo Nau'in Yanayi

ELMo (Embeddings from Language Models) wani ci gaba ne na 2018 wanda ya ba kowace kalma wakilcin da aka tsara ta hanyar jimlarta, don haka 'banki' a cikin 'bankin kogi' ya bambanta da 'banki' a cikin 'bankin ajiya.

Dubawa

ELMo (Embeddings from Language Models) wani ci gaba ne na 2018 wanda ya ba kowace kalma wakilcin da aka tsara ta hanyar jimla, don haka 'banki' a cikin 'bankin kogi' ya bambanta da 'banki' a cikin 'bankin ajiya'. Ya nuna alamar canji daga madaidaicin kalmomin vectors zuwa NLP mai sane da mahallin.

ELMo Contextual Embeddings wani ɓangare ne na tarin harshe-AI da ake amfani da shi don karantawa, ƙirƙira, rarrabuwa, da canza rubutu da magana a sikeli.

Zurfafa nutsewa

ELMo, wanda Allen Institute for AI masu bincike ya gabatar (Peters et al., 2018), yana samar da wakilcin kalmomi ta hanyar gudanar da jumla ta hanyar ƙirar harshe mai zurfi na LSTM mai zurfi wanda aka horar da shi a kan wani biliyan-kalmar corpus. Ba kamar Word2Vec ko GloVe ba, waɗanda ke ba da ƙayyadaddun vector guda ɗaya a kowace kalma, ELMo tana ƙididdige sabon vector don kowane abin da ya faru dangane da mahallin kewaye. Mahimmanci, ELMo yana haɗa duk yadudduka na LSTM na ciki ta hanyar koyo, takamaiman ma'auni na ɗawainiya maimakon amfani da saman saman kawai. Ƙananan yadudduka suna yin kama da syntax (bangaren-magana, tsari) yayin da manyan yadudduka ke ɗaukar ma'ana da ma'anar kalma. Ƙara ELMo zuwa samfuran da ake da su ya haifar da babban fa'ida a cikin ayyuka masu ƙima guda shida, gami da amsa tambaya, nazarin ra'ayi, da sanin mahaɗan mai suna.

Fahimtar Fasaha

ELMo ta tattara LSTMs guda biyu: samfurin harshe na gaba yana tsinkayar kalma ta gaba da baya wanda ke tsinkayar kalmar da ta gabata, kowanne sama da abubuwan shigar CNN na matakin hali (don haka yana sarrafa kalmomin da ba a gani). Don aiki na ƙasa, ELMo yana rushe wakilcin Layer ta amfani da ma'aunin nauyi na softmax-na al'ada tare da scalar, duk an koya yayin daidaitawa. Wannan yana nufin kowane ɗawainiya zai iya yanke shawarar adadin syntactic da siginar tamani da yake so daga biLM da aka rigaya daskararre.

Ƙwararren Ƙwararru na ELMo

ELMo (Embeddings from Language Models) wani ci gaba ne na 2018 wanda ya ba kowace kalma wakilcin da aka tsara ta hanyar jimla, don haka 'banki' a cikin 'bankin kogi' ya bambanta da 'banki' a cikin 'bankin ajiya'. Ya nuna alamar canji daga madaidaicin kalmomin vectors zuwa NLP mai sane da mahallin. ELMo Contextual Embeddings wani ɓangare ne na tarin harshe-AI da ake amfani da shi don karantawa, ƙirƙira, rarrabuwa, da canza rubutu da magana a sikeli. Don gina zurfin fahimta, bi ELMo Contextual Embeddings azaman ƙirar aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi suna amfani da ELMo Contextual Embeddings ƙira ƙira, maidowa, da sake duba madaukai azaman tsarin sadarwa da aka haɗa. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba. A lokaci guda, abubuwan da ba a iya gani ba na iya shigar da rahotanni cikin nutsuwa, kwararar goyan baya, ko abubuwan bincike. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.

Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.

Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.

Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar ELMo Contextual Embddings

Babban ra'ayin ELMo, wakilcin mahallin daga horon ƙirar harshe, ya zama tushen tushe, amma tsarin gine-ginen LSTM na yau da kullun ya kasance cikin sauri ya rufe shi da samfuran masu canji kamar BERT a ƙarshen 2018, waɗanda ke karanta jimlar jimloli a layi ɗaya da sikeli mafi kyau. A yau ELMo galibi yana da mahimmancin tarihi da ilimi, kodayake sarrafa shigarwar hali-CNN da ra'ayoyi masu nauyi har yanzu suna tasiri na musamman aikin haɗawa a cikin ƙananan albarkatu da wadatattun harsuna.

Aiwatar da Gaskiyar Duniya

Haɓaka tsarin tantance mahaɗan mai suna waɗanda dole ne su faɗi ko 'Washington' na nufin mutum, jiha, ko birni dangane da kalmomin da ke kewaye.

Ƙarfafa nazarin ra'ayi ta hanyar ɗaukar cewa 'mara lafiya' yana nufin mara kyau a cikin 'Ina jin rashin lafiya' amma tabbatacce a cikin ɓangarorin 'wannan ba shi da lafiya'

Haɓaka tsarin amsa tambayoyi akan ma'aunin SQuAD ta hanyar ciyar da abubuwan da suka dace a cikin mai karatu.

Rarraba ma'anar kalma a cikin fassarar inji don haka kalmomi masu yawa kamar 'tsika' suna fassara daidai abin da aka bayar

Hanyoyin Aiwatarwa

ELMo Contextual Embeddings a aikace

Haɓaka tsarin tantance mahaɗan mai suna waɗanda dole ne su faɗi ko 'Washington' na nufin mutum, jiha, ko birni dangane da kalmomin da ke kewaye.

Haɓaka tsarin tantance mahaɗan mai suna waɗanda dole ne su faɗi ko 'Washington' na nufin mutum, jiha, ko birni bisa ga kalmomin da ke kewaye Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da kuma bin diddigin nasarorin samarwa da tsadar kurakurai a kan lokaci.

ELMo Contextual Embeddings a aikace

Ƙarfafa nazarin ra'ayi ta hanyar kama wannan 'marasa lafiya' yana nufin mara kyau a cikin 'Ina jin rashin lafiya' amma tabbatacce a cikin kalmar 'wannan ba shi da lafiya'.

Ƙarfafa nazarin ra'ayi ta hanyar ɗaukar cewa 'marasa lafiya' yana nufin mara kyau a cikin 'Ina jin rashin lafiya' amma tabbatacce a cikin slang' wannan ba shi da lafiya' Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da kuma bin diddigin nasarorin da ake samu da kuma tsadar kuɗi a kan lokaci.

ELMo Contextual Embeddings a aikace

Haɓaka tsarin amsa tambayoyi akan ma'auni na SQuAD ta hanyar ciyar da abubuwan da suka dace a cikin mai karatu.

Haɓaka tsarin amsa tambayoyi akan ma'aunin SQuAD ta hanyar ciyar da ƙwararrun alamomin mahallin a cikin ƙungiyoyin masu karatu yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.

ELMo Contextual Embeddings a aikace

Rarraba ma'anar kalma a cikin fassarar inji don haka kalmomi masu yawa kamar 'tsika' suna fassara daidai abin da aka bayar.

Rarraba ma'anar ma'anar kalma a cikin fassarar inji don haka kalmomi masu yawa kamar 'shuka' suna fassara daidai da aka ba mahallin Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da kuma bin duk nasarorin da ake samu da kuma tsadar kuskure a kan lokaci.

Hatsari & Tsare-tsare

!

Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.

!

Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.

!

Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.

Taswirar Hanya

1

Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.

Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.

Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.

Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.

Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike