Dubawa
ROUGE da BLEU sune ma'auni na atomatik na aiki don kwatanta rubutun da aka samar da na'ura akan nassoshi na ɗan adam. An gina BLEU don fassarar kuma yana dogara akan daidaito; ROUGE an gina shi don taƙaitawa kuma ya dogara akan tunawa.
ROUGE da BLEU Evaluation Metrics tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli.
Zurfafa nutsewa
Duk ma'auni guda biyu suna auna haɗin n-gram tsakanin rubutun ɗan takara da rubutun magana ɗaya ko fiye, amma suna jaddada kwatance daban-daban. BLEU (Ƙaramar Nazarin Harsuna Biyu) tana ƙididdige madaidaicin n-gram (yawanci 1- zuwa 4-grams), yana ninka su ta hanyar geometric, kuma yana zartar da hukuncin taƙaitaccen hukunci don haka tsarin ba zai iya yin makin ta hanyar samar da ɗan gajeren fitarwa ba. ROUGE (Ƙaramar Tunawa-Mai Gabatarwa don Ƙimar Gisting) a maimakon haka ya fi son tunawa: ROUGE-N yana ƙidaya n-grams masu rufewa, ROUGE-L yana amfani da mafi tsayi na gama-gari don ba da lada a cikin tsari ba tare da buƙatar haɗin kai ba. BLEU yayi tambaya 'nawa na abin da tsarin ya ce daidai ne?' yayin da ROUGE ke tambaya 'nawa ne tsarin ya kama?'. Dukansu suna da arha kuma ana iya sake su amma kawai ga kalma ta sama, ta ɓace da ma'ana.
Fahimtar Fasaha
Shirye-shiryen gyaran gyare-gyare na BLEU kowane ɗan takara n-gram yana ƙidayar ƙidayarsa a cikin kowane tunani, yana hana maimaita wasan caca; hukunce-hukuncen takaitawa yana farawa lokacin da fitarwa ya fi guntu fiye da abin da aka ambata. ROUGE-L mafi dadewa-na gaba-gaba yana ɗaukar tsarin matakin jumla da tsarin kalma yayin da yake ba da damar giɓi, kuma ROUGE yakan bayar da rahoton F1 yana haɗa daidaici da tunawa.
Mastering ROUGE da BLEU Evaluation Metrics
ROUGE da BLEU sune ma'auni na atomatik na aiki don kwatanta rubutun da aka samar da na'ura akan nassoshi na ɗan adam. An gina BLEU don fassarar kuma yana dogara akan daidaito; ROUGE an gina shi don taƙaitawa kuma ya dogara akan tunawa. ROUGE da BLEU Evaluation Metrics tubalin ginin fasaha ne wanda ke shafar ingancin samfuri, farashin kayayyakin more rayuwa, latency, da aminci a sikeli. Don gina zurfin fahimta, bi da ROUGE da BLEU Evaluation Metrics a matsayin samfurin aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya dogara da abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da ma'aunin kimantawa na ROUGE da BLEU suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa akan dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Masu binciken fassarar inji sun ba da rahoton maki BLEU akan ma'auni na WMT don kwatanta ingancin tsarin
Takardun taƙaitawa suna ba da rahoton ROUGE-1, ROUGE-2, da ROUGE-L akan bayanan CNN/DailyMail
Ƙungiyar injiniya tana bin BLEU a cikin CI don gano koma baya lokacin daidaita tsarin fassarar
Samfurin taƙaitawa yana amfani da ROUGE-L azaman rajistan atomatik mai arha kafin gudanar da ƙimar ƙimar ɗan adam
Hanyoyin Aiwatarwa
ROUGE da BLEU Ma'aunin kimantawa a aikace
Masu binciken fassarar inji sun ba da rahoton maki BLEU akan ma'auni na WMT don kwatanta ingancin tsarin.
Masu binciken fassarar injin suna ba da rahoton maki BLEU akan ma'auni na WMT don kwatanta ingancin tsarin Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure a kan lokaci.
ROUGE da BLEU Ma'aunin kimantawa a aikace
Takardun taƙaitawa suna ba da rahoton ROUGE-1, ROUGE-2, da ROUGE-L akan bayanan CNN/DailyMail.
Takardun taƙaitawa suna ba da rahoton ROUGE-1, ROUGE-2, da ROUGE-L akan CNN/DailyMail dataset Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da kuma bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
ROUGE da BLEU Ma'aunin kimantawa a aikace
Ƙungiyar injiniya tana bin BLEU a cikin CI don gano koma baya lokacin daidaita tsarin fassarar.
Ƙungiya ta injiniya tana bin BLEU a cikin CI don gano koma baya lokacin da aka daidaita samfurin fassarar Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
ROUGE da BLEU Ma'aunin kimantawa a aikace
Samfurin taƙaitawa yana amfani da ROUGE-L azaman rajistan atomatik mai arha kafin gudanar da ƙimar ƙimar ɗan adam.
Samfurin taƙaitawa yana amfani da ROUGE-L azaman rajistan atomatik mai arha kafin gudanar da ƙwararrun kimantawa na ɗan adam yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.