ROUGE na BLEU Isuzuma Ibipimo
ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu.
Incamake
BLEU was built for translation and leans on precision; ROUGE was built for summarization and leans on recall.
Kwibira cyane
Ibipimo byombi bipima n-garama ihuza inyandiko yumukandida ninyandiko imwe cyangwa nyinshi zerekana, ariko zishimangira icyerekezo gitandukanye. BLEU (Bilingual Evaluation Understudy) ibara neza n-garama yahinduwe (mubisanzwe 1- kugeza kuri garama 4), ikagwiza geometrike, kandi igakoresha ibihano byoroheje kuburyo sisitemu idashobora gukina amanota itanga umusaruro muke cyane. ROUGE (Ibuka-Yerekejweho Kwiga Gisting Evaluation) ahubwo ishyigikira kwibutsa: ROUGE-N ibara hejuru ya n-garama, ROUGE-L ikoresha igihe kirekire cyakurikiyeho kugirango ihembe imikino ikurikirana idakeneye guhuza. BLEU arabaza 'angahe mubyo sisitemu yavuze aribyo?' mugihe ROUGE ibaza 'sisitemu zifata sisitemu zingana iki?'. Byombi bihendutse kandi byororoka ariko reba gusa ijambo ryuzuye hejuru, kubura imvugo nubusobanuro.
Ubushishozi
BLEU yahinduye neza yerekana neza buri mukandida n-garama kubara kugeza ku mubare ntarengwa aho ariho hose, bikumira imikino yo gusubiramo; igihano kigufi gitangira mugihe ibisohoka ari bigufi kuruta ibyerekanwe. ROUGE-L ndende-isanzwe-ikurikira-ifata interuro-urwego imiterere ninteruro yijambo mugihe yemerera icyuho, kandi ROUGE ikunze kuvuga F1 ihuza neza no kwibuka.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza ha ROUGE na BLEU Isuzuma Ibipimo
Kuberako n-garama metrics ihemba ijambo rihuye neza, ntibaha agaciro imvugo yemewe hamwe no kwandika neza, ikibazo kigenda cyiyongera nkuko LLM isohoka itandukana mumagambo. Ibishushanyo-bishingiye ku bipimo nka BERTScore kandi wize ibipimo nka BLEURT na COMET, wongeyeho LLM-nkumucamanza gusuzuma, bigenda byuzuzanya cyangwa kubisimbuza. Biracyaza, ROUGE na BLEU bikomeza nkuko byihuse, bisobanutse neza mubipapuro hafi ya byose.
Gushyira mu bikorwa Isi
Abashakashatsi bahinduye imashini bavuga amanota ya BLEU kubipimo bya WMT kugirango bagereranye ubuziranenge bwa sisitemu
Impapuro zincamake zerekana ROUGE-1, ROUGE-2, na ROUGE-L kuri dataset ya CNN / DailyMail
Itsinda ryubwubatsi rikurikirana BLEU muri CI kugirango hamenyekane ibyasubiye inyuma mugihe uhinduye neza icyitegererezo cyubuhinduzi
Igicuruzwa cyincamake gikoresha ROUGE-L nkigenzura rihendutse mbere yo gukora isuzuma rihenze ryabantu
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ROUGE and BLEU Evaluation Metrics quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Isuzuma ryumurongo hamwe nisuzuma ryimiterere
Ibibazo bikunze kubazwa
What is ROUGE and BLEU Evaluation Metrics?
ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu. BLEU yubatswe kugirango ihindurwe kandi ishingiye ku busobanuro; ROUGE yubatswe mu ncamake kandi ishingiye ku kwibuka.
Nibihe bipimo byateguwe mbere yo guhindura imashini kandi bishimangira neza?
BLEU yaremewe guhindurwa kandi ishingiye kuri n-garama ihinduwe neza hamwe nigihano gito.
ROUGE igamije iki?
ROUGE isobanura Kwibuka-Kwerekeza kuri Understudy yo Gisting Evaluation kandi ishimangira umubare wibisobanuro byafashwe.
Niki igihano gito cya BLEU kibuza?
Igihano kigufi kigabanya BLEU mugihe umukandida ari mugufi kuruta kuvugwa, guhagarika sisitemu guhindagura neza nibisohoka terse.
ROUGE-L ipima iki?
ROUGE-L ikoresha igihe kirekire gisanzwe gikurikiraho, ihemba imikino ikurikirana mugihe yemerera icyuho.
Ni ubuhe buryo bw'ingenzi busangiwe kuri BLEU na ROUGE?
Byombi bishingiye ku ijambo nyaryo / n-garama rihuye, bityo rero ntibaha agaciro imvugo yemewe itandukanye n'amagambo.