Ubuyobozi bwa tekiniki

ROUGE na BLEU Isuzuma Ibipimo

ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza ha ROUGE na BLEU Isuzuma Ibipimo
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

BLEU was built for translation and leans on precision; ROUGE was built for summarization and leans on recall.

Kwibira cyane

Ibipimo byombi bipima n-garama ihuza inyandiko yumukandida ninyandiko imwe cyangwa nyinshi zerekana, ariko zishimangira icyerekezo gitandukanye. BLEU (Bilingual Evaluation Understudy) ibara neza n-garama yahinduwe (mubisanzwe 1- kugeza kuri garama 4), ikagwiza geometrike, kandi igakoresha ibihano byoroheje kuburyo sisitemu idashobora gukina amanota itanga umusaruro muke cyane. ROUGE (Ibuka-Yerekejweho Kwiga Gisting Evaluation) ahubwo ishyigikira kwibutsa: ROUGE-N ibara hejuru ya n-garama, ROUGE-L ikoresha igihe kirekire cyakurikiyeho kugirango ihembe imikino ikurikirana idakeneye guhuza. BLEU arabaza 'angahe mubyo sisitemu yavuze aribyo?' mugihe ROUGE ibaza 'sisitemu zifata sisitemu zingana iki?'. Byombi bihendutse kandi byororoka ariko reba gusa ijambo ryuzuye hejuru, kubura imvugo nubusobanuro.

Gushyira mu bikorwa Isi

Abashakashatsi bahinduye imashini bavuga amanota ya BLEU kubipimo bya WMT kugirango bagereranye ubuziranenge bwa sisitemu

Impapuro zincamake zerekana ROUGE-1, ROUGE-2, na ROUGE-L kuri dataset ya CNN / DailyMail

Itsinda ryubwubatsi rikurikirana BLEU muri CI kugirango hamenyekane ibyasubiye inyuma mugihe uhinduye neza icyitegererezo cyubuhinduzi

Igicuruzwa cyincamake gikoresha ROUGE-L nkigenzura rihendutse mbere yo gukora isuzuma rihenze ryabantu

Ejo hazaza ha ROUGE na BLEU Isuzuma Ibipimo

Kuberako n-garama metrics ihemba ijambo rihuye neza, ntibaha agaciro imvugo yemewe hamwe no kwandika neza, ikibazo kigenda cyiyongera nkuko LLM isohoka itandukana mumagambo. Ibishushanyo-bishingiye ku bipimo nka BERTScore kandi wize ibipimo nka BLEURT na COMET, wongeyeho LLM-nkumucamanza gusuzuma, bigenda byuzuzanya cyangwa kubisimbuza. Biracyaza, ROUGE na BLEU bikomeza nkuko byihuse, bisobanutse neza mubipapuro hafi ya byose.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the ROUGE and BLEU Evaluation Metrics quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is ROUGE and BLEU Evaluation Metrics?

ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu. BLEU yubatswe kugirango ihindurwe kandi ishingiye ku busobanuro; ROUGE yubatswe mu ncamake kandi ishingiye ku kwibuka.

Nibihe bipimo byateguwe mbere yo guhindura imashini kandi bishimangira neza?

BLEU yaremewe guhindurwa kandi ishingiye kuri n-garama ihinduwe neza hamwe nigihano gito.

ROUGE igamije iki?

ROUGE isobanura Kwibuka-Kwerekeza kuri Understudy yo Gisting Evaluation kandi ishimangira umubare wibisobanuro byafashwe.

Niki igihano gito cya BLEU kibuza?

Igihano kigufi kigabanya BLEU mugihe umukandida ari mugufi kuruta kuvugwa, guhagarika sisitemu guhindagura neza nibisohoka terse.

ROUGE-L ipima iki?

ROUGE-L ikoresha igihe kirekire gisanzwe gikurikiraho, ihemba imikino ikurikirana mugihe yemerera icyuho.

Ni ubuhe buryo bw'ingenzi busangiwe kuri BLEU na ROUGE?

Byombi bishingiye ku ijambo nyaryo / n-garama rihuye, bityo rero ntibaha agaciro imvugo yemewe itandukanye n'amagambo.