ROUGE na BLEU Nyocha Metrics
ROUGE na BLEU bụ metrics akpaka na-arụ ọrụ maka atụnyere ederede emepụtara igwe megide nrụtụ aka mmadụ.
Nchịkọta
BLEU was built for translation and leans on precision; ROUGE was built for summarization and leans on recall.
Ime miri emi
Metiriks abụọ a na-atụ n-gram ndakọrịta n'etiti ederede nwa akwụkwọ na otu ederede ma ọ bụ karịa, mana ha na-emesi ntụzịaka dị iche iche ike. BLEU (Ụmụ akwụkwọ nyocha asụsụ abụọ) na-agbakọ n-gram ziri ezi gbanwetụrụ (nke bụ 1-site na 4-gram), na-amụba ha na geometric, ma tinye ntaramahụhụ dị mkpụmkpụ ka sistemụ enweghị ike ịme akara ahụ site na imepụta obere mpụta. ROUGE (Nleba Ncheta-Nleba anya maka Ntụle Gisting) kama na-akwado icheta: ROUGE-N na-agụta n-gram, ROUGE-L na-eji ihe na-esote ogologo oge iji kwụọ ụgwọ egwuregwu n'usoro na-achọghị contiguity. BLEU na-ajụ ' ole n'ime ihe sistemụ kwuru ziri ezi?' ebe ROUGE na-ajụ ' ole n'ime ntụaka ka usoro ahụ weghaara?'. Ha abụọ dị ọnụ ala ma nwee ike imepụtagharị mana hụ naanị okwu dị n'elu, na-efu nkwuwa okwu na ihe ọ pụtara.
Nghọta nka nka
Mpempe akwụkwọ ziri ezi nke BLEU gbanwere onye ọ bụla n-gram na-agụta ọnụ ọgụgụ ya kachasị na ntụaka ọ bụla, na-egbochi egwuregwu ugboro ugboro; ntaramahụhụ nkenke na-amalite mgbe mmepụta dị mkpụmkpụ karịa ntụnye aka. Ihe na-esote ROUGE-L kachasị ogologo na-ejide nhazi ọkwa nke ahịrịokwu na usoro okwu ma na-enye ohere ohere, ROUGE na-akọkarị F1 na-ejikọta nkenke na icheta.
Mmetụta atụmatụ
Ọnụ ego na mmefu ego
Mkpebi ihe owuwu ụlọ na-akwalite arụmọrụ yana ọnụ ahịa ọrụ ruo ọtụtụ afọ.
Mkpebi doro anya
Nkà mmụta nka na-enyere ndị otu egwuregwu aka ịhọrọ nchịkọta ziri ezi, ọ bụghị naanị nke kachasị ọhụrụ.
Quality akara
Nhọrọ injinia ka mma na-ebelata ihe omume ntụkwasị obi na mmepụta.
Ọdịnihu nke ROUGE na BLEU Nyocha Metrics
N'ihi na n-gram metrics na-akwụghachi ụgwọ maka dakọtara ọnụ, ha na-eleda nkwuwa okwu ziri ezi na idegharị nke ọma, nsogbu na-eto eto ka mpụta LLM na-agbanwe n'ụzọ dị iche iche site na ntụnyere aka. Mgbakwunye metrik dabere dị ka BERTScore na metrik mmụta dị ka BLEURT na COMET, gbakwunyere nyocha LLM dị ka onye ọka ikpe, na-agbakwunye ma ọ bụ dochie ha. N'agbanyeghị nke ahụ, ROUGE na BLEU na-aga n'ihu ngwa ngwa, usoro ndabere doro anya na-akọ na ihe fọrọ nke nta ka ọ bụrụ akwụkwọ ọ bụla.
Mmejuputa n'ezie n'ụwa
Ndị nyocha ntụgharị asụsụ igwe na-akọ akara BLEU na akara WMT iji tụnyere ịdịmma sistemụ
Akwụkwọ nchịkọta akụkọ na-akọ ROUGE-1, ROUGE-2, na ROUGE-L na dataset CNN/DailyMail.
Otu injinia na-eso BLEU na CI iji chọpụta nlọghachi azụ mgbe ha na-edozi ụdị ntụgharị asụsụ
Ngwaahịa nchịkọta na-eji ROUGE-L dị ka nlele akpaaka dị ọnụ ala tupu ịme nyocha mmadụ dị ọnụ ahịa
Ihe ize ndụ & okporo ụzọ nche
Ịkwalite otu akara ngosi nwere ike zoo adịghị ike sistemụ sara mbara.
A na-eledakarị ihe akụrụngwa na ụgwọ ọrụ anya.
Ọdịiche nchekwa na nleba anya nwere ike itolite ka sistemu na-adịwanye mgbagwoju anya.
Map mmejuputa
Kọwaa latency, ịdịmma na ebumnuche ọnụ ahịa tupu mmejuputa ya.
Benchmark n'okpuru ibu dị adị na ọnọdụ data.
Nleba anya akụrụngwa maka mperi, ịkpafu na mmetụta onye ọrụ.
Kwadebe ụzọ nzaghachi azụghachi azụ na ihe omume tupu ịchachaa.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ROUGE and BLEU Evaluation Metrics quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nyochaa Linear na Ntụle Njirimara Frozen
Ajụjụ a na-ajụkarị
What is ROUGE and BLEU Evaluation Metrics?
ROUGE na BLEU bụ metrics akpaka na-arụ ọrụ maka atụnyere ederede emepụtara igwe megide nrụtụ aka mmadụ. Ewubere BLEU maka ntụgharị ma dabere na nkenke; Ewuru ROUGE maka nchịkọta yana dabere na icheta.
Kedu metric e mere na mbụ maka ntụgharị igwe ma na-emesi nkenke ike?
Emepụtara BLEU maka ntụgharị asụsụ ma dabere na n-gram ziri ezi gbanwetụrụ yana ntaramahụhụ dị mkpụmkpụ.
Kedu ihe ROUGE gbadoro anya na ya?
ROUGE na-anọchi anya Ntụle Ncheta gbakwasara maka Ntụle nkọwa ma mesie ike ole n'ime ntụaka ahụ ejidere.
Kedu ihe ntaramahụhụ mkpirisi BLEU na-egbochi?
Ntaramahụhụ dị mkpụmkpụ na-ebelata BLEU mgbe onye ndoro-ndoro ochichi dị mkpụmkpụ karịa ntụaka ahụ, na-akwụsị sistemu site na iwepụta nkenke nke ọma na mmepụta terse.
Kedu ihe ROUGE-L na-atụ?
ROUGE-L na-eji usoro kachasị ogologo oge na-esochi, na-akwụghachi ụgwọ n'usoro n'usoro ma na-enye ohere ohere.
Kedu ihe bụ njedebe ikekọrịta nke ma BLEU na ROUGE?
Ha abụọ na-adabere n'otu n'otu okwu/n-gram dakọtara, yabụ na ha na-eleda nkwuwa okwu dị mma nke dị iche na nrụtụ aka.