HejuruUbuyobozi bukurikira
Isuzuma rya RAG Ibipimo na RAGAS
Tekiniki
Ubuyobozi bwa tekiniki
ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu.
Umva iki gitaboAI-byavuzwe · ~2 min
BLEU was built for translation and leans on precision; ROUGE was built for summarization and leans on recall.
Ibipimo byombi bipima n-garama ihuza inyandiko yumukandida ninyandiko imwe cyangwa nyinshi zerekana, ariko zishimangira icyerekezo gitandukanye. BLEU (Bilingual Evaluation Understudy) ibara neza n-garama yahinduwe (mubisanzwe 1- kugeza kuri garama 4), ikagwiza geometrike, kandi igakoresha ibihano byoroheje kuburyo sisitemu idashobora gukina amanota itanga umusaruro muke cyane. ROUGE (Ibuka-Yerekejweho Kwiga Gisting Evaluation) ahubwo ishyigikira kwibutsa: ROUGE-N ibara hejuru ya n-garama, ROUGE-L ikoresha igihe kirekire cyakurikiyeho kugirango ihembe imikino ikurikirana idakeneye guhuza. BLEU arabaza 'angahe mubyo sisitemu yavuze aribyo?' mugihe ROUGE ibaza 'sisitemu zifata sisitemu zingana iki?'. Byombi bihendutse kandi byororoka ariko reba gusa ijambo ryuzuye hejuru, kubura imvugo nubusobanuro.
Abashakashatsi bahinduye imashini bavuga amanota ya BLEU kubipimo bya WMT kugirango bagereranye ubuziranenge bwa sisitemu
Impapuro zincamake zerekana ROUGE-1, ROUGE-2, na ROUGE-L kuri dataset ya CNN / DailyMail
Itsinda ryubwubatsi rikurikirana BLEU muri CI kugirango hamenyekane ibyasubiye inyuma mugihe uhinduye neza icyitegererezo cyubuhinduzi
Igicuruzwa cyincamake gikoresha ROUGE-L nkigenzura rihendutse mbere yo gukora isuzuma rihenze ryabantu
Kuberako n-garama metrics ihemba ijambo rihuye neza, ntibaha agaciro imvugo yemewe hamwe no kwandika neza, ikibazo kigenda cyiyongera nkuko LLM isohoka itandukana mumagambo. Ibishushanyo-bishingiye ku bipimo nka BERTScore kandi wize ibipimo nka BLEURT na COMET, wongeyeho LLM-nkumucamanza gusuzuma, bigenda byuzuzanya cyangwa kubisimbuza. Biracyaza, ROUGE na BLEU bikomeza nkuko byihuse, bisobanutse neza mubipapuro hafi ya byose.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu. BLEU yubatswe kugirango ihindurwe kandi ishingiye ku busobanuro; ROUGE yubatswe mu ncamake kandi ishingiye ku kwibuka.
BLEU yaremewe guhindurwa kandi ishingiye kuri n-garama ihinduwe neza hamwe nigihano gito.
ROUGE isobanura Kwibuka-Kwerekeza kuri Understudy yo Gisting Evaluation kandi ishimangira umubare wibisobanuro byafashwe.
Igihano kigufi kigabanya BLEU mugihe umukandida ari mugufi kuruta kuvugwa, guhagarika sisitemu guhindagura neza nibisohoka terse.
ROUGE-L ikoresha igihe kirekire gisanzwe gikurikiraho, ihemba imikino ikurikirana mugihe yemerera icyuho.
Byombi bishingiye ku ijambo nyaryo / n-garama rihuye, bityo rero ntibaha agaciro imvugo yemewe itandukanye n'amagambo.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Isuzuma rya RAG Ibipimo na RAGAS
Tekiniki