Incamake
ROUGE na BLEU nakazi ka mashini yikora yo kugereranya inyandiko yakozwe na mashini hamwe nabantu. BLEU yubatswe kugirango ihindurwe kandi ishingiye ku busobanuro; ROUGE yubatswe mu ncamake kandi ishingiye ku kwibuka.
ROUGE na BLEU Isuzuma Ibipimo ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.
Kwibira cyane
Ibipimo byombi bipima n-garama ihuza inyandiko yumukandida ninyandiko imwe cyangwa nyinshi zerekana, ariko zishimangira icyerekezo gitandukanye. BLEU (Bilingual Evaluation Understudy) ibara neza n-garama yahinduwe (mubisanzwe 1- kugeza kuri garama 4), ikagwiza geometrike, kandi igakoresha ibihano byoroheje kuburyo sisitemu idashobora gukina amanota itanga umusaruro muke cyane. ROUGE (Ibuka-Yerekejweho Kwiga Gisting Evaluation) ahubwo ishyigikira kwibutsa: ROUGE-N ibara hejuru ya n-garama, ROUGE-L ikoresha igihe kirekire cyakurikiyeho kugirango ihembe imikino ikurikirana idakeneye guhuza. BLEU arabaza 'angahe mubyo sisitemu yavuze aribyo?' mugihe ROUGE ibaza 'sisitemu zifata sisitemu zingana iki?'. Byombi bihendutse kandi byororoka ariko reba gusa ijambo ryuzuye hejuru, kubura imvugo nubusobanuro.
Ubushishozi
BLEU yahinduye neza yerekana neza buri mukandida n-garama kubara kugeza ku mubare ntarengwa aho ariho hose, bikumira imikino yo gusubiramo; igihano kigufi gitangira mugihe ibisohoka ari bigufi kuruta ibyerekanwe. ROUGE-L ndende-isanzwe-ikurikira-ifata interuro-urwego imiterere ninteruro yijambo mugihe yemerera icyuho, kandi ROUGE ikunze kuvuga F1 ihuza neza no kwibuka.
Kumenya ROUGE na BLEU Isuzuma Ibipimo
ROUGE na BLEU nakazi ko gukora ama metero yikora yo kugereranya inyandiko yakozwe nimashini hamwe nabantu. BLEU yubatswe kugirango ihindurwe kandi ishingiye ku busobanuro; ROUGE yubatswe mu ncamake kandi ishingiye ku kwibuka. ROUGE na BLEU Isuzuma Ibipimo ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata ROUGE na BLEU Isuzuma Ibipimo nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mubimenyerezo, amakipe akomeye akoresha ROUGE na BLEU Isuzuma Ibipimo bitezimbere ubwubatsi, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Abashakashatsi bahinduye imashini bavuga amanota ya BLEU kubipimo bya WMT kugirango bagereranye ubuziranenge bwa sisitemu
Impapuro zincamake zerekana ROUGE-1, ROUGE-2, na ROUGE-L kuri dataset ya CNN / DailyMail
Itsinda ryubwubatsi rikurikirana BLEU muri CI kugirango hamenyekane ibyasubiye inyuma mugihe uhinduye neza icyitegererezo cyubuhinduzi
Igicuruzwa cyincamake gikoresha ROUGE-L nkigenzura rihendutse mbere yo gukora isuzuma rihenze ryabantu
Uburyo bwo Gushyira mu bikorwa
ROUGE na BLEU Isuzuma Ibipimo mubikorwa
Abashakashatsi bahinduye imashini bavuga amanota ya BLEU kubipimo bya WMT kugirango bagereranye ubuziranenge bwa sisitemu.
Abashakashatsi bahinduye imashini bavuga amanota ya BLEU ku bipimo bya WMT kugirango bagereranye ubuziranenge bwa sisitemu Amakipe akunze kubona umusaruro ushimishije iyo asobanuye ibipimo ngenderwaho imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
ROUGE na BLEU Isuzuma Ibipimo mubikorwa
Impapuro zincamake zerekana ROUGE-1, ROUGE-2, na ROUGE-L kuri dataset ya CNN / DailyMail.
Impapuro zerekana incamake zerekana ROUGE-1, ROUGE-2, na ROUGE-L kuri CNN / DailyMail dataset Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
ROUGE na BLEU Isuzuma Ibipimo mubikorwa
Itsinda ryubwubatsi rikurikirana BLEU muri CI kugirango hamenyekane ibyasubiye inyuma mugihe uhinduye neza icyitegererezo cyubuhinduzi.
Itsinda ryubwubatsi rikurikirana BLEU muri CI kugirango hamenyekane ibyasubiye inyuma mugihe uteguye neza icyitegererezo cyubuhinduzi Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
ROUGE na BLEU Isuzuma Ibipimo mubikorwa
Igicuruzwa cyincamake gikoresha ROUGE-L nkigenzura rihendutse mbere yo gukora isuzuma rihenze ryabantu.
Igicuruzwa cyincamake gikoresha ROUGE-L nkigenzura rihendutse mbere yo gukora isuzuma rihendutse ryabantu Amakipe mubisanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.