Idanwo ti o sopọ mọ itọsọna · Alabọde Ipele

ROUGE ati BLEU Igbelewọn Metrics adanwo

Checks BLEU precision and clipping, ROUGE recall and sequence overlap, and why n-gram metrics miss semantically valid paraphrases.

Jẹmọ itọsọna awọn ọnaRouge Ati Bleu Igbelewọn Metiriki
Ibeere 1 ti 8

Metiriki wo ni a ṣe ni akọkọ fun itumọ ẹrọ ti o tẹnu mọ pipe?

Awotẹlẹ gbogbo ibeere8 ibeere

Awọn idahun ati awọn alaye han bi o ṣe n mu ibeere naa.

  1. Metiriki wo ni a ṣe ni akọkọ fun itumọ ẹrọ ti o tẹnu mọ pipe?
    • BLEU
    • ROUGE
    • BERTScore
    • F1 nikan
  2. Kini ROUGE ni iṣalaye akọkọ si?
    • Itọkasi
    • Ranti
    • Lairi
    • Iwọn awoṣe
  3. Kini ijiya kukuru ti BLEU ṣe idiwọ?
    • Ṣiṣejade awọn abajade gigun pupọju
    • Lilo awọn ọrọ toje
    • Ere Dimegilio pẹlu awọn abajade kukuru pupọ
    • Ntun ọrọ kanna
  4. Kini iwọn ROUGE-L?
    • Awọn nọmba ti awọn lẹta ni o wu
    • Lairi ni milliseconds
    • Iwọn ẹkọ ti o tobi julọ ti a lo
    • Atẹle ti o wọpọ julọ laarin oludije ati itọkasi
  5. Kini aropin pinpin bọtini ti mejeeji BLEU ati ROUGE?
    • Wọn nikan wiwọn dada n-gram ni lqkan ati padanu paraphrase tabi itumo
    • Wọn nilo awọn GPU lati ṣe iṣiro
    • Wọn ko le mu ọrọ Gẹẹsi mu
    • Wọn ko nilo ọrọ itọkasi
  6. Bawo ni BLEU ṣe ṣe idiwọ eto kan lati ṣe ere Dimegilio nipa atunwi n-gram igbohunsafẹfẹ giga-giga?
    • O foju kọ gbogbo awọn ọrọ ti o tun sọ
    • O ṣe agekuru oludije kọọkan n-gram kika si kika ti o pọju ninu awọn itọkasi
    • O ka gbolohun akọkọ nikan
    • O jẹ ijiya eyikeyi atunwi si odo
  7. When does BLEU’s brevity penalty reduce a candidate’s score?
    • When the candidate includes a unigram match
    • When the reference contains more than four words
    • When the candidate is shorter than the reference length
    • When the candidate uses a paraphrase
  8. Why does BLEU take a geometric mean across n-gram precisions?
    • It converts precision into a confidence interval
    • It guarantees semantic equivalence
    • It removes the need for reference text
    • A low score at one n-gram order can substantially lower the combined score