Ikibazo gihuza ibibazo · Hagati Urwego

Ibipimo byo Kubona: Ibuka @ K, MRR na NDCG Ikibazo

Hitamo Kwibuka @ K, MRR, na nDCG ukurikije intego zo kurutonde hamwe nibirango bifatika, hanyuma wumve icyo amanota yo kugarura asize adapimwe.

Inzira zijyanye no kuyoboraIbipimo byo Kugarura Ibuka Mrr Ndcg
Ikibazo 1 Bya 8

Ibuka @ K bipima iki?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ibuka @ K bipima iki?
    • Urwego rwibintu byambere byingenzi
    • Igice cyibintu bizwi byagarutsweho murwego rwo hejuru K ibisubizo
    • Igisekuru cyiza cyibisubizo byanyuma
    • Impuzandengo yubukererwe bwubushakashatsi
  2. Ni ubuhe buryo MRR ishimangira?
    • Umubare rusange wibisubizo bifatika nyuma yurwego K.
    • Urwego rufite agaciro ka buri gisubizo
    • Niba igisubizo cyatanzwe gitanga isoko
    • Nigute hejuru ibisubizo byambere biboneka bigaragara murutonde
  3. Ni ubuhe bwoko bw'urubanza nDCG ishobora gukoresha?
    • Ibyiciro bifatika, hamwe nibintu byo hasi-byagabanijwe
    • Gusa icyitegererezo cyibisohoka token kubara
    • Niba icyifuzo cyarageze
    • Gusa bihuye neza nibirango kubisubizo byatanzwe
  4. Kuki MRR ishobora kuba nziza mugihe abakoresha bakeneye igisubizo kimwe vuba?
    • Ihemba kugarura ibintu byose bijyanye
    • Ipima niba inyandiko zose zashyizwe ku rutonde
    • Ihemba gushyira ikintu cya mbere cyingirakamaro hafi yo hejuru
    • Isuzuma ibisubizo byukuri
  5. Niki Kwibuka @ K yananiwe gutandukanya wenyine?
    • Umubare K yakoresheje
    • Itondekanya ritandukanye ryibintu bifatika biri murwego rwo hejuru K.
    • Niba ibyingenzi bifitanye isano birazwi
    • Inyandiko y'ibibazo
  6. Ni ukubera iki imanza zidafite ishingiro zishobora kugoreka ibipimo byo kugarura?
    • An actually relevant but unjudged result may be treated as nonrelevant
    • Metrics automatically fill in all missing labels
    • Every query has exactly one relevant result
    • Judgments affect only model latency
  7. What should be reported when comparing nDCG implementations?
    • Only the retrieval model name
    • Umubare wa GPU
    • Only the prompt template
    • The gain and discount conventions, cutoff, and aggregation
  8. Does a high retrieval Recall@K prove that a RAG answer is correct?
    • Yes, if K is at least ten
    • Yes, because relevant documents guarantee faithful synthesis
    • No; it measures retrieval coverage, not final answer correctness
    • No, because retrieval cannot be evaluated