Kuiz berkaitan panduan · Keras Tahap

Kuiz Kaedah Pengesanan Halusinasi

Menguji pensampelan ketekalan diri, keperluan peringkat tuntutan terhadap sumber, isyarat ketidakpastian seperti entropi semantik dan model hakim yang mengesahkan.

Laluan panduan yang berkaitanKaedah Pengesanan Halusinasi
soalan 1 daripada 8

What observation underlies self-consistency methods such as SelfCheckGPT?

Pratonton setiap soalan8 soalan

Jawapan dan penjelasan muncul semasa anda mengambil kuiz.

  1. What observation underlies self-consistency methods such as SelfCheckGPT?
    • When a model knows a fact, repeated samples tend to agree, while fabricated details tend to vary
    • Models always give identical answers to repeated questions
    • Longer answers are always more accurate
    • Setting temperature to zero removes all hallucinations
  2. What is a key limitation of self-consistency checking?
    • It requires a large labeled dataset before use
    • It works only on image outputs
    • It misses errors the model repeats consistently, and it costs extra model calls
    • It cannot run without retrieved source documents
  3. What do source-grounded entailment checks actually measure?
    • The model's training cutoff date
    • Faithfulness to the provided sources, which is not the same as truth if the sources are wrong
    • How quickly the model responds
    • Grammar and spelling quality
  4. How does semantic entropy differ from simple token-level uncertainty?
    • It counts the number of words in each answer
    • It relies only on human raters
    • It avoids sampling multiple answers
    • It groups sampled answers by meaning before measuring uncertainty
  5. Why does the guide recommend requiring the verifier to quote the supporting span?
    • Ia menjadikan output lebih pendek
    • It makes verification auditable, and a simple string match confirms the quote appears in the source
    • It makes the verifier more creative
    • It reduces verification cost to zero
  6. Which checks should run first in a detection pipeline?
    • Cheap deterministic checks, such as confirming that cited URLs, IDs or case numbers exist
    • Full human review of every answer
    • Fine-tuning the model on the flagged answers
    • Semantic entropy on every token
  7. What caveat applies to using an LLM as a judge?
    • Judges cannot read source documents
    • Judges work only in English
    • Judges are always correct
    • Judges have their own biases and error rates, so they should be checked against human labels
  8. Why is simply asking a model 'are you sure?' an unreliable detection method?
    • Models cannot read follow-up questions
    • It is prohibited by API terms
    • Models may abandon correct answers or defend wrong ones
    • Ia menggandakan saiz tetingkap konteks