Bài kiểm tra có liên kết hướng dẫn · Cứng Cấp độ

Bài kiểm tra phương pháp phát hiện ảo giác

Kiểm tra việc lấy mẫu tự thống nhất, sự kế thừa ở cấp độ yêu cầu đối với các nguồn, các tín hiệu không chắc chắn như entropy ngữ nghĩa và xác thực các mô hình đánh giá.

Đường dẫn hướng dẫn liên quanPhương pháp phát hiện ảo giác
Câu hỏi 1 của 8

What observation underlies self-consistency methods such as SelfCheckGPT?

Xem trước mọi câu hỏi8 câu hỏi

Câu trả lời và giải thích xuất hiện khi bạn làm bài kiểm tra.

  1. What observation underlies self-consistency methods such as SelfCheckGPT?
    • When a model knows a fact, repeated samples tend to agree, while fabricated details tend to vary
    • Models always give identical answers to repeated questions
    • Longer answers are always more accurate
    • Setting temperature to zero removes all hallucinations
  2. What is a key limitation of self-consistency checking?
    • It requires a large labeled dataset before use
    • It works only on image outputs
    • It misses errors the model repeats consistently, and it costs extra model calls
    • It cannot run without retrieved source documents
  3. What do source-grounded entailment checks actually measure?
    • Ngày kết thúc đào tạo của người mẫu
    • Faithfulness to the provided sources, which is not the same as truth if the sources are wrong
    • How quickly the model responds
    • Grammar and spelling quality
  4. How does semantic entropy differ from simple token-level uncertainty?
    • It counts the number of words in each answer
    • It relies only on human raters
    • It avoids sampling multiple answers
    • It groups sampled answers by meaning before measuring uncertainty
  5. Why does the guide recommend requiring the verifier to quote the supporting span?
    • Nó làm cho đầu ra ngắn hơn
    • It makes verification auditable, and a simple string match confirms the quote appears in the source
    • It makes the verifier more creative
    • It reduces verification cost to zero
  6. Which checks should run first in a detection pipeline?
    • Cheap deterministic checks, such as confirming that cited URLs, IDs or case numbers exist
    • Full human review of every answer
    • Fine-tuning the model on the flagged answers
    • Semantic entropy on every token
  7. What caveat applies to using an LLM as a judge?
    • Judges cannot read source documents
    • Judges work only in English
    • Judges are always correct
    • Judges have their own biases and error rates, so they should be checked against human labels
  8. Why is simply asking a model 'are you sure?' an unreliable detection method?
    • Models cannot read follow-up questions
    • It is prohibited by API terms
    • Models may abandon correct answers or defend wrong ones
    • Nó tăng gấp đôi kích thước cửa sổ ngữ cảnh