Guide-yakabatana mibvunzo · Zvakaoma Nhanho

Harucination Kuona Nzira Quiz

Inoedza kuzvimiririra sampling, nhanho-yepamusoro kubatanidza kune masosi, kusavimbika masaini semantic entropy, uye inosimbisa mutongi modhi.

Nzira dzekutungamira dzinoenderanaNzira dzekuona dzekunyepa
Mubvunzo 1 ye 8

Ndechipi chekutarisa chiri pasi pemaitiro ekuzvimiririra seSelfCheckGPT?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. Ndechipi chekutarisa chiri pasi pemaitiro ekuzvimiririra seSelfCheckGPT?
    • When a model knows a fact, repeated samples tend to agree, while fabricated details tend to vary
    • Models always give identical answers to repeated questions
    • Longer answers are always more accurate
    • Setting temperature to zero removes all hallucinations
  2. Ndechipi chinodzikisira chakakosha chekuzviongorora wega?
    • It requires a large labeled dataset before use
    • It works only on image outputs
    • It misses errors the model repeats consistently, and it costs extra model calls
    • It cannot run without retrieved source documents
  3. Ko source-grounded etailment checks inoyera chii chaizvo?
    • Iyo modhi yekupedzisira yekudzidziswa zuva
    • Faithfulness to the provided sources, which is not the same as truth if the sources are wrong
    • How quickly the model responds
    • Grammar and spelling quality
  4. Ko semantic entropy inosiyana sei kubva nyore token-level kusavimbika?
    • It counts the number of words in each answer
    • It relies only on human raters
    • It avoids sampling multiple answers
    • It groups sampled answers by meaning before measuring uncertainty
  5. Sei gwara richikurudzira kuti verifier itore nguva yekutsigira?
    • Inoita kuti zvinobuda zvive zvipfupi
    • It makes verification auditable, and a simple string match confirms the quote appears in the source
    • It makes the verifier more creative
    • It reduces verification cost to zero
  6. Which checks should run first in a detection pipeline?
    • Cheap deterministic checks, such as confirming that cited URLs, IDs or case numbers exist
    • Full human review of every answer
    • Fine-tuning the model on the flagged answers
    • Semantic entropy on every token
  7. What caveat applies to using an LLM as a judge?
    • Judges cannot read source documents
    • Judges work only in English
    • Judges are always correct
    • Judges have their own biases and error rates, so they should be checked against human labels
  8. Why is simply asking a model 'are you sure?' an unreliable detection method?
    • Models cannot read follow-up questions
    • It is prohibited by API terms
    • Models may abandon correct answers or defend wrong ones
    • Iyo inopeta kaviri saizi yehwindo remukati