Gids-gekoppelde quiz · Moeilijk Niveau
Hallucinatiedetectiemethoden Quiz
Test zelfconsistentiesteekproeven, claimniveau-conclusies met bronnen, onzekerheidssignalen zoals semantische entropie en validerende beoordelingsmodellen.
Vraag 1 van 8
What observation underlies self-consistency methods such as SelfCheckGPT?
Bekijk elke vraag8 vragen
Antwoorden en uitleg verschijnen terwijl je de quiz doet.
- What observation underlies self-consistency methods such as SelfCheckGPT?
- When a model knows a fact, repeated samples tend to agree, while fabricated details tend to vary
- Models always give identical answers to repeated questions
- Longer answers are always more accurate
- Setting temperature to zero removes all hallucinations
- What is a key limitation of self-consistency checking?
- It requires a large labeled dataset before use
- It works only on image outputs
- It misses errors the model repeats consistently, and it costs extra model calls
- It cannot run without retrieved source documents
- What do source-grounded entailment checks actually measure?
- De sluitingsdatum van de training van het model
- Faithfulness to the provided sources, which is not the same as truth if the sources are wrong
- How quickly the model responds
- Grammar and spelling quality
- How does semantic entropy differ from simple token-level uncertainty?
- It counts the number of words in each answer
- It relies only on human raters
- It avoids sampling multiple answers
- It groups sampled answers by meaning before measuring uncertainty
- Why does the guide recommend requiring the verifier to quote the supporting span?
- Het maakt de output korter
- It makes verification auditable, and a simple string match confirms the quote appears in the source
- It makes the verifier more creative
- It reduces verification cost to zero
- Which checks should run first in a detection pipeline?
- Cheap deterministic checks, such as confirming that cited URLs, IDs or case numbers exist
- Full human review of every answer
- Fine-tuning the model on the flagged answers
- Semantic entropy on every token
- What caveat applies to using an LLM as a judge?
- Judges cannot read source documents
- Judges work only in English
- Judges are always correct
- Judges have their own biases and error rates, so they should be checked against human labels
- Why is simply asking a model 'are you sure?' an unreliable detection method?
- Models cannot read follow-up questions
- It is prohibited by API terms
- Models may abandon correct answers or defend wrong ones
- Het verdubbelt de grootte van het contextvenster