Guide-linked quiz · Medium Level

Why Chatbots Give Different Answers to the Same Question Quiz

Understand how context, model settings, tools and updates change chatbot responses, and how to verify conflicting claims.

Question 1 of 8

Two new chats receive the same question but different instructions about audience and format. Why may their answers vary?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. Two new chats receive the same question but different instructions about audience and format. Why may their answers vary?
    • The prompt context changes which response is appropriate
    • One response must be false because wording differs
    • The chatbot is guaranteed to browse the web
    • The model uses the same fixed paragraph for every question
  2. A chatbot connected to a company help center gives a different answer after the policy page is updated. Which factor could explain the change?
    • The chatbot necessarily became more accurate
    • The retrieved source material may have changed
    • The user’s device changed the policy
    • The new response proves the earlier page never existed
  3. A user asks the same fact question ten times and receives one answer more often. What has that repetition established?
    • That the majority response is guaranteed accurate
    • That the chatbot consulted ten separate sources
    • A pattern in those outputs, not independent proof that the answer is true
    • That the other answers were intentional lies
  4. What details help another person understand why an answer changed?
    • Only the chatbot’s name
    • The user’s preferred color theme
    • A screenshot that hides the prompt
    • The exact prompt, conversation context, tool setting, date and model version if available
  5. A longer chatbot answer includes more confident details than a shorter one. What should the reader infer?
    • Length and confidence do not establish that its claims are better supported
    • The longer answer is always more accurate
    • The shorter answer must have been truncated
    • Every detail came from a cited source
  6. Why might a repeated prompt not reproduce an answer from last month?
    • Text prompts always expire after thirty days
    • A hosted model, search index, system instruction or connected source may have changed
    • The user must use identical punctuation for any factual question
    • Models cannot use conversation context
  7. Two answers disagree on an important safety instruction. What is the best next step?
    • Choose whichever answer sounds more certain
    • Ask the same chatbot until it repeats one answer
    • Check an authoritative source and treat the disputed chatbot claim as unresolved until verified
    • Average the two instructions
  8. A team wants to test whether a chatbot is stable on one question. Which setup is most useful?
    • Change the prompt each time but compare the wording
    • Use different models and hide their names
    • Count synonyms instead of checking claims
    • Keep the prompt and available context consistent, repeat the test and record changes

Keep testing yourself

More quizzes picked for your level.

View all quizzes