引導式測驗 · 中等 等級

使用者體驗研究人員人工智慧測驗

在使用者體驗研究中測試人工智慧:合成使用者的限制、檢查引用和密碼本標籤、測量編碼器一致性以及為什麼摘要不是合成的。

問題 1 的 8

合成用戶的核心限制是什麼?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. 合成用戶的核心限制是什麼?
    • 它們運行成本太高
    • They give plausible, averaged answers from training patterns rather than lived experience
    • They can only answer in English
    • They always refuse to answer interview questions
  2. 根據指南合理使用合成使用者是多少?
    • Replacing all usability testing
    • Reporting findings to executives as customer evidence
    • Piloting a discussion guide to find confusing questions
    • Setting product pricing
  3. 為什麼研究人員應該要求人工智慧提供帶有時間戳的逐字引用?
    • So each quote can be checked against the source, since models can misattribute or invent quotes
    • Because timestamps make reports look more professional
    • Because AI cannot summarize without timestamps
    • To shorten the transcripts
  4. Cohen's kappa 在人工智慧輔助標記中衡量什麼?
    • The speed of transcription
    • The number of themes in a dataset
    • The sentiment of each comment
    • Agreement between model labels and human coding, adjusted for chance
  5. 為什麼人工智慧摘要與研究綜合不同?
    • Synthesis weighs evidence, notices contradictions and ties findings to decisions, while summaries can smooth over outliers
    • Summaries are always longer than synthesis
    • Synthesis can only be done on paper
    • 沒有什麼區別
  6. Why can't synthetic users replace usability testing specifically?
    • Usability tests require video cameras
    • They cannot show what people actually do, only generate what someone might say
    • Usability testing is illegal with AI
    • Synthetic users are too critical of designs
  7. When should a codebook for AI tagging be written?
    • After the model finishes tagging
    • Never, because models create their own codes
    • Before the model sees the data, with definitions, examples and counterexamples
    • Only if the dataset is under 100 items
  8. What role do embeddings play in analyzing large feedback sets?
    • They encrypt participant data
    • They record audio
    • They replace the need for a researcher to read feedback
    • They represent text numerically so similar comments can be clustered