引導式測驗 · 中等 等級
使用者體驗研究人員人工智慧測驗
在使用者體驗研究中測試人工智慧:合成使用者的限制、檢查引用和密碼本標籤、測量編碼器一致性以及為什麼摘要不是合成的。
問題 1 的 8
合成用戶的核心限制是什麼?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 合成用戶的核心限制是什麼?
- 它們運行成本太高
- They give plausible, averaged answers from training patterns rather than lived experience
- They can only answer in English
- They always refuse to answer interview questions
- 根據指南合理使用合成使用者是多少?
- Replacing all usability testing
- Reporting findings to executives as customer evidence
- Piloting a discussion guide to find confusing questions
- Setting product pricing
- 為什麼研究人員應該要求人工智慧提供帶有時間戳的逐字引用?
- So each quote can be checked against the source, since models can misattribute or invent quotes
- Because timestamps make reports look more professional
- Because AI cannot summarize without timestamps
- To shorten the transcripts
- Cohen's kappa 在人工智慧輔助標記中衡量什麼?
- The speed of transcription
- The number of themes in a dataset
- The sentiment of each comment
- Agreement between model labels and human coding, adjusted for chance
- 為什麼人工智慧摘要與研究綜合不同?
- Synthesis weighs evidence, notices contradictions and ties findings to decisions, while summaries can smooth over outliers
- Summaries are always longer than synthesis
- Synthesis can only be done on paper
- 沒有什麼區別
- Why can't synthetic users replace usability testing specifically?
- Usability tests require video cameras
- They cannot show what people actually do, only generate what someone might say
- Usability testing is illegal with AI
- Synthetic users are too critical of designs
- When should a codebook for AI tagging be written?
- After the model finishes tagging
- Never, because models create their own codes
- Before the model sees the data, with definitions, examples and counterexamples
- Only if the dataset is under 100 items
- What role do embeddings play in analyzing large feedback sets?
- They encrypt participant data
- They record audio
- They replace the need for a researcher to read feedback
- They represent text numerically so similar comments can be clustered