Guide-linked quiz · Medium Level

Bias in Content Moderation Algorithms Quiz

Tests how label bias and dialect variation enter moderation, how false positives differ from false negatives, and why pipeline-level audits matter.

Question 1 of 8

How does a moderation false positive occur?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. How does a moderation false positive occur?
    • Abusive content is correctly removed
    • The model processes a post slowly
    • A user appeals a correct decision
    • Benign content is incorrectly flagged or restricted
  2. What did Sap et al. find in their 2019 study of hate-speech datasets?
    • Every AAE post contained hate speech
    • All platforms removed AAE from their guidelines
    • AAE markers correlated with toxicity labels, and models learned that association in tested data
    • The study evaluated only image classifiers
  3. What was the highest relative labeling difference reported by Sap et al. for AAE tweets in their experiments?
    • Ten times less likely
    • Exactly the same in all datasets
    • The study did not compare labels
    • Up to two times more likely to be labeled offensive
  4. How did dialect priming affect the annotators in the 2019 study?
    • Making annotators aware that text used AAE reduced the chance they labeled it offensive
    • It removed the need for human labels
    • It made every post a violation
    • It increased all toxicity ratings
  5. Why can a keyword-only moderation rule misclassify reclaimed language?
    • It may ignore speaker, context, quotation and intended meaning
    • It always improves recall
    • It uses too many training examples
    • It has no threshold
  6. Which evaluation provides stronger evidence than one overall accuracy number?
    • The number of GPUs used
    • Task-specific false-positive and false-negative rates on representative examples
    • The average length of a post
    • The model vendor’s market share
  7. Which set of stages should an audit include?
    • Only posts removed by moderators
    • Only model training time
    • Score, threshold, human review, enforcement and appeal
    • Only the platform’s public policy title
  8. What should platforms avoid when auditing dialect-related moderation outcomes?
    • Offering an appeal route
    • Treating race or dialect labels as automatic proxies for harmfulness
    • Checking annotator disagreement
    • Testing meaning-matched examples

Keep testing yourself

More quizzes picked for your level.

View all quizzes