গাইড লিঙ্ক ক্যুইজ · মাঝারি স্তর
Gender Bias in Language Models Quiz
Tests how gender associations appear in embeddings, translation, coreference and simulated hiring, while keeping results scoped to specific studies.
প্রশ্ন 1 এর 8
What did the 2024 EMNLP employment-recommendation study vary across its candidate prompts?
প্রতিটি প্রশ্নের পূর্বরূপ দেখুন8 প্রশ্ন
আপনি কুইজ নেওয়ার সাথে সাথে উত্তর এবং ব্যাখ্যাগুলি উপস্থিত হয়।
- What did the 2024 EMNLP employment-recommendation study vary across its candidate prompts?
- First names signaling race and gender while qualifications were held comparable
- Only candidates’ university grades
- Only the model’s temperature
- Different job descriptions with no candidate information
- Which two models did that study test?
- Only GPT-4o
- BERT and ELIZA
- GPT-3.5-Turbo and Llama 3-70B-Instruct
- Whisper and DeepSpeech
- What limitation should readers keep in mind about the study’s name-based findings?
- It measured only real-world job offers
- The prompt signals combined race and gender, and simulated recommendations do not prove deployed employer behavior
- It tested every hiring system used worldwide
- It included no names
- What does the WinoBias benchmark evaluate?
- Translation quality for numbers
- Speech-recognition accuracy by accent
- Coreference errors on stereotypical and anti-stereotypical occupation sentences
- Age-estimation error in faces
- How can machine translation introduce a gendered assumption?
- It always translates every noun into a verb
- It can add a gendered pronoun when the source language does not specify gender
- এটি সমস্ত বিরাম চিহ্ন মুছে দেয়
- It converts spoken words into images
- Why can removing every gender association from an embedding be problematic?
- It makes word vectors impossible to store
- It guarantees model bias increases
- It removes all occupations from a vocabulary
- Some gender information is relevant to meaning or identity and cannot be cleanly separated from stereotypes
- Which evaluation design best tests whether a gender cue changes a recommendation?
- Test one output from one model
- Compare unrelated people in different jobs
- Change gender, education, salary and occupation together
- Hold qualifications and task constant while varying the cue in repeated prompts
- What does a lower stereotype score on one benchmark establish?
- Only performance on that benchmark and setup, not fairness across every product use
- That translation quality is perfect
- আইনি সম্মতির গ্যারান্টি
- That all gender bias has been removed