Computer-Using Agents Quiz

Answers and explanations appear as you take the quiz.

1. How does a computer-using agent primarily interact with software?
   • By viewing the screen and producing clicks, typing, and scrolling
   • By editing the program's source code
   • By sending email to developers
   • By only using voice commands
2. What is the main advantage of operating at the pixel-and-keystroke level?
   • It is always faster than an API
   • It can use software that has no programmatic interface
   • It never makes mistakes
   • It requires no model at all
3. What does the agent receive to decide its next action?
   • A printed manual
   • The user's bank password
   • A fresh screenshot of the display
   • A list of every file on disk
4. Which of these is a real example of a computer-using agent product?
   • A spreadsheet macro from 1995
   • A static website
   • A USB cable
   • Anthropic's Claude computer use
5. Why are computer-using agents often run in sandboxed environments?
   • Because giving an agent control of a machine raises safety concerns
   • To make them slower on purpose
   • Because sandboxes add more pixels
   • Because it is legally required everywhere
6. What is a common reliability challenge for these agents?
   • Too few keyboards
   • Clicks landing on the wrong element due to imperfect visual grounding
   • Having no screen at all
   • Running only on paper
7. What can an accessibility tree provide in addition to a screenshot?
   • A guarantee that every click will succeed
   • The application’s source code and private database
   • Structured UI element roles, labels, and properties that can help identify controls
   • A record of the model’s hidden reasoning
8. What does the OSWorld benchmark ask computer-use agents to do?
   • Only classify static screenshots
   • Generate source code without interacting with a computer
   • Answer questions about a single pre-rendered webpage
   • Complete open-ended tasks in real desktop and web applications within an operating-system environment