Best-of-N Sampling and Reranking Quiz

Answers and explanations appear as you take the quiz.

1. What is the core idea of best-of-N sampling?
   • Generate N candidate outputs and pick the best one with a scorer
   • Train the model N times and average the weights
   • Use only the first output the model produces
   • Reduce the vocabulary to N tokens
2. When is best-of-N most likely to help?
   • When every output is equally good
   • When the model sometimes samples a correct candidate and a reliable verifier can identify it
   • When the task has no way to assess candidates
   • When sampling is disabled
3. What largely determines whether best-of-N actually improves results?
   • The color of the user interface
   • The length of the prompt only
   • The quality and robustness of the scorer or verifier
   • The model's vocabulary size
4. What can happen when N becomes large and the reward model is an imperfect proxy?
   • The model’s tokenizer is removed
   • The model forgets its training weights
   • All candidates become identical
   • Selection can favor outputs that exploit scorer errors and reduce true quality
5. Which simple reranking strategy is also known as self-consistency?
   • Majority voting among sampled answers
   • Picking the longest answer
   • Choosing a random sample
   • Always taking the lowest-probability output
6. What mainly drives the generation cost of best-of-N?
   • Only the number of vocabulary entries
   • The total amount of text generated across the sampled candidates
   • The user interface color
   • The number of model training runs
7. If each independent sample succeeds with probability p and a perfect verifier picks any success, what is the chance at least one of N samples succeeds?
   • p/N
   • N−p
   • 1−(1−p)^N
   • 1−p^N
8. Which assumption is needed for the simple 1−(1−p)^N success formula?
   • Every response has a different length
   • The model is retrained after each sample
   • The reward model has no parameters
   • The candidate samples are independent and the verifier recognizes success perfectly