引导式测验 · 硬 等级

Collecting Human Preference Data for RLHF Quiz

Understand pairwise preference collection, rater instructions, reward models, PPO, DPO, position bias, and limits of preference labels.

问题 1 的 8

What kind of label does the InstructGPT preference-collection stage record?