引導式測驗 · 中等 等級
情境學習測驗
查看提示演示、固定模型權重、歸納頭研究限制、示例順序效應以及少樣本學習的上下文預算。
問題 1 的 8
在情境學習過程中模型內部發生了什麼根本變化?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 在情境學習過程中模型內部發生了什麼根本變化?
- 模型的權重透過幾個梯度步驟更新
- 一個小型適配器層在範例上進行訓練
- 模型永久記住新任務
- 權重沒有變化;僅提示控制輸出
- 在真正的問題被呼叫之前,包含幾個工作範例的提示:
- 零射擊提示
- 少鏡頭提示
- 微調
- 強化學習
- GPT-3 報告中少樣本效能隨規模提升的發現,確立了什麼?
- A universal rule that all models below one hundred billion parameters cannot use examples
- A requirement for internet access during every prompt
- An observed trend for the evaluated models and tasks
- A separate emergency training phase
- 歸納頭研究應如何與廣泛的情境學習聯繫起來?
- As evidence about a studied mechanism, with limitations on broader conclusions
- As proof that every task uses only one circuit
- As a permanent database of every demonstration
- As a replacement for all task evaluation
- 應用程式應如何比較重複的少樣本提示與微調?
- Assume fine-tuning is always the least expensive choice
- Measure task quality and the relevant training, request, and maintenance costs
- Assume adding unlimited prompt examples has no cost
- Decide solely by which approach has the longer name
- 一個少樣本票務提示詞僅展示了退款和帳單標籤。這些範例為下一張票提供了什麼?
- An automatic update to the model's stored weights
- A guarantee that every next ticket fits one of the labels
- A permanent change to all future conversations
- An in-prompt task and label pattern that can guide classification
- Why might the same few-shot classification examples produce different results after reordering?
- The model can be sensitive to the order of examples in its context
- Reordering automatically retrains every parameter
- The label texts must disappear
- The model's vocabulary changes with each permutation
- What resource tradeoff arises when more demonstrations are added to an in-context prompt?
- They use no input tokens because they are examples
- They make the context limit disappear
- They consume more supported context and per-request processing
- They permanently reduce the model's parameter count