Maswali yanayounganishwa na mwongozo · Kati Kiwango

Maswali ya Kujifunza Katika Muktadha

Kagua maonyesho ya papo hapo, uzani wa kielelezo kisichobadilika, vikomo vya utafiti wa utangulizi, athari za mpangilio wa mifano, na bajeti ya muktadha wa mafunzo machache.

Njia za mwongozo zinazohusianaKatika Kujifunza Muktadha
Swali 1 ya 8

Ni mabadiliko gani ya kimsingi ndani ya modeli wakati wa ujifunzaji wa muktadha?

Hakiki kila swali8 maswali

Majibu na maelezo huonekana unapojibu maswali.

  1. Ni mabadiliko gani ya kimsingi ndani ya modeli wakati wa ujifunzaji wa muktadha?
    • Uzito wa mfano unasasishwa na hatua chache za upinde rangi
    • Safu ndogo ya adapta imefunzwa kwenye mifano
    • Muundo hukariri kazi mpya kabisa
    • Hakuna mabadiliko katika uzani; haraka tu inaongoza pato
  2. Mwongozo unaojumuisha mifano kadhaa iliyofanyiwa kazi kabla ya swali halisi kuitwa:
    • Ushawishi wa sifuri
    • Ushawishi wa risasi chache
    • Urekebishaji mzuri
    • Kujifunza kuimarisha
  3. What does GPT-3's reported improvement in few-shot performance with scale establish?
    • A universal rule that all models below one hundred billion parameters cannot use examples
    • A requirement for internet access during every prompt
    • An observed trend for the evaluated models and tasks
    • A separate emergency training phase
  4. How should induction-head research be related to broad in-context learning?
    • As evidence about a studied mechanism, with limitations on broader conclusions
    • As proof that every task uses only one circuit
    • As a permanent database of every demonstration
    • As a replacement for all task evaluation
  5. How should an application compare repeated few-shot prompting with fine-tuning?
    • Assume fine-tuning is always the least expensive choice
    • Measure task quality and the relevant training, request, and maintenance costs
    • Assume adding unlimited prompt examples has no cost
    • Decide solely by which approach has the longer name
  6. A few-shot ticket prompt demonstrates only refund and billing labels. What do those examples provide for the next ticket?
    • An automatic update to the model's stored weights
    • A guarantee that every next ticket fits one of the labels
    • A permanent change to all future conversations
    • An in-prompt task and label pattern that can guide classification
  7. Why might the same few-shot classification examples produce different results after reordering?
    • The model can be sensitive to the order of examples in its context
    • Reordering automatically retrains every parameter
    • The label texts must disappear
    • The model's vocabulary changes with each permutation
  8. What resource tradeoff arises when more demonstrations are added to an in-context prompt?
    • They use no input tokens because they are examples
    • They make the context limit disappear
    • They consume more supported context and per-request processing
    • They permanently reduce the model's parameter count