Kuis Suhu dan Pengambilan Sampel

Jawaban dan penjelasan muncul saat Anda mengikuti kuis.

1. Apa pengaruh kenaikan suhu terhadap keluaran model?
   • Menjadikannya lebih deterministik dan berulang
   • Mengubah bobot model secara permanen
   • Menonaktifkan fungsi softmax
   • Menjadikannya lebih acak dan bervariasi, dengan lebih banyak peluang mendapatkan token yang tidak biasa
2. Sebelum pengambilan sampel, skor token mentah (logit) model diubah menjadi probabilitas dengan:
   • Filter k teratas
   • Fungsi softmax
   • Propagasi mundur
   • Tokenizernya
3. What determines the candidate set in top-p sampling, compared with top-k?
   • Top-p always keeps exactly ten tokens
   • Both methods always keep every vocabulary token
   • Top-p uses the smallest leading set reaching a cumulative probability threshold; top-k uses a count
   • Top-k uses a cumulative threshold while top-p uses a fixed count
4. Secara mekanis, apa sebenarnya pengaruh suhu terhadap logit?
   • Bagi setiap logit dengan T sebelum softmax
   • Menambahkan nomor acak ke setiap logit
   • Menghapus log terendah
   • Kalikan probabilitas akhir dengan T
5. For a structured-data task, what does choosing more predictable token selection fail to establish?
   • That a decoding setting was chosen
   • That the generated content is correct or valid
   • That token scores can be compared
   • That a model can produce an output
6. How does greedy decoding choose the next token?
   • It literally divides every logit by zero
   • It uniformly samples every vocabulary token
   • It permanently retrains the model
   • It selects a highest-scoring eligible token rather than sampling
7. Two token logits differ by six before temperature scaling. With positive temperature two, what is their scaled difference?
   • Tiga
   • Twelve
   • Enam
   • Nol
8. For probabilities 0.55, 0.30, 0.10, and 0.05, how many leading tokens does top-p 0.80 keep?
   • Satu
   • Tiga
   • Dua
   • Empat