Kuis terkait panduan · Keras Tingkat
Kuis Decoding Lookahead
Tinjau cabang lookahead, iterasi Jacobi, n-gram yang di-cache, verifikasi target, dan pengorbanan komputasi di balik pengurangan langkah-langkah decoding berurutan.
Pertanyaan 1 dari 8
Apa yang membedakan decoding lookahead dari decoding spekulatif standar?
Pratinjau setiap pertanyaan8 pertanyaan
Jawaban dan penjelasan muncul saat Anda mengikuti kuis.
- Apa yang membedakan decoding lookahead dari decoding spekulatif standar?
- Hal ini memerlukan dua model yang dilatih secara terpisah
- Ia tidak menggunakan rancangan model terpisah — hanya model target itu sendiri
- Ini hanya berfungsi untuk tugas terjemahan
- Ini mengkuantisasi model secara permanen
- Metode numerik manakah yang mendukung decoding lookahead?
- Penurunan gradien
- Transformasi Fourier
- Pengelompokan K-means
- Iterasi Jacobi (titik tetap).
- Apa dua cabang paralel yang berjalan pada setiap langkah?
- Cabang pelatihan dan cabang pengujian
- Encoder dan decoder
- Cabang lookahead dan cabang verifikasi
- Model rancangan dan model target
- Apa yang disimpan di 'n-gram pool'?
- Urutan multi-token yang masuk akal terlihat selama iterasi paralel
- Riwayat obrolan pengguna
- Bobot model
- Masker perhatian
- What supports correctness when lookahead decoding commits a guessed n-gram prefix?
- Using the same model makes every unverified guess correct
- Every candidate in the n-gram pool must be committed
- Verification against the target's greedy predictions or an appropriate distribution-preserving sampling procedure
- A larger window proves the generated statements are true
- What resource tradeoff is important when deploying lookahead decoding on already busy hardware?
- Candidate generation uses no compute or memory
- Additional parallel work may offset the benefit of fewer sequential passes
- Every larger window must lower wall-clock latency
- The target weights are automatically compressed to zero size
- Why should a lookahead candidate remain provisional until target verification?
- Parallel iteration guesses can differ from the target's valid continuation
- Every cached n-gram has already been proven correct by storage alone
- The lookahead branch permanently changes the target weights
- Verification is needed only to determine the output filename
- Does a standard training-free lookahead iteration update the target model's learned weights?
- Yes; each candidate applies a gradient update to every parameter
- Yes; verified n-grams become a new training dataset immediately
- Only the tokenizer's vocabulary is retrained at every step
- No; it changes candidate token states and verifies outputs while keeping the model weights fixed