Kuis terkait panduan · Sedang Tingkat

Kuis Kuantisasi

Tinjau nilai presisi lebih rendah, bobot muatan ideal, pembulatan, kalibrasi GPTQ dan AWQ, kernel, bobot sadar aktivasi, kode affine, dan QAT.

Jalur panduan terkaitKuantisasi
Pertanyaan 1 dari 8

In a weight-focused quantization scheme, what representation property is changed?

Pratinjau setiap pertanyaan8 pertanyaan

Jawaban dan penjelasan muncul saat Anda mengikuti kuis.

  1. In a weight-focused quantization scheme, what representation property is changed?
    • The mandatory number of network layers
    • The identity of every original training document
    • The numerical levels or precision used for selected weights
    • Only the displayed model title
  2. Ignoring metadata and other working memory, what fraction of raw packed-weight bits remains when moving the same weights from 16-bit to 4-bit?
    • The same amount
    • Twice as much
    • One-hundredth in every case
    • One-quarter
  3. Apa kelemahan utama dari kuantisasi agresif?
    • Kesalahan pembulatan dapat mengurangi keakuratan model
    • Model tidak dapat diunduh lagi
    • Ini secara permanen menghapus data pelatihan
    • Itu selalu membuat model lebih lambat
  4. Why do the cited GPTQ and AWQ methods inspect calibration inputs?
    • To guarantee identical performance on every future input
    • To guide their respective weight-quantization choices and error management
    • To translate the vocabulary into another language
    • To add a required number of new transformer layers
  5. Why must runtime speed be measured rather than inferred from a lower weight bitwidth alone?
    • A bitwidth label guarantees an identical speedup on every device
    • All quantized values remove the need for computation
    • Every compressed model must be slower by definition
    • Kernels, hardware, and conversion overhead also affect runtime
  6. What does activation-aware mean in the cited AWQ weight-quantization method?
    • Every activation must be stored at the same low bitwidth as every weight
    • The weights are never quantized
    • Activation observations help choose salient weight scaling
    • The method uses only parameter names without input observations
  7. Using the stated reconstruction rule scale times code minus zero point with subtraction inside, what value comes from code six, scale 0.5, and zero point two?
    • Empat
    • Dua
    • Tiga
    • Enam
  8. How does quantization-aware training differ in timing from post-training quantization?
    • Training incorporates quantization effects so learned values can adapt
    • It is defined as changing only a fitted model after every training stage ends
    • It forbids all training examples
    • It guarantees no rounding or approximation error in any representation