引導式測驗 · 硬 等級

緩存增強生成 (CAG) 測驗

測試您對快取增強生成的理解:如何預先載入和重複使用 KV 快取、查詢之間的快取重置以及語料庫大小限制。

相關引導路徑快取增強生成
問題 1 的 8

CAG 使用什麼來代替按查詢檢索?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. CAG 使用什麼來代替按查詢檢索?
    • A keyword search engine
    • Fine-tuning the model on the documents
    • A new vector index per question
    • Preloading the whole knowledge base into the KV cache once and reusing it
  2. Transformer 中的 KV 快取是什麼?
    • A database of user accounts
    • The stored attention keys and values computed for tokens the model has already read
    • A list of document URLs
    • The model's trained weights
  3. 為什麼 CAG 系統在每次回答後都會截斷快取?
    • To save the answer for training
    • To delete the documents permanently
    • To restore the documents-only state so the next query does not see the previous question and answer
    • To switch to a different model
  4. CAG 的主要限制是什麼?
    • The entire corpus must fit in the model's context window
    • It requires a vector database
    • It cannot answer questions quickly
    • 它改變了模型的權重
  5. 為什麼 CAG 的答覆速度比將文件貼到每個請求中更快?
    • It skips generating output tokens
    • The model only needs to compute the new question tokens on top of the cached prefix
    • 它使用較小的模型
    • It retrieves fewer documents
  6. Which knowledge base is the best fit for CAG?
    • A news archive updated every hour
    • Millions of customer records with per-user permissions
    • An entire web crawl
    • A small, stable product manual that rarely changes
  7. Which statement about CAG is a misconception?
    • CAG removes retrieval errors because all documents are present
    • Changing documents requires rebuilding the cache
    • CAG fine-tunes the model's weights on the documents
    • Hosted prompt caching is related to the idea
  8. Which techniques reduce the memory needed for a large KV cache?
    • Grouped-query attention and cache quantization
    • 添加更多關注頭
    • Using longer prompts
    • 提高採樣溫度