引導式測驗 · 硬 等級
緩存增強生成 (CAG) 測驗
測試您對快取增強生成的理解:如何預先載入和重複使用 KV 快取、查詢之間的快取重置以及語料庫大小限制。
問題 1 的 8
CAG 使用什麼來代替按查詢檢索?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- CAG 使用什麼來代替按查詢檢索?
- A keyword search engine
- Fine-tuning the model on the documents
- A new vector index per question
- Preloading the whole knowledge base into the KV cache once and reusing it
- Transformer 中的 KV 快取是什麼?
- A database of user accounts
- The stored attention keys and values computed for tokens the model has already read
- A list of document URLs
- The model's trained weights
- 為什麼 CAG 系統在每次回答後都會截斷快取?
- To save the answer for training
- To delete the documents permanently
- To restore the documents-only state so the next query does not see the previous question and answer
- To switch to a different model
- CAG 的主要限制是什麼?
- The entire corpus must fit in the model's context window
- It requires a vector database
- It cannot answer questions quickly
- 它改變了模型的權重
- 為什麼 CAG 的答覆速度比將文件貼到每個請求中更快?
- It skips generating output tokens
- The model only needs to compute the new question tokens on top of the cached prefix
- 它使用較小的模型
- It retrieves fewer documents
- Which knowledge base is the best fit for CAG?
- A news archive updated every hour
- Millions of customer records with per-user permissions
- An entire web crawl
- A small, stable product manual that rarely changes
- Which statement about CAG is a misconception?
- CAG removes retrieval errors because all documents are present
- Changing documents requires rebuilding the cache
- CAG fine-tunes the model's weights on the documents
- Hosted prompt caching is related to the idea
- Which techniques reduce the memory needed for a large KV cache?
- Grouped-query attention and cache quantization
- 添加更多關注頭
- Using longer prompts
- 提高採樣溫度