Kuiz berkaitan panduan · Sederhana Tahap
Kuiz Konteks Panjang lwn RAG
Bandingkan konteks panjang dan RAG pada kos, kependaman, ketepatan dan kesegaran, termasuk kesan hilang-di-tengah dan reka bentuk hibrid.
soalan 1 daripada 8
Mengapakah pendekatan konteks panjang biasanya lebih mahal setiap pertanyaan berbanding RAG?
Pratonton setiap soalan8 soalan
Jawapan dan penjelasan muncul semasa anda mengambil kuiz.
- Mengapakah pendekatan konteks panjang biasanya lebih mahal setiap pertanyaan berbanding RAG?
- Providers charge per input token, and long context sends far more tokens
- Long-context models require a vector database
- RAG is always free
- Long context requires fine-tuning for each question
- Apakah yang didapati oleh kajian Lost in the Middle 2023?
- Models ignore the first sentence of every prompt
- Retrieval always beats long context
- Performance dropped when relevant information was placed in the middle of long inputs
- Context windows cannot exceed 4,000 tokens
- Apakah batasan utama ujian mencari jarum dalamas tumpukan jerami?
- Mereka hanya berfungsi pada imej
- They measure simple lookup, not reasoning across many scattered facts
- They cannot be run on long inputs
- They measure cost, not accuracy
- Situasi manakah yang paling jelas menyebelahi RAG berbanding konteks panjang?
- A single short policy document queried a few times
- Summarizing the themes of one novel
- Comparing two chapters of one report
- A large, frequently changing corpus with per-user access permissions
- Apabila menggunakan pengecosan gesaan dengan korpus yang panjang, bagaimanakah gesaan itu harus disusun?
- Put the question first and the corpus last
- Shuffle the corpus on each request
- Put the stable corpus first and the variable question last
- Split the corpus across separate requests
- Why does time to first token increase with context length?
- The model must process every input token before it starts answering
- Longer prompts are sent over slower networks
- The model retrieves documents from the internet
- Output tokens are generated in parallel
- Which task is long context particularly well suited to?
- Searching millions of support articles
- Serving users with different clearance levels
- Answering from data that changes every hour
- Summarizing themes across an entire document
- What does a common hybrid of long context and RAG look like?
- Using RAG only for images and long context only for text
- Retrieving relevant documents generously, then including whole documents in a long window
- Fine-tuning the model on the retrieved chunks
- Alternating approaches on odd and even days