quiz bu lëkkale ak tegtal · Diggante Niveau
Quiz cache bu gaaw
Xoolaat jëfandikoowaat prefix prompt bi furnisër bi yor, yelleefu cache bi, def contexte bu dëgër, coppite ci sàrt yi, ak saytu dencukaay done yi.
Laaj 1 de 8
What can a provider-managed prompt cache let a later request avoid?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- What can a provider-managed prompt cache let a later request avoid?
- Recomputing some work for an eligible repeated prompt prefix
- Running the model on any new user content
- Checking provider-specific cache eligibility
- Applying attention to the uncached part of a request
- Why can a small prompt-prefix change affect cache eligibility?
- Every provider guarantees cache reuse regardless of prompt changes
- Provider-specific matching rules or breakpoints may make the changed prefix ineligible for reuse
- Causal attention prevents any prefix from being reused
- Changing later content always invalidates every earlier prefix
- Ban senaario moo gëna am njariñ ci cache bu gaaw?
- Benn laaj bu benn yoon kese ak ab laaj bu gàtt
- Ab laajte buy soppi baat bu nekk saa yu nekk
- Barina laaj yu ñuy bokk benn sistem bu gudd te nuróo wala këyit
- Defar ay nimero yu bari te amul benn dugal
- How should a team estimate the price effect of a prompt-cache hit?
- Assume every provider discounts cached tokens by 90%
- Assume cache hits are always free
- Use the number of prompt characters alone
- Use the current provider and model pricing for cached versus uncached tokens
- How long does a prompt cache remain available?
- It depends on the provider, model, and cache-retention settings
- Exactly one hour for every provider
- Forever unless a user deletes it
- Exactly five minutes in every API
- How can an OpenAI API client identify how many input tokens were served from cache?
- The number of characters in the system message
- The response usage field input_tokens_details.cached_tokens
- The cache key length
- Limu paramet model yi
- In OpenAI implicit prompt-caching mode, where is a breakpoint placed by default?
- It caches every prompt regardless of length
- It disables prefix matching
- It places a breakpoint at the end of the latest eligible message
- It stores all user prompts permanently
- What should a team check before caching sensitive prompt content?
- Only the color of the API dashboard
- Whether the prompt contains an odd number of tokens
- Whether another provider offers the same discount
- The provider’s retention, data-use, and cache-control terms for the selected model