Quiz collegato alla guida · Medio Livello

Reducing LLM App Latency Quiz

Map latency techniques to the stages they affect and check tradeoffs in quality, freshness, reliability, privacy, and cost.

Percorsi guida correlatiRiduzione della latenza dell'app LLM
Domanda 1 di 8

Cosa migliora solitamente lo streaming per un utente?

Anteprima di ogni domanda8 domande

Le risposte e le spiegazioni vengono visualizzate mentre rispondi al quiz.

  1. Cosa migliora solitamente lo streaming per un utente?
    • The model’s factual accuracy automatically
    • How soon partial output becomes visible, not necessarily total completion time
    • The time required to train the model
    • The freshness of cached data
  2. Quando è più appropriata l'esecuzione parallela?
    • When each call depends on the previous result
    • Whenever a request uses a model
    • When failures must be hidden
    • When calls are independent and their results can be combined safely
  3. Cosa può ridurre la memorizzazione nella cache dei prompt del provider?
    • Repeated processing for eligible shared prompt prefixes
    • Every application response’s generation time to zero
    • All output tokens billed by every provider
    • The need for authorization checks
  4. What risk comes with application-level response caching?
    • Increasing model accuracy automatically
    • Making every cache miss faster
    • Returning stale or user-specific content to the wrong request
    • Removing the need for network security
  5. What should be done before routing a task to a smaller model?
    • Assume smaller models always perform identically
    • Evaluate task-specific quality as well as latency and cost
    • Disable all monitoring
    • Use only training accuracy
  6. Perché le API batch generalmente non sono adatte per una risposta interattiva?
    • They are designed for asynchronous processing windows rather than immediate response
    • They return outputs before receiving requests
    • They always have lower final accuracy
    • They cannot process multiple requests
  7. In che modo un'applicazione dovrebbe ridurre la latenza delle chiamate agli strumenti?
    • Run all calls concurrently regardless of dependency
    • Skip permission checks
    • Cache all results indefinitely
    • Remove unnecessary round trips and parallelize only independent steps
  8. What should a latency optimization experiment monitor?
    • Only average TTFT
    • Only the number of source files
    • Tail latency, failures, quality, and cost on representative traffic
    • Only model size