Kvíz spojený s průvodcem · Střední úroveň

Kvíz s koncovými body modelu zátěžového testování

Naplánujte si realistické testy zátěže koncových bodů pomocí vzorů příchodů, reprezentativních vstupů, percentilů latence, měření zdrojů a bezpečných ovládacích prvků testů.

Otázka 1 z 8

Which metric set gives a broader view of model endpoint capacity than average latency alone?

Náhled každé otázky8 otázky

Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.

  1. Which metric set gives a broader view of model endpoint capacity than average latency alone?
    • Training accuracy and validation loss
    • Mean request size and model parameter count
    • Throughput, latency percentiles, errors, and resource use
    • Source-file count and deployment age
  2. How can a closed-loop virtual-user test hide overload?
    • It creates an unlimited arrival rate regardless of response time
    • Waiting users reduce their request rate as responses slow
    • It records only successful requests
    • It applies a fixed arrival rate independent of user behavior
  3. Why include several payload sizes in a model endpoint test?
    • Payload length determines the endpoint license
    • All tensor shapes require identical compute and memory
    • Large payloads cannot be tested safely
    • Input dimensions or sequence lengths can change compute and memory
  4. What distinguishes a soak test from a brief load test?
    • It measures only startup latency before any request
    • It repeats one request until its response is cached
    • It runs long enough to reveal gradual degradation such as leaks
    • It varies model architecture while keeping duration brief
  5. Why test cold and warm serving paths separately?
    • Cold requests always have lower latency than warm ones
    • Warm requests bypass the model and use a different API
    • Startup and model loading can add latency beyond steady inference
    • Cold and warm requests differ only in labels
  6. What can make a load generator provide misleading results?
    • Recording latency makes the generator invalid
    • The generator can saturate on CPU, network, or serialization before reaching target load
    • Python scenarios cannot generate concurrent requests
    • A load generator cannot affect measured throughput
  7. Why define stop conditions and monitor dependent services during a stress test?
    • Stop conditions guarantee that the endpoint cannot fail
    • Monitoring dependencies removes them from the test
    • Stress traffic should be bounded to avoid affecting other systems
    • A stress test should disable all infrastructure metrics
  8. What does Locust provide for a load test?
    • Python-defined scenarios with throughput, response-time, and error reporting
    • An automatic proof that production capacity will be sufficient
    • A pretrained model that serves predictions
    • A guarantee that the generator has unlimited capacity