गाइड से जुड़ी प्रश्नोत्तरी · मध्यम स्तर

Tail Latency in Model Serving Quiz

Interpret p95 and p99 latency and evaluate batching, queueing, timeouts and hedging without creating additional load or duplicate side effects.