गाइड से जुड़ी प्रश्नोत्तरी · मध्यम स्तर

Autoscaling Model Inference on Kubernetes Quiz

Configure model-serving autoscaling signals and account for GPU scheduling, model startup delays, queues and scale-to-zero tradeoffs.

संबंधित मार्गदर्शक पथAutoscaling Model Inference Kubernetes
प्रश्न 1 का 8

Which signal may represent inference pressure better than CPU alone?