Quiz lié à un guide · Moyen Niveau

Autoscaling Model Inference on Kubernetes Quiz

Configure model-serving autoscaling signals and account for GPU scheduling, model startup delays, queues and scale-to-zero tradeoffs.

Chemins de guidage associésAutoscaling Model Inference Kubernetes
Question 1 de 8

Which signal may represent inference pressure better than CPU alone?