引導式測驗 · 中等 等級

Autoscaling Model Inference on Kubernetes Quiz

Configure model-serving autoscaling signals and account for GPU scheduling, model startup delays, queues and scale-to-zero tradeoffs.

相關引導路徑Autoscaling Model Inference Kubernetes
問題 1 的 8

Which signal may represent inference pressure better than CPU alone?