Kuiz berkaitan panduan · Sederhana Tahap

Inferens Model Penskalaan Auto pada Kubernetes Kuiz

Konfigurasikan isyarat autoscaling penyajian model dan akaun untuk penjadualan GPU, kelewatan permulaan model, baris gilir dan pertukaran skala-ke-sifar.

Laluan panduan yang berkaitanInferens Model Penskalaan Auto Kubernetes
soalan 1 daripada 8

Which signal may represent inference pressure better than CPU alone?

Pratonton setiap soalan8 soalan

Jawapan dan penjelasan muncul semasa anda mengambil kuiz.

  1. Which signal may represent inference pressure better than CPU alone?
    • Queue depth or request age
    • The model's training accuracy
    • The number of YAML files
    • The checkpoint's creation date
  2. Why can a GPU pod remain pending after HPA requests more replicas?
    • HPA automatically adds physical GPUs
    • No node may have available GPU capacity matching the pod request
    • The model has no output signature
    • Queue depth is always zero
  3. What can a large model's cold start include?
    • A training data label join
    • Only a request counter update
    • Image and weight download plus model initialization
    • A decrease in node capacity
  4. What can scaling an inference workload to zero trade for idle cost savings?
    • No need for readiness checks
    • Higher GPU memory at all times
    • Guaranteed zero queueing
    • Lower idle cost but potentially longer first-request latency
  5. What does KEDA commonly add to Kubernetes scaling?
    • A GPU driver in each pod
    • Event-source or external-metric triggers for workloads
    • Model calibration metrics
    • A replacement for container images
  6. Why configure stabilization windows or scale policies?
    • To remove GPU resource requests
    • To force every pod to load identical model weights
    • To reduce oscillation and abrupt replica changes
    • To guarantee low latency
  7. What should readiness indicate for a model-serving pod?
    • The cluster has no queued work
    • The container process has merely started
    • The training pipeline is complete
    • The model has loaded and the pod can handle requests
  8. Why set a maximum replica or GPU limit?
    • To bound cost and respect hardware quota
    • To guarantee capacity during all traffic spikes
    • To prevent any scale-up
    • To change model prediction values