가이드 연계 퀴즈 · 중간 레벨
Time to First Token and Latency Metrics Quiz
Distinguish TTFT, inter-token latency, end-to-end latency, throughput, and tail percentiles, then compare serving performance under similar workloads.
질문 1 의 8
가이드 연계 퀴즈 · 중간 레벨
Distinguish TTFT, inter-token latency, end-to-end latency, throughput, and tail percentiles, then compare serving performance under similar workloads.