Test legat de ghid · Mediu Nivel
Time to First Token and Latency Metrics Quiz
Distinguish TTFT, inter-token latency, end-to-end latency, throughput, and tail percentiles, then compare serving performance under similar workloads.
Întrebare 1 de 8
Test legat de ghid · Mediu Nivel
Distinguish TTFT, inter-token latency, end-to-end latency, throughput, and tail percentiles, then compare serving performance under similar workloads.