가이드 연계 퀴즈 · 하드 레벨
Estimating GPU Memory Needed for LLMs Quiz
Estimate LLM memory from weights, training state, activations and KV cache, and identify how context, batch and precision change the budget.
질문 1 의 8
가이드 연계 퀴즈 · 하드 레벨
Estimate LLM memory from weights, training state, activations and KV cache, and identify how context, batch and precision change the budget.