引导式测验 · 硬 等级
Estimating GPU Memory Needed for LLMs Quiz
Estimate LLM memory from weights, training state, activations and KV cache, and identify how context, batch and precision change the budget.
问题 1 的 8
引导式测验 · 硬 等级
Estimate LLM memory from weights, training state, activations and KV cache, and identify how context, batch and precision change the budget.