Guide-linked quiz · Hard Level

Model FLOPs Utilization (MFU) Quiz

Calculate and interpret MFU while distinguishing model FLOPs from hardware activity, precision peaks and architecture-dependent accounting.

Related guide pathsModel Flops Utilization Mfu
Question 1 of 8

What does MFU compare?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. What does MFU compare?
    • Measured GPU busy time divided by peak memory bandwidth
    • Model parameter count divided by peak FLOPs
    • Estimated useful model FLOPs per second divided by compatible peak FLOPs per second
    • Kernel time divided by total optimizer-step time
  2. What belongs in the denominator of an MFU calculation?
    • Peak memory bandwidth for the same GPU
    • Theoretical peak FLOPs per second for the relevant precision
    • GPU activity percentage from a system monitor
    • Model FLOPs per token before multiplying by throughput
  3. What can make reported MFU values incomparable?
    • MFU is independent of arithmetic precision
    • Models with equal parameter counts must have equal MFU
    • GPU names determine an identical MFU for every workload
    • Model-FLOP accounting and theoretical-peak conventions can differ
  4. How can a simplified token-throughput estimate form MFU?
    • FLOPs per token times tokens per second, divided by peak FLOPs per second
    • Model FLOPs per token divided by tokens per second
    • Peak FLOPs divided by model work per second
    • Tokens per second divided by peak FLOPs per second
  5. Does 100 percent reported GPU busy time imply 100 percent MFU?
    • Yes, active kernels prove all peak arithmetic is used
    • Yes, memory activity equals tensor compute
    • No; activity can include memory stalls, communication, or work outside the MFU estimate
    • No, because MFU measures model accuracy
  6. Why should published MFU values be treated as context rather than universal targets?
    • MFU is independent of which accelerator is used
    • Model, hardware, precision, and FLOP accounting differ
    • Equal parameter counts imply the same training MFU
    • Published ratios apply unchanged across precision formats
  7. Which pair directly shows useful training work rate and multi-GPU scaling?
    • SM activity and training step time alone
    • Power draw and clock frequency alone
    • Training loss and validation accuracy alone
    • Tokens per second and multi-GPU scaling efficiency
  8. What should be documented for a comparable MFU report?
    • Precision, peak source, FLOP formula, workload, and measurement window
    • Only the accelerator name and product-sheet peak rate
    • Only achieved accuracy and total training time
    • Only step time without token throughput or model-FLOP assumptions

Keep testing yourself

More quizzes picked for your level.

View all quizzes