Guide-linked quiz · Medium Level
Batch vs Real-Time Inference Quiz
Compare batch, streaming and online inference by freshness, latency, throughput, costs and operations in production ML systems.
Question 1 of 8
Which workload is a natural fit for batch inference?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- Which workload is a natural fit for batch inference?
- Scoring next week's inventory forecasts overnight
- Blocking each payment until a score returns
- Responding to every chat token synchronously
- Updating a decision before a user clicks
- Why use real-time inference for a payment authorization decision?
- It has no latency requirement
- The decision is needed before the transaction proceeds
- It can always be computed the night before
- It avoids all service operation
- What distinguishes streaming inference from a nightly batch job?
- It always returns an HTTP response to a user
- It only runs once per calendar year
- It processes arriving events continuously with bounded delay
- It uses no event ordering
- Which design combines bulk precomputation with fresh request context?
- It removes feature freshness concerns
- It eliminates all model-serving infrastructure
- It guarantees identical rankings for every user
- It combines efficient bulk work with fresh request context
- What contributes to end-to-end real-time latency?
- Only the model's matrix multiplication time
- Network, feature retrieval, preprocessing and postprocessing as well as model execution
- Training dataset size only
- The number of offline evaluation metrics
- Why can a real-time endpoint cost more than a scheduled job?
- Real-time models cannot be quantized
- Batch jobs always require more hardware
- Always-available capacity may sit idle between requests
- Requests have no network overhead
- What should a streaming system handle for late events?
- Static batch partition names only
- Only HTTP status codes
- The model's final training epoch
- Event-time windows, ordering and replay behavior
- Which principle should drive choosing among inference modes?
- Freshness, latency, throughput, cost and operational needs
- Always choose the lowest single-request latency
- Use the most complex infrastructure available
- Pick the mode with the newest model name
Keep testing yourself
More quizzes picked for your level.