Quiz collegato alla guida · Medio Livello
Quiz sui microservizi di inferenza NIM di NVIDIA
Valuta i container NIM, l'integrazione delle API, i requisiti hardware e i controlli di distribuzione per i servizi di inferenza IA self-hosted.
Domanda 1 di 8
What does an NVIDIA NIM container primarily provide?
Anteprima di ogni domanda8 domande
Le risposte e le spiegazioni vengono visualizzate mentre rispondi al quiz.
- What does an NVIDIA NIM container primarily provide?
- A packaged inference service for supported models
- A replacement for the host GPU driver
- Una garanzia di accuratezza del modello
- An automatic data-labeling workflow
- Why check the supported model and hardware requirements before deployment?
- Every container runs every model identically
- Support and memory needs vary by NIM, model and GPU
- API compatibility guarantees sufficient GPU capacity
- The host driver is included in all images
- What should an application verify about a NIM API?
- That every provider has identical semantics
- Only that the URL uses HTTP
- Specific request fields, streaming and error behavior for that NIM
- That model licenses need no review
- Which metric helps assess an LLM NIM serving workload?
- The count of package folders
- Only the image file size
- Training accuracy on old data
- Time to first token and throughput under representative prompts
- Why keep client application logic separated from a NIM endpoint?
- It guarantees all models have the same outputs
- It makes it easier to change serving backends or versions
- It removes authentication needs
- It prevents GPU memory use
- What remains the host's responsibility when running a GPU container?
- The model's response schema only
- The container's model license only
- Compatible driver and GPU runtime configuration
- The app's prompt template
- Why review model and container licensing before deployment?
- A license replaces security scanning
- NIM containers remove all software licenses
- Licensing determines model latency
- Usage conditions may restrict how artifacts can be used or redistributed
- What does a NIM container not provide automatically?
- Governance, evaluation and access-control decisions
- A serving endpoint
- A packaged runtime for supported use
- An API described in its documentation