What is Inference-Time Compute? Definition | AI Understanding

Maanaam

Bariwaayu dooley liggéey bi ñuy jëfandikoo ngir defar tontu bu nekk.

Term yu ci méngoo

Test-Time xayma

Yokkateg xayma yuñ jëfandikoo ci defar tontu ngir gëna baaxal kalite bi wala xalaat bi.

Facturation basée sur l'utilisation

Njëgg fu njëg yi di méngoo ak woote API yi, jeton yi, diiru inference bi, wala xayma yiñ jëfandikoo.

Modèle distilé

Benn model bu gëna ndaw lañu tàggat ngir toppandoo doxalinu model bu gëna mag te ba noppi di jëfandikoo xayma yu néew ci inference.

jumtukaayi liggéey yiñ soxla ngir tàggat ak doxal ay model, ñu koy faral di natt ci waxtu FLOPS wala GPU.

RAG (Generation buñ yokk ngir am)

Benn anam buy jëlee xam-xam bi bawoo ci biti, ba noppi dugal ko ci jamonoy inference.

Njëg yu gëna bari ci diir bi, xayma yi, wala gaawaayu produit bi war ngir defar sistem yi ñu gëna wóor te ñu gëna mëna saytu.

Nekk leen ci sunuy tegtal yu amul fayda

AI Inference Computer Vision Sentiment Analysis Real-Time Voice Agents

Xoolal itam

Inference Instruction Tuning In-Context Learning Intent Classification Hyperparameter Jailbreak Human-in-the-Loop Knowledge Cutoff

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda