Luy Inférens? Tekki | AI Understanding

Maanaam

Faasu runtime bi model buñ tàggat di defar ay prediction wala ay output.

Term yu ci méngoo

Njàngat bu mujj

Ab interfaasu API buñ dugal buy jot ay laaj model ba noppi di delloosi liñu waxoon ci liggéey bi.

Liggéeyukaay bu nit ñi di xoolaat, tegtal wala soppi li IA di génne.

IA bu sàrtu ndayu réew

Xeetu tàggat ak yamale jeffin, fu ay xeeti génnekaay di doxalee ci ay njàngale yuñ bind.

Modèle distilé

Benn model bu gëna ndaw lañu tàggat ngir toppandoo doxalinu model bu gëna mag te ba noppi di jëfandikoo xayma yu néew ci inference.

Facturation basée sur l'utilisation

Njëgg fu njëg yi di méngoo ak woote API yi, jeton yi, diiru inference bi, wala xayma yiñ jëfandikoo.

Dekodage spekulatif

Benn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Nekk leen ci sunuy tegtal yu amul fayda

AI Inference AI Inference Optimization LLM Inference Routing and Load Balancing Seldon Core and Inference Graphs

Xoolal itam

In-Context Learning Inference-Time Compute Hyperparameter Instruction Tuning Intent Classification Hallucination Jailbreak Guardrails

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda