Jàng Xibaar Jumtukaay yi Liggéey yi Sunu yitte

Baatu Glossaire IA

Lan mooy Inférens?

Maanaam

Faasu runtime bi model buñ tàggat di defar ay prediction wala ay output.

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda

Njàngat bu mujjAb interfaasu API buñ dugal buy jot ay laaj model ba noppi di delloosi liñu waxoon ci liggéey bi.Nit-ci-ci-LoopLiggéeyukaay bu nit ñi di xoolaat, tegtal wala soppi li IA di génne.IA bu sàrtu ndayu réewXeetu tàggat ak yamale jeffin, fu ay xeeti génnekaay di doxalee ci ay njàngale yuñ bind.Modèle distiléBenn model bu gëna ndaw lañu tàggat ngir toppandoo doxalinu model bu gëna mag te ba noppi di jëfandikoo xayma yu néew ci inference.Facturation basée sur l'utilisationNjëgg fu njëg yi di méngoo ak woote API yi, jeton yi, diiru inference bi, wala xayma yiñ jëfandikoo.Dekodage spekulatifBenn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Nekk leen ci sunuy tegtal yu amul fayda

AI Inference AI Inference Optimization LLM Inference Routing and Load Balancing Seldon Core and Inference Graphs

Xoolal itam

In-Context Learning Inference-Time Compute Hyperparameter Instruction Tuning Intent Classification Hallucination Jailbreak Guardrails