What is Inference Endpoint? Definition | AI Understanding

Maanaam

Ab interfaasu API buñ dugal buy jot ay laaj model ba noppi di delloosi liñu waxoon ci liggéey bi.

Term yu ci méngoo

API (interfaasu prograam aplikaasioŋ)

Benn anam buñ tëral ngir benn sistem losisel mëna yónnee ay laaj ak jot tontu ci beneen sistem.

Faasu runtime bi model buñ tàggat di defar ay prediction wala ay output.

Facturation basée sur l'utilisation

Njëgg fu njëg yi di méngoo ak woote API yi, jeton yi, diiru inference bi, wala xayma yiñ jëfandikoo.

Inference-Waxtu xayma

Bariwaayu dooley liggéey bi ñuy jëfandikoo ngir defar tontu bu nekk.

Benn xeetu xam-xam buy wax luy waaja am jaaraleko ci xaajalug màndarga if-then.

Boole xam-xam yu bawoo ci model yu bari ngir gëna dëgër wala gëna dëggu.

Nekk leen ci sunuy tegtal yu amul fayda

AI Inference AI Inference Optimization LLM Inference Routing and Load Balancing Seldon Core and Inference Graphs

Xoolal itam

Human Preference Model Knowledge Base Guarded Decoding Latent Space Groundedness Model Registry Feature Store On-Device AI

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda