Baatu Glossaire IA

Luy Dekodage spekulatif?

Maanaam

Benn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Term yu ci méngoo

Facturation basée sur l'utilisation
Njëgg fu njëg yi di méngoo ak woote API yi, jeton yi, diiru inference bi, wala xayma yiñ jëfandikoo.
Palanteer buy gliise
Modèlu attention boo xamni token bu nekk dafay bàyyi xel ci palanteer bu yam ci token yi ci wetam ngir wàññi calcul bi.
Inférens
Faasu runtime bi model buñ tàggat di defar ay prediction wala ay output.
RAG (Generation buñ yokk ngir am)
Benn anam buy jëlee xam-xam bi bawoo ci biti, ba noppi dugal ko ci jamonoy inference.
Top-k jël misaal
Pexem dekodaas buy jël misaal ci k token yi ci topp.
Modèle distilé
Benn model bu gëna ndaw lañu tàggat ngir toppandoo doxalinu model bu gëna mag te ba noppi di jëfandikoo xayma yu néew ci inference.

Nekk leen ci sunuy tegtal yu amul fayda

Contrastive DecodingMinimum Bayes Risk DecodingSpeculative Sampling VerificationSelf-Consistency Decoding

Xoolal itam

Zero Data RetentionKV CacheMCP (Model Context Protocol)Trust CalibrationAgentic LoopTest-Time ComputeReActStructured Output
Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda