Baatu Glossaire IA

Lan mooy Dekodage spekulatif?

Maanaam

Benn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda

Term yu ci méngoo

Facturation basée sur l'utilisationNjëgg fu njëg yi di méngoo ak woote API yi, jeton yi, diiru inference bi, wala xayma yiñ jëfandikoo.Palanteer buy gliiseModèlu attention boo xamni token bu nekk dafay bàyyi xel ci palanteer bu yam ci token yi ci wetam ngir wàññi calcul bi.InférensFaasu runtime bi model buñ tàggat di defar ay prediction wala ay output.RAG (Generation buñ yokk ngir am)Benn anam buy jëlee xam-xam bi bawoo ci biti, ba noppi dugal ko ci jamonoy inference.Top-k jël misaalPexem dekodaas buy jël misaal ci k token yi ci topp.Modèle distiléBenn model bu gëna ndaw lañu tàggat ngir toppandoo doxalinu model bu gëna mag te ba noppi di jëfandikoo xayma yu néew ci inference.

Nekk leen ci sunuy tegtal yu amul fayda

Contrastive DecodingMinimum Bayes Risk DecodingSpeculative Sampling VerificationSelf-Consistency Decoding

Xoolal itam

Zero Data RetentionKV CacheMCP (Model Context Protocol)Trust CalibrationAgentic LoopTest-Time ComputeReActStructured Output