Luy dagg? Tekki | AI Understanding

Maanaam

Dindi poid model wala neuron yu gëna néew solo ngir wàññi dayo bi ak xayma.

Term yu ci méngoo

Palanteer buy gliise

Modèlu attention boo xamni token bu nekk dafay bàyyi xel ci palanteer bu yam ci token yi ci wetam ngir wàññi calcul bi.

Yoon ci eskalaasioŋ

Relasioŋ empirik buy wane ni performance di yokke ak dayo model bi, done yi wala ordinatër yi.

Modèle distilé

Benn model bu gëna ndaw lañu tàggat ngir toppandoo doxalinu model bu gëna mag te ba noppi di jëfandikoo xayma yu néew ci inference.

Tasaaro ci ginaaw

Algorithm bi gëna am solo biy yeesal diisaayu model bi ci tasaare njuumti yiñ wax luy waaja am ci reso bi.

jumtukaayi liggéey yiñ soxla ngir tàggat ak doxal ay model, ñu koy faral di natt ci waxtu FLOPS wala GPU.

Vecteur buy wane ba ñaata la parametre bu nekk wara soppi ngir wàññi perte.

Nekk leen ci sunuy tegtal yu amul fayda

Attention Rollout and Head Pruning Structured Pruning and Layer Dropping Model Pruning

Xoolal itam

Prompt Injection Quantization Prompt Engineering RAG (Retrieval-Augmented Generation)Prompt Recall Pretraining Recommendation System

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda