What is Quantization? Definition | AI Understanding

Maanaam

Soppi diisaayu model ci formaa yu gëna ndaw yu melni 8-bit wala 4-bit.

Term yu ci méngoo

Model Kantifikaasioŋ

Wàññi njubteg lim ci diisaayu model ngir wàññi njëgu mémoire ak inference.

Pexem ajustement bu boole 4-bit ak adaptëru LoRA ngir wàññi bëg-bëgu mémoire.

Tasaaro ci ginaaw

Algorithm bi gëna am solo biy yeesal diisaayu model bi ci tasaare njuumti yiñ wax luy waaja am ci reso bi.

Reseau neuronal convolutionnel (CNN)

Architecture neuronal buñ jagleel ngir mëna jëfandikoo ay done yu nuru griy yu melni nataal.

Extraction de fonctionnement

Soppi done yu bees yi ci man-mani joxe leeral yu benn model mëna jëfandikoo.

Sistem IA yiy defar ëmbiit yu bees yu melni mbind, nataal, audio, wideo wala kod.

Nekk leen ci sunuy tegtal yu amul fayda

Residual Vector Quantization SmoothQuant and Activation Quantization GPTQ and AWQ Post-Training Quantization Quantization

Xoolal itam

Pruning RAG (Retrieval-Augmented Generation)Prompt Injection Recall Prompt Engineering Recommendation System Prompt Red Teaming

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda