Baatu Glossaire IA

Lan mooy Flash Fexe?

Maanaam

Algorithme biy wàññi jëfandikoo mémoire bi ba noppi gaawal tàggat transformateur bi ak inference bi.

Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda

Term yu ci méngoo

Màngasin FeaturesSistem buñ yor ngir denc ak joxe man-mani ML yuñ baaxal ci anam wu méngoo ngir tàggat ak jël doggal.Tasaaro ci ginaawAlgorithm bi gëna am solo biy yeesal diisaayu model bi ci tasaare njuumti yiñ wax luy waaja am ci reso bi.Model KantifikaasioŋWàññi njubteg lim ci diisaayu model ngir wàññi njëgu mémoire ak inference.TransformatërArchitecture neuronal buy jëfandikoo bàyyi xel ngir modele diggante yi ci toppalante yi ci paralel.Perte de formationValër njuumte model bi ñu xayma ci diiru tàggat yaram ba noppi ñu gëna wàcci ko ci diir bi.Bopp yu bariBenn mekanismu transformatër buy def ay liggéey yu bari ci paralel ngir jàpp xeeti diggante yu bari.

Nekk leen ci sunuy tegtal yu amul fayda

Attention Rollout and Head PruningSequence Parallelism and Ring AttentionMulti-Head Latent AttentionRWKV Linear Attention

Xoolal itam

QLoRADPO (Direct Preference Optimization)Positional EncodingTree of ThoughtsRoPE (Rotary Positional Embeddings)ReActALiBiAgentic Loop