AI Glossary Nguva

Chii Multi-Musoro Attention?

Tsanangudzo

Transformer mashandiro ayo anomhanyisa akati wandei maitiro anoenderana kubata akasiyana marudzi ehukama.

Mashoko anoenderana

Transformer
A neural architecture inoshandisa kutarisisa kuenzanisi hukama kune dzakatevedzana dzakafanana.
Multi-Query Kudzoreredza
Nzira yekudzorera iyo inonyora zvakare mubvunzo wemushandisi mumisiyano yakati wandei kuti uvandudze kurangarira.
Kutarisisa Mechanism
Chikamu chemodhini chinotarisa zvine simba pazvikamu zvinoenderana zvechipo kana uchigadzira zvinobuda.
Flash Attention
Iyo yakagadziridzwa yekutarisisa algorithm iyo inoderedza ndangariro kushandiswa uye inomhanyisa kudzidzisa kwekushandura uye kufungidzira.
Multimodal Model
Modhi inogona kugadzirisa kana kugadzira akawanda emhando dzedata senge zvinyorwa, mufananidzo, uye odhiyo.
Ruzivo Girafu
Chimiro chegirafu chemasangano uye hukama hunoshandiswa kufunga kana kudzoreredza.

Dzidza zvakawanda mumadhairekitori edu emahara

Multilingual LLMsMultimodal SearchHard Parameter Sharing in Multi-Task NetworksAttention Rollout and Head Pruning

Onawo

Positional EncodingQLoRARoPE (Rotary Positional Embeddings)DPO (Direct Preference Optimization)ALiBiTree of ThoughtsSliding Window AttentionReAct
Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori