AI Glossary Nguva

Chii chinonzi Multi-Musoro Attention?

Tsanangudzo

Transformer mashandiro ayo anomhanyisa akati wandei maitiro anoenderana kubata akasiyana marudzi ehukama.

Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori

Mashoko anoenderana

Transformer (Shanduri)A neural architecture inoshandisa kutarisisa kuenzanisi hukama kune dzakatevedzana dzakafanana.Multi-Query KudzoreredzaNzira yekudzorera iyo inonyora zvakare mubvunzo wemushandisi mumisiyano yakati wandei kuti uvandudze kurangarira.Kutarisisa MechanismChikamu chemodhini chinotarisa zvine simba pazvikamu zvinoenderana zvechipo kana uchigadzira zvinobuda.Flash Attention (Kutarisa Kwemheni)Iyo yakagadziridzwa yekutarisisa algorithm iyo inoderedza ndangariro kushandiswa uye inomhanyisa kudzidzisa kwekushandura uye kufungidzira.Muenzaniso weMultimodalModhi inogona kugadzirisa kana kugadzira akawanda emhando dzedata senge zvinyorwa, mufananidzo, uye odhiyo.Ruzivo GirafuChimiro chegirafu chemasangano uye hukama hunoshandiswa kufunga kana kudzoreredza.

Dzidza zvakawanda mumadhairekitori edu emahara

Multilingual LLMsMultimodal SearchHard Parameter Sharing in Multi-Task NetworksAttention Rollout and Head Pruning

Onawo

Positional EncodingQLoRARoPE (Rotary Positional Embeddings)DPO (Direct Preference Optimization)ALiBiTree of ThoughtsSliding Window AttentionReAct