AI Glossary Nguva

Chii chinonzi Flash Attention (Kutarisa Kwemheni)?

Tsanangudzo

Iyo yakagadziridzwa yekutarisisa algorithm iyo inoderedza ndangariro kushandiswa uye inomhanyisa kudzidzisa kwekushandura uye kufungidzira.

Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori

Mashoko anoenderana

Chitoro cheZvimiroIyo inogadziriswa sisitimu yekuchengetedza uye kushumira yakasimbiswa ML maficha nguva dzose yekudzidziswa uye inference.Kudzokera kumashureIyo yakakosha kudzidziswa algorithm inogadziridza maremu emhando nekuparadzira zvikanganiso zvekufungidzira kumashure kuburikidza netiweki.Kuderedzwa kweModel (Model Quantization)Kuderedza kurongeka kwenhamba yezviyereso zvemuenzaniso kuderedza ndangariro uye mutengo wekufungidzira.Transformer (Shanduri)A neural architecture inoshandisa kutarisisa kuenzanisi hukama kune dzakatevedzana dzakafanana.Kurasikirwa KwekudzidziraIyo modhi yekukanganisa kukosha yakaverengerwa panguva yekudzidziswa uye yakagadziridzwa pasi nekufamba kwenguva.Multi-Musoro AttentionTransformer mashandiro ayo anomhanyisa akati wandei maitiro anoenderana kubata akasiyana marudzi ehukama.

Dzidza zvakawanda mumadhairekitori edu emahara

Attention Rollout and Head PruningSequence Parallelism and Ring AttentionMulti-Head Latent AttentionRWKV Linear Attention

Onawo

QLoRADPO (Direct Preference Optimization)Positional EncodingTree of ThoughtsRoPE (Rotary Positional Embeddings)ReActALiBiAgentic Loop