Kedis ku xidhan hagaha · Adag Heerka

Kediska Mamba iyo Goobo Dawladeed oo Xul ah

Dib u eeg cabbiraadaha SSM-ku-tiirsanaanta Mamba, gobolka cabbirka go'an, habaynta isku xigxiga-waqtiga toosan, iyo iskaanka barbar socda qalabka-ogyahay.

Wadooyinka haga ee la xidhiidhaMamba Iyo Goobo Dawladeed oo Xul ah
Su'aal 1 ee 8

Waa maxay faa'iidada xisaabinta ugu weyn ee Mamba marka loo eego Transformer-ka caadiga ah?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. Waa maxay faa'iidada xisaabinta ugu weyn ee Mamba marka loo eego Transformer-ka caadiga ah?
    • Waxa ay si toos ah u miisaamaysaa dhererka isku xigxiga halkii ay ka ahaan lahayd afar gees
    • Uma baahna xog tababar
    • Waxay kaliya ku shaqeysaa sawirada
    • Waxay meesha ka saartaa baahida loo qabo xaalad kasta oo qarsoon
  2. Waa maxay macnaha erayga 'door' uga jeedaa Mamba?
    • Waxay doorataa GPU-da uu ku shaqaynayo
    • Xuduudaheeda SSM waxay ku xidhan yihiin calaamada wax galinta, si ay u dooran karto waxa la xasuusan karo ama la iloobo
    • Waxay doorataa magacyo iyo ficillo keliya
    • Waxay soo xushaa qayb hoose oo random ah oo calaamado ah in la iska indho tiro
  3. Sidee buu mooda meel gobolku u taagan yahay taariikhda isku xigxiga?
    • Adigoo si cad u kaydinaya calaamad kasta oo hore
    • Adigoo sawiraya khariidad fiiro gaar ah oo ku saabsan dhammaan lammaanaha
    • Adigoo taariikhda ku cadaadinaya cabbir go'an oo qarsoodi ah oo la cusbooneysiiyay tallaabo tallaabo
    • Wax taariikh ah ma hayso
  4. Waa maxay sababta Mamba u isticmaali la'dahay gaabiyaha convolution-ka ee ay SSM-yadii hore isticmaali jireen?
    • Sababta oo ah iskudhacyadu waa sharci-darro GPU-yada
    • Sababtoo ah ma laha xuduudo
    • Sababtoo ah waxay u socodsiisaa calaamadaha si aan kala sooc lahayn
    • Sababtoo ah samaynta cabbirada ku-tiirsanaanta waxay jebisaa is-rog-rogyada-waqtiga-wareegga waxay u baahan yihiin
  5. Farsamo noocee ah ayay Mamba isticmaashaa si ay u degdegto inkasta oo ay lumisay marin-gaabiyaha isku-dhafka?
    • Sawir isbarbar-bar-bar-bar-bar-kici ah oo qalab-yaqaan ah ayaa lagu hayaa xusuusta GPU-da degdegga ah
    • Ku shaqeeya gebi ahaanba CPU-ga
    • Kaydinta dhammaan lammaanaha calaamada
    • Ka boodista inta badan taxanaha
  6. Yaa soo bandhigay Mamba iyo qiyaas ahaan goorma?
    • OpenAI sanadka 2018
    • Albert Gu iyo Tri Dao dabayaaqadii 2023
    • Google sanadka 2015
    • Qofna, waa mala awaal
  7. Which Mamba state-space parameters are made functions of the current input?
    • Only the fixed transition matrix A
    • The output vocabulary and tokenizer
    • B, C, and the step size delta
    • The attention query and key heads
  8. What do the variable B, C, and delta parameters let Mamba do?
    • Build a growing key-value cache for every token
    • Route each token to an expert network only
    • Replace the state update with full all-pairs attention
    • Choose how much information to let into the state and how much to retain based on the input