Guide-yakabatana mibvunzo · Zvakaoma Nhanho

Mamba uye Selective State Spaces Quiz

Ongorora Mamba's yekuisa-inotsamira SSM paramita, yakagadziriswa-saizi mamiriro, mutsara-nguva kutevedzana kugadzirisa, uye hardware-inoziva parallel scan.

Nzira dzekutungamira dzinoenderanaMamba uye Selective State Spaces
Mubvunzo 1 ye 8

Chii chakakosha computational mukana weMamba pamusoro peyakajairwa Transformer?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. Chii chakakosha computational mukana weMamba pamusoro peyakajairwa Transformer?
    • Inoyera zvakatevedzana nehurefu hwekutevedzana pachinzvimbo che quadratically
    • Izvo hazvidi data yekudzidziswa
    • Inoshanda chete pamifananidzo
    • Inobvisa kudiwa kwechero nyika yakavanzika
  2. Ko izwi rekuti 'selective' rinorevei kuMamba?
    • Iyo inosarudza iyo GPU yekumhanya pairi
    • Yayo SSM paramita inotsamira pane yekupinza tokeni, saka inogona kusarudza yekurangarira kana kukanganwa
    • Inosarudza mazita nezviito chete
    • Iyo inotora isina kurongeka subset yematokeni yekufuratira
  3. Ko modhi yemuchadenga inomiririra sei nhoroondo yekutevedzana?
    • Nekuchengeta chiratidzo chega chega chekare zvakajeka
    • Nekudhirowa mepu yekutarisa pane ese maviri maviri
    • Nekumanikidza nhoroondo kuita yakagadziriswa-saizi yakavanzika mamiriro akagadziridzwa nhanho nhanho
    • Harichengeti chero nhoroondo
  4. Sei Mamba isingashandise nzira yekudimbudzira yekukurumidza yakamboshandiswa neSSM?
    • Nekuti convolutions hazvisi pamutemo paGPUs
    • Nekuti haina parameters
    • Nekuti inogadzira tokeni mune zvisina kurongeka
    • Nekuti kugadzira maparamendi anoenderana-anotsamira anotyora iyo nguva-invariance convolutions inoda
  5. Ndeipi nzira inoshandiswa neMamba kuramba yakatsanya kunyangwe yarasa nzira yekudimbudzira?
    • Hardware-aware parallel scan inochengetwa mukukurumidza GPU ndangariro
    • Kumhanya zvachose paCPU
    • Chengetedza zvese token pairs
    • Kusvetuka zvakanyanya kutevedzana
  6. Ndiani akasuma Mamba uye nguvai?
    • OpenAI muna 2018
    • Albert Gu naTri Dao mukupera kwa2023
    • Google muna 2015
    • Hapana, ndezvekufungidzira
  7. Which Mamba state-space parameters are made functions of the current input?
    • Only the fixed transition matrix A
    • The output vocabulary and tokenizer
    • B, C, and the step size delta
    • The attention query and key heads
  8. What do the variable B, C, and delta parameters let Mamba do?
    • Build a growing key-value cache for every token
    • Route each token to an expert network only
    • Replace the state update with full all-pairs attention
    • Choose how much information to let into the state and how much to retain based on the input