Ikibazo gihuza ibibazo · Biragoye Urwego

Ikibazo cya RWKV

Shakisha irembo ryakira RWKV, kwangirika kwigihe, urufunguzo / agaciro gasubirwamo, guhora-ubunini bwa leta, hamwe na Transformer-isa nuburyo bwo guhugura.

Inzira zijyanye no kuyoboraRwkv Itondekanya
Ikibazo 1 Bya 8

Nuwuhe mutwe wumutwe wa RWKV?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Nuwuhe mutwe wumutwe wa RWKV?
    • Itoza nka Transformer ariko ikora umwanzuro nka RNN
    • Irashobora gutozwa gusa kumashusho
    • Irasaba quadratic urufunguzo-agaciro cache
    • Ntishobora kugereranywa na gato
  2. Inyuguti ziri muri RWKV zisobanura iki?
    • Soma, Andika, Gumana, Kugenzura
    • Kwakira, Ibiro, Urufunguzo, Agaciro
    • Isubiramo, Yagutse, Intangiriro, Vector
    • Ibisanzwe, Uburemere, Ubumenyi, Gutandukana
  3. Nigute RWKV ituma kwibuka bihoraho mugihe cyibisekuru?
    • Mugusiba uburemere bwikitegererezo
    • Kubika ibimenyetso byose kuri disiki
    • Mugutwara akantu gato gahamye-gahishe leta imbere aho kuba cache ikura
    • Mugabanye ibisubizo kubimenyetso icumi
  4. Ni uruhe ruhare uburemere bwangirika (W) bugira?
    • Ishiraho igipimo cyo kwiga
    • Irabara umubare wibimenyetso
    • Ihitamo imvugo isohoka
    • Igenzura uburyo byihuse amakuru ashaje atakaza imbaraga
  5. Ugereranije na softmax kwitabwaho, ni iki umurongo wa RWKV wongeye kwirinda?
    • Quadratic all-jours token kugereranya
    • Gukoresha urufunguzo nindangagaciro
    • Gukenera gushiramo
    • Gukoresha imiyoboro mitsi
  6. Ni ukubera iki RWKV ibereye cyane ibisekuruza bigenda neza?
    • Kuberako igomba kubona ibyinjijwe byose mbere ibisohoka
    • Kuberako buri kimenyetso gishya biterwa gusa nubushize-bunini bwa leta
    • Kuberako idashobora kubyara inyandiko
    • Kuberako ikeneye cluster ya GPU kuri buri kimenyetso
  7. In the guide’s RWKV description, what does the receptance gate control?
    • How many image patches are generated
    • The size of the model vocabulary
    • How much of the accumulated state is read out
    • The amount of GPU memory available
  8. What training property does RWKV retain from Transformers?
    • Full quadratic key-value caching at inference
    • A separate generator and discriminator
    • A fixed top-k token router in every layer
    • Parallelizable training across sequence positions