Ikibazo gihuza ibibazo · Hagati Urwego

Umwanya wa Interpolation kumwanya muremure

Reba uburyo interpolation ihagaze ikuraho imyanya ya RoPE, kuki extrapolation ishobora guhungabanya ibitekerezo nicyo inkomoko yabyo yasuzumye.

Ikibazo 1 Bya 8

Ni ikihe gitekerezo cyibanze inyuma ya Interpolation?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ni ikihe gitekerezo cyibanze inyuma ya Interpolation?
    • Gufata imyanya mishya yerekana urwego icyitegererezo cyari kimaze gutozwa
    • Guhugura icyitegererezo gishya kuva cyera kuri buri burebure
    • Kuraho amakuru yumwanya rwose
    • Gutondekanya ibimenyetso byingirakamaro
  2. Ni ukubera iki naive extrapolation kumwanya muremure byananirana?
    • Ikoresha kwibuka cyane
    • Irashobora guhanagura amanota yibitekerezo binini cyane, bidahinduka
    • Buri gihe isubiza ikimenyetso kimwe
    • Irasaba ibimenyetso bitandukanye
  3. Nkanswe kangahe-gutunganya neza akazi ka mbere PI yasabye kwagura LLaMA kugeza 32K?
    • Nta gutunganya neza na gato
    • Intambwe zigera kuri miliyoni
    • Intambwe zigera ku 1.000
    • Kwiruka byuzuye
  4. Niba waguye imiterere kubintu s, nigute PI ihindura umwanya m?
    • Ikarita m kugeza m inshuro s
    • Ikarita m kugeza m kare
    • Irasiga m idahindutse
    • Ikarita m kugeza m igabanijwe na s
  5. Nigute PI yagize ingaruka muburyo bwanyuma nka YaRN?
    • Byahindutse ibyingenzi uburyo bwo kumenya inshuro byakosowe
    • Yarahebwe kandi ntiyigeze itangwa
    • Yasimbuye ubwubatsi bwa Transformer
    • Irakoreshwa gusa kumashusho yerekana
  6. Nuwuhe mwanya uhuza imyanya Interpolation yibanze cyane cyane?
    • Kode imwe ishyushye
    • RoPE (Ibirindiro byerekana umwanya)
    • Ijambo2
    • Umufuka-w-amagambo ubara
  7. A model trained to position 2K tokens is extended to 32K using PI. What is the extension factor s?
    • 2
    • 8
    • 16
    • 32
  8. With extension factor s = 16, where does PI map original position m = 16,000?
    • Position 16,000
    • Position 256,000
    • Position 32,000
    • Position 1,000