Positional Interpolation for Long Context Quiz

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

1. Ndeipi pfungwa huru kumashure kwePositional Interpolation?
   • Kudzvanya ma indices ezvinzvimbo mumhando iyo modhi yakanga yatodzidziswa
   • Kudzidzira modhi-itsva kubva pakutanga kwehurefu hwega hwega
   • Kubvisa positional information zvachose
   • Kuronga tokeni nekukosha
2. Sei naive extrapolation kune nzvimbo refu ichitadza?
   • Inoshandisa ndangariro shoma
   • Inogona kukwidza zvibodzwa zvetarisiro kune zvakakura zvakanyanya, zvisina kugadzikana hunhu
   • Inogara ichidzorera chiratidzo chimwe chete
   • Inoda imwe tokenizer yakasiyana
3. Zvingangoita kuti ingani-ikugadzirisa zvakanaka iyo yekutanga PI basa yaida kuwedzera LLaMA kusvika ku32K?
   • Hapana kunyatsogadzirisa zvachose
   • Inenge miriyoni matanho
   • Anenge 1,000 nhanho
   • A full pretraining run
4. Kana iwe ukawedzera mamiriro nechinhu s, PI inoshandura sei chinzvimbo m?
   • Inoratidza m kusvika m nguva s
   • Inoratidza m kusvika ku m squared
   • Inosiya m isina kuchinjwa
   • Inotara m kusvika m yakapatsanurwa ne s
5. PI yakapesvedzera sei nzira dzakazotevera seYaRN?
   • Yakave iyo yekutanga nzira dzekuziva-frequency dzakagadziridzwa
   • Yakasiiwa uye haina kumbotaurwa
   • Yakatsiva iyo Transformer architecture
   • Inongoshanda kune mifananidzo yemifananidzo
6. Ndeipi chinzvimbo encoding iyo Positional Interpolation inonyanya kunanga?
   • Imwe-inopisa encodings
   • Rope (Rotary Position Embeddings)
   • Word2Vec vectors
   • Bag-of-mazwi kuverenga
7. A model trained to position 2K tokens is extended to 32K using PI. What is the extension factor s?
   • 2
   • 8
   • 16
   • 32
8. With extension factor s = 16, where does PI map original position m = 16,000?
   • Position 16,000
   • Position 256,000
   • Position 32,000
   • Position 1,000