Kedis ku xidhan hagaha · Dhexdhexaad Heerka

Dhexdhexaadinta Mawqifka ah ee Kediska Macnaha Dheeraadka ah

Waxay hubisaa sida is-dhexgalka boosku uu u cabbiro boosaska RoPE, sababta ka-saarista ka-saarku u wiiqi karto dareenka iyo waxa isha laga soo xigtay.

Wadooyinka haga ee la xidhiidhaDhexgalka Mawqifka ah ee Mawduuca Dheer
Su'aal 1 ee 8

Waa maxay fikradda asaasiga ah ee ka dambeysa Interpolation Positional?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. Waa maxay fikradda asaasiga ah ee ka dambeysa Interpolation Positional?
    • Ku tuujin tusmooyinka booska cusub ee kala duwanaanshaha moodeelka horay loogu tababaray
    • Tababar nooc cusub oo xoq ah dherer kasta
    • Meesha laga saarayo gabi ahaan macluumaadka booska
    • Astaamaha lagu kala saarayo muhiimada
  2. Waa maxay sababta ka-baxsanaanta naive-ka ee jagooyinka dhaadheer u guul-darreysato?
    • Waxay isticmaashaa xusuusta aad u yar
    • Waxay u qarxin kartaa dhibcaha dareenka qiyam aad u weyn, oo aan degganayn
    • Had iyo jeer waxay soo celisaa calaamad isku mid ah
    • Waxay u baahan tahay calaamad kale
  3. Qiyaastii intee in le'eg hagaajinta hagaajinta ayaa shaqada PI ee asalka ahi u baahnayd in la kordhiyo LLAMA ilaa 32K?
    • Wax hagaajin ah haba yaraatee ma jirto
    • Qiyaastii 1 milyan oo tallaabo
    • Ilaa 1,000 tallaabo
    • Socod tababar ka hor ah oo buuxa
  4. Haddii aad macnaha guud ku kordhiso qodob s, sidee buu PI u beddelaa boos m?
    • Waxay khariidad m to m times s
    • Waxay khariidad m ilaa m afar gees ah
    • Waxay ka baxdaa m aan isbeddelin
    • Waxay khariidad m ilaa m u qaybisaa s
  5. Sidee buu PI u saameeyay hababka dambe sida YaRN?
    • Waxay noqotay aasaaska hababka ogaanshaha soo noqnoqda ay ku horumareen
    • Waa laga tagay oo marna lama soo xigan
    • Waxay beddeshay qaab-dhismeedka Transformer
    • Waxa kaliya oo ay khusaysaa moodooyinka sawirka
  6. Meelkee codaynta ee Positional Interpolation ayaa inta badan bartilmaameedsada?
    • Hal-kulan codayn
    • XAQIIQADA (Ku-xidhnaanta Booska Rotary)
    • Word2Vec vectors
    • Kiishka-ereyada waa la tiriyaa
  7. A model trained to position 2K tokens is extended to 32K using PI. What is the extension factor s?
    • 2
    • 8
    • 16
    • 32
  8. With extension factor s = 16, where does PI map original position m = 16,000?
    • Position 16,000
    • Position 256,000
    • Position 32,000
    • Position 1,000