quiz bu lëkkale ak tegtal · Diggante Niveau
interpolaasioŋ posisioŋ ngir laaj ak tontu bu gudd
Saytu ni interpolaasioŋ positionel di delloosi position RoPE, lu tax extrapolaasioŋ mën na dindi bàyyi xel ak limu jëlee ci jàngat bi.
Laaj 1 de 8
Lan mooy xalaat bu mag bi ci ginaaw interpolaasioŋ positionel?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- Lan mooy xalaat bu mag bi ci ginaaw interpolaasioŋ positionel?
- Dajale indices position yu bees ci rang bi model bi jota tàggat
- Taggat xeetu model bu bees ci noonu ngir guddaay bu nekk
- Dindi lépp lu jëm ci position
- Tànnal jeton yi ci solo
- Lu tax extrapolation bu yomb ci position yu gëna gudd du am njariñ?
- Dafay jëfandikoo memory bu néew lool
- Mën na yokk poñ yi ñuy joxe ci attention ba ci valeur yu rëy lool te duñu stabil
- Saa yu nekk dafay delloo benn token bi
- Dafay laaj beneen tokenizer
- Lu tollu ci ban fine-tuning la liggéeyu PI bi njëkk soxla ngir yokk LLaMA ba 32K?
- Amul benn ajustement
- Lu tollu ci 1 milioŋ ciy jéego
- Lu tollu ci 1000 jéego
- Dawal bu mat sëkk
- Soo yokke contexte ci facteur s, naka la PI di soppi position m?
- Dafay màndargaal m ba m yoon s
- Dafay méngale m ak m kaare
- Dafay bàyyi m te du soppiku
- Dafay màndargaal m ak m xaaj s
- naka la PI amee njeexital ci yeneen xeeti xam-xam yu melni YaRN?
- Nekkoon na royuwaay bi pexe xam-xam frequency gëna suqali
- Dañu ko bàyyi, musu ñu ci wax
- Dafa wecci tabax Transformer
- Dafay wax ci modelu nataal yi kese
- Ban kodage position la interpolaasioŋ positionel di njëkka xool?
- Kodage yu tàng
- RoPE (Position Rotaire)
- Vecteur Word2Vec
- Sac-de-mots
- A model trained to position 2K tokens is extended to 32K using PI. What is the extension factor s?
- 2
- 8
- 16
- 32
- With extension factor s = 16, where does PI map original position m = 16,000?
- Position 16,000
- Position 256,000
- Position 32,000
- Position 1,000