Ikibazo gihuza ibibazo · Hagati Urwego
Byte-Pair Encoding Ikibazo
Ongera usubiremo BPE guhuza, gutangira ibimenyetso, byte gukwirakwiza, inkomoko yo kwikuramo, gutondekanya kodegisi, ibice-byamagambo adasanzwe, amagambo yimibare, na UTF-8 decoding.
Ikibazo 1 Bya 8
Iki gikorwa cy'ibimenyetso bikurikirana gikorerwa inshuro nyinshi mu kwiga amagambo ya BPE rusange?
Reba buri kibazo8 ibibazo
Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.
- Iki gikorwa cy'ibimenyetso bikurikirana gikorerwa inshuro nyinshi mu kwiga amagambo ya BPE rusange?
- Deleting all low-frequency words from the language
- Merging a most-frequent pair into a larger symbol
- Sorting complete documents by title
- Selecting pairs solely by their alphabetical spelling
- BPE ifata iki inyandiko nkigihe itangiye imyitozo?
- Interuro zose
- Gukosora 8-token
- Inyuguti kugiti cye cyangwa bytes
- Imvugo yabanje guhindurwa
- Mu miterere ya BPE ishingiye kuri byite ihagarariye agaciro ka byite 256 by'isoko, uko inyandiko ya UTF-8 idasanzwe ishobora guhagararirwa?
- Through its constituent bytes when larger pieces are unavailable
- By storing every possible complete word in the finite vocabulary
- By requiring the input to be translated into English first
- By assigning every unseen character one shared unknown ID
- Algorithm ya BPE yaturutse he mbere yuko NLP ibyemeza?
- Guhagarika amashusho
- Kode y'amajwi
- Kwerekana Ububikoshingiro
- Guhagarika amakuru
- Iyo umushakamagambo wa BPE wa GPT-2 washyizwe ahagaruka ubonye ibice byinshi bikurikirana byemewe, ni iki kigenzura ihitamo ry'ihuza?
- A new random vocabulary fit on that one input
- The text file's creation date
- The priorities in the learned merge ranks
- The order of a human-written list of target meanings
- What can happen when an unfamiliar word lacks larger learned BPE pieces?
- It must be replaced by an unrelated synonym
- It remains represented by several smaller available pieces
- It necessarily becomes one new learned token during inference
- It is always silently removed from the input
- An illustrative BPE vocabulary has 256 base byte tokens, two distinct added merge tokens, and one separate special token. What is its total size?
- 256
- 258
- 512
- 259
- In GPT-2's published decoder, what is reconstructed before converting the result from UTF-8 into text?
- The complete byte sequence represented by the token pieces
- An independent Unicode character from every individual token first
- A new corpus-frequency table for training merges
- The model's output-label probabilities