Ikibazo gihuza ibibazo · Hagati Urwego

Byte-Pair Encoding Ikibazo

Ongera usubiremo BPE guhuza, gutangira ibimenyetso, byte gukwirakwiza, inkomoko yo kwikuramo, gutondekanya kodegisi, ibice-byamagambo adasanzwe, amagambo yimibare, na UTF-8 decoding.

Inzira zijyanye no kuyoboraByte Byombi
Ikibazo 1 Bya 8

Iki gikorwa cy'ibimenyetso bikurikirana gikorerwa inshuro nyinshi mu kwiga amagambo ya BPE rusange?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Iki gikorwa cy'ibimenyetso bikurikirana gikorerwa inshuro nyinshi mu kwiga amagambo ya BPE rusange?
    • Deleting all low-frequency words from the language
    • Merging a most-frequent pair into a larger symbol
    • Sorting complete documents by title
    • Selecting pairs solely by their alphabetical spelling
  2. BPE ifata iki inyandiko nkigihe itangiye imyitozo?
    • Interuro zose
    • Gukosora 8-token
    • Inyuguti kugiti cye cyangwa bytes
    • Imvugo yabanje guhindurwa
  3. Mu miterere ya BPE ishingiye kuri byite ihagarariye agaciro ka byite 256 by'isoko, uko inyandiko ya UTF-8 idasanzwe ishobora guhagararirwa?
    • Through its constituent bytes when larger pieces are unavailable
    • By storing every possible complete word in the finite vocabulary
    • By requiring the input to be translated into English first
    • By assigning every unseen character one shared unknown ID
  4. Algorithm ya BPE yaturutse he mbere yuko NLP ibyemeza?
    • Guhagarika amashusho
    • Kode y'amajwi
    • Kwerekana Ububikoshingiro
    • Guhagarika amakuru
  5. Iyo umushakamagambo wa BPE wa GPT-2 washyizwe ahagaruka ubonye ibice byinshi bikurikirana byemewe, ni iki kigenzura ihitamo ry'ihuza?
    • A new random vocabulary fit on that one input
    • The text file's creation date
    • The priorities in the learned merge ranks
    • The order of a human-written list of target meanings
  6. What can happen when an unfamiliar word lacks larger learned BPE pieces?
    • It must be replaced by an unrelated synonym
    • It remains represented by several smaller available pieces
    • It necessarily becomes one new learned token during inference
    • It is always silently removed from the input
  7. An illustrative BPE vocabulary has 256 base byte tokens, two distinct added merge tokens, and one separate special token. What is its total size?
    • 256
    • 258
    • 512
    • 259
  8. In GPT-2's published decoder, what is reconstructed before converting the result from UTF-8 into text?
    • The complete byte sequence represented by the token pieces
    • An independent Unicode character from every individual token first
    • A new corpus-frequency table for training merges
    • The model's output-label probabilities