引導式測驗 · 中等 等級

位元組對編碼測驗

回顧 BPE 合併、起始符號、位元組覆蓋、壓縮起源、排名編碼、罕見單字片段、詞彙算術和 UTF-8 解碼。

相關引導路徑位元組對編碼
問題 1 的 8

常見的 BPE 詞彙訓練中會重複哪些相鄰符號操作?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. 常見的 BPE 詞彙訓練中會重複哪些相鄰符號操作?
    • Deleting all low-frequency words from the language
    • Merging a most-frequent pair into a larger symbol
    • Sorting complete documents by title
    • Selecting pairs solely by their alphabetical spelling
  2. BPE 在開始訓練時將文字視為什麼?
    • 整個句子
    • 固定 8 個代幣區塊
    • 單一字元或位元組
    • 預翻譯短語
  3. 在涵蓋所有 256 個基本位元組值的位元組級 BPE 配置中,如何表示不熟悉的有效 UTF-8 文字?
    • Through its constituent bytes when larger pieces are unavailable
    • By storing every possible complete word in the finite vocabulary
    • By requiring the input to be translated into English first
    • By assigning every unseen character one shared unknown ID
  4. 在 NLP 採用 BPE 演算法之前,它最初來自哪裡?
    • 影像壓縮
    • 音訊編碼
    • 資料庫索引
    • 資料壓縮
  5. 當 GPT-2 發布的 BPE 編碼器找到多個符合條件的相鄰對時,什麼決定了其合併選擇?
    • A new random vocabulary fit on that one input
    • The text file's creation date
    • The priorities in the learned merge ranks
    • The order of a human-written list of target meanings
  6. What can happen when an unfamiliar word lacks larger learned BPE pieces?
    • It must be replaced by an unrelated synonym
    • It remains represented by several smaller available pieces
    • It necessarily becomes one new learned token during inference
    • It is always silently removed from the input
  7. An illustrative BPE vocabulary has 256 base byte tokens, two distinct added merge tokens, and one separate special token. What is its total size?
    • 256
    • 258
    • 512
    • 259
  8. In GPT-2's published decoder, what is reconstructed before converting the result from UTF-8 into text?
    • The complete byte sequence represented by the token pieces
    • An independent Unicode character from every individual token first
    • A new corpus-frequency table for training merges
    • The model's output-label probabilities