引導式測驗 · 中等 等級
位元組對編碼測驗
回顧 BPE 合併、起始符號、位元組覆蓋、壓縮起源、排名編碼、罕見單字片段、詞彙算術和 UTF-8 解碼。
問題 1 的 8
常見的 BPE 詞彙訓練中會重複哪些相鄰符號操作?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 常見的 BPE 詞彙訓練中會重複哪些相鄰符號操作?
- Deleting all low-frequency words from the language
- Merging a most-frequent pair into a larger symbol
- Sorting complete documents by title
- Selecting pairs solely by their alphabetical spelling
- BPE 在開始訓練時將文字視為什麼?
- 整個句子
- 固定 8 個代幣區塊
- 單一字元或位元組
- 預翻譯短語
- 在涵蓋所有 256 個基本位元組值的位元組級 BPE 配置中,如何表示不熟悉的有效 UTF-8 文字?
- Through its constituent bytes when larger pieces are unavailable
- By storing every possible complete word in the finite vocabulary
- By requiring the input to be translated into English first
- By assigning every unseen character one shared unknown ID
- 在 NLP 採用 BPE 演算法之前,它最初來自哪裡?
- 影像壓縮
- 音訊編碼
- 資料庫索引
- 資料壓縮
- 當 GPT-2 發布的 BPE 編碼器找到多個符合條件的相鄰對時,什麼決定了其合併選擇?
- A new random vocabulary fit on that one input
- The text file's creation date
- The priorities in the learned merge ranks
- The order of a human-written list of target meanings
- What can happen when an unfamiliar word lacks larger learned BPE pieces?
- It must be replaced by an unrelated synonym
- It remains represented by several smaller available pieces
- It necessarily becomes one new learned token during inference
- It is always silently removed from the input
- An illustrative BPE vocabulary has 256 base byte tokens, two distinct added merge tokens, and one separate special token. What is its total size?
- 256
- 258
- 512
- 259
- In GPT-2's published decoder, what is reconstructed before converting the result from UTF-8 into text?
- The complete byte sequence represented by the token pieces
- An independent Unicode character from every individual token first
- A new corpus-frequency table for training merges
- The model's output-label probabilities