ガイド連動クイズ · 中 レベル

Tokenization Disparities Across Languages Quiz

Tests why tokenizers split some languages into more tokens, how that affects cost and context windows, and how to audit and reduce the gap.