Машинний переклад

Parallel training data pairs source passages with corresponding translations. Incorrect alignment, duplicated material, or mismatched language labels can teach the wrong relationship. Clean the pairs and keep documents together when splitting evaluation data to avoid near-duplicate leakage. Tokenization determines how text becomes model inputs. A tokenizer that handles one writing system efficiently may split another into many more units. Check the length limits in both languages and whether truncation removes the end of either the source or target passage. Automatic metrics make repeated experiments practical. BLEU compares patterns of word sequences with reference translations, but a metric is not a complete judgment of meaning, readability, or suitability for a domain. Evaluation settings and reference choices matter, so record them with the score. Use an error taxonomy alongside metrics: additions, omissions, changed numbers, inconsistent terminology, incorrect negation, and awkward phrasing. Assess each language pair and domain separately. An average across several well-resourced languages can conceal failures in a less-represented language or specialized document type.