概述
It summarizes a panel’s judgments on a specified scale; the value depends on the stimuli, instructions, listener population, and test conditions, and is not a context-free physical measurement.
深入探讨
ITU-T Recommendation P.800 describes methods for subjective transmission-quality evaluation, including Absolute Category Rating (ACR) and Comparison Category Rating procedures. In ACR, listeners rate samples using a defined opinion scale; MOS is the arithmetic mean of the collected scores for the evaluated set. A score of 5 corresponds to excellent and 1 to bad in the common five-point scale. Scores from different studies should not be treated as directly comparable when their samples, instructions, listeners, playback conditions, or protocols differ. Automatic predictors such as DNSMOS and UTMOS are trained against human ratings and can screen large sets, but prediction quality may weaken out of domain, such as for unseen speakers, listeners, or systems.
现实世界的实施
Using an Absolute Category Rating test to collect independent quality ratings for speech samples
Comparing codec outputs within a controlled listening session and reporting protocol details
Estimating uncertainty in a panel average by reporting score distributions or confidence intervals
Using an automatic MOS predictor for screening while validating important results with human ratings
平均意见评分评估的未来
Evaluation research pairs objective predictors with listening panels and studies how well predictors generalize across speakers, systems, domains, and instructions. Near the top of a bounded rating scale, ceiling effects can compress differences, but the degree depends on the study. Strong reports include protocol details and uncertainty rather than presenting one MOS value as an absolute ranking.
付诸实践
为什么这很重要
- 交通与覆盖范围. 它通过转录、旁白和语音界面提高了可访问性。
- 成本与预算. 媒体团队可以用更少的预算更快地交付精美的音频。
- 速度与规模. 面向客户的系统可以处理更大规模的语音交互。
留意
- 如果未征得同意，语音滥用和冒充风险就会增加。
- 由于口音、方言或嘈杂的环境，准确性可能会下降。
- 如果没有明确的标签，合成音频可能会被误认为是真实的语音。
后续步骤
- 获得语音捕获、克隆和重用的明确同意。
- 测试不同扬声器和背景条件下的质量。
- 定义人员必须审查或批准输出的时间。
- 标记合成音频并保留来源记录以供问责。
不断探索
常见问题
What is Mean Opinion Score Evaluation?
Mean Opinion Score (MOS) is an average of subjective listener ratings collected under a defined test protocol. It summarizes a panel’s judgments on a specified scale; the value depends on the stimuli, instructions, listener population, and test conditions, and is not a context-free physical measurement.
在标准量表中，平均意见得分 5 代表什么？
在标准国际电联五点绝对类别评级量表中，5 表示优秀，1 表示差。
Why do MOS studies collect ratings from multiple listeners?
Multiple listeners let researchers estimate an average and its variability; the precision depends on the panel size and study design.
哪个组织标准化了原始 MOS 音频质量方法？
国际电信联盟在 P.800 建议书中定义了 MOS 测试，最初用于电话语音质量。
比较两项独立研究的 MOS 值的主要限制是什么？
由于评分取决于特定样本、锚点和听众池，因此无法可靠地比较不同会话的绝对 MOS 数。
DNSMOS 或 UTMOS 等自动 MOS 预测器可以解决什么问题？
经过人类评分训练的预测 MOS 模型会自动估计分数，让团队在最终的人类评估之前以较低的成本筛选许多样本。