A Precise Evaluation Method of Prosodic Quality of Non-Native Speakers Using Average Voice and Prosody Substitution
A Precise Evaluation Method of Prosodic Quality of Non-Native Speakers Using Average Voice and Prosody Substitution
复制标题
基于平均语音和韵律替换的非母语者韵律质量精确评价方法
DOI：
10.1109/icalip.2016.7846620
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Akinori Ito
中科院分区：
文献类型：
--
作者：
Hafiyan Prafianto;Takashi Nose;Akinori Ito
我们提出了一种方法来提高人类对非母语人士话语评估的一致性，能够评估口音和节奏等特征。在该方法中，人类评估者通过使用平均语音模型和韵律替换来独立地评估口音和节奏。我们还研究了独立评估这些功能的优势。我们发现，当不独立评估韵律特征时，重音分数会受到节奏好坏的影响，反之亦然。使用传统方法，相同话语的重音分数和节奏分数的相关系数为0.23，使用所提出的方法为-0.026。这也导致不同评估者给出的分数之间存在更大的分歧。使用传统方法，23%的评估者之间的对的节奏得分的评估者间相关性超过0.5，而使用本文提出的方法，67%的对的评估者间相关性超过0.5。
We propose a method to improve the consistency of human evaluation of non-native speaker's utterance, with a capability to evaluate features such as accent and rhythm. In this method, human evaluators evaluate the accent and the rhythm independently by using average voice model and prosody substitution. We also investigated the advantages of evaluating those features independently. We found that, when the prosodic features are not evaluated independently, the accent scores are affected by the goodness of the rhythm and vice versa. The correlation coefficient of the accent score and the rhythm score of identical utterances was 0.23 using the conventional method and -0.026 using the proposed method. This also leads to greater disagreement between the scores given by different evaluators. Using the conventional method, 23% of the pairs between evaluators have their inter-evaluator correlation of the rhythm score more than 0.5, while using this proposed method, 67% of the pairs have the inter-evaluator correlation more than 0.5.