VISUALIZATION OF INTERNAL ARTICULATOR DYNAMICS AND ITS INTELLIGIBILITY IN SYNTHETIC AUDIOVISUAL SPEECH
VISUALIZATION OF INTERNAL ARTICULATOR DYNAMICS AND ITS INTELLIGIBILITY IN SYNTHETIC AUDIOVISUAL SPEECH
复制标题
DOI：
--
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
K. Grauwinkel;Britta Dewitt;Sascha Fagel
中科院分区：
文献类型：
--
作者：
K. Grauwinkel;Britta Dewitt;Sascha Fagel
本文介绍了一项研究结果，该研究考察了内部发音机构运动的可视化对合成视听语音清晰度的影响。一个会说话的头由内部的被动和主动发音装置补充。在两个不同的训练课前后进行了知觉对比测试，其中一种显示包括所有的发音关节内部运动，另一种显示不包括舌背高度、舌膜打开/关闭和舌头向前/向后移动的动态。结果表明，视听呈现的再认分数显著高于听觉呈现，两种显示的再认分数没有显著差异。然而，只有当呈现所有额外的运动信息时，训练课才能显著提高视觉和视听语音的清晰度。
This paper presents the result of a study investigating the influence of visualization of internal articulator movements on the intelligibility of synthesized audiovisual speech. A talking head was supplemented by internal passive and active articulators. A comparative perception test before and after two different training lessons was carried out, where one type of display included all internal articulator movements and the other displayed dynamics without tongue dorsum height, velum opening/closing and tongue forward/backward movements. Results show that recognition scores were significantly higher in audiovisual compared to auditory-alone presentation with non-significantly different recognition scores for both kinds of display. However, only when presenting all additional motion information, the training lesson was able to significantly increase the visual-alone and audiovisual speech intelligibility.