Vowel priority lip matching scheme and similarity evaluation model based on humanoid robot Ren-Xin
Vowel priority lip matching scheme and similarity evaluation model based on humanoid robot Ren-Xin
复制标题
DOI：
10.1007/s12652-020-02175-9
复制
发表时间：
2020-06-11
影响因子：
--
通讯作者：
Ren, Fuji
中科院分区：
文献类型：
--
作者：
Liu, Zheng;Kang, Xin;Ren, Fuji
目前，仿人机器人的重要性急剧增加，而这类机器人由于发展不成熟，很少进入人类生活。类人机器人的嘴唇形状在语音过程中至关重要，因为它使类人机器人看起来像真实的人类。许多研究表明，元音是世界上所有语言的基本发音要素。在传统的视位研究基础上，增加了唇音在元音间平滑过渡的优先级，提出了一种基于元音优先级的唇音匹配方案。此外，本文还利用计算机视觉唇特征设计了一种基于曼哈顿距离的相似度评价模型，量化了0-1之间的唇形相似度，为评价标准的推荐提供了有效的方法。令人惊讶的是，该模型成功地弥补了该领域中唇形相似性评价标准的缺点。我们将此唇型匹配方案应用于人-心仿人机器人，进行了机器人教学实验，以及两男两女与机器人的20个句子的相似度比较实验。值得注意的是，所有的实验都取得了很好的结果。
At present, the significance of humanoid robots dramatically increased while this kind of robots rarely enters human life because of its immature development. The lip shape of humanoid robots is crucial in the speech process since it makes humanoid robots look like real humans. Many studies show that vowels are the essential elements of pronunciation in all languages in the world. Based on the traditional research of viseme, we increased the priority of the smooth transition of lip between vowels and propose a lip matching scheme based on vowel priority. Additionally, we also designed a similarity evaluation model based on the Manhattan distance by using computer vision lip features, which quantifies the lip shape similarity between 0-1 provides an effective recommendation of evaluation standard. Surprisingly, this model successfully compensates the disadvantages of lip shape similarity evaluation criteria in this field. We applied this lip-matching scheme to Ren-Xin humanoid robot and performed robot teaching experiments as well as a similarity comparison experiment of 20 sentences with two males and two females and the robot. Notably, all the experiments have achieved excellent results.