Proposal of Non-Contact Type Interface of Command Input Using Lip Motion Features
Proposal of Non-Contact Type Interface of Command Input Using Lip Motion Features
复制标题
利用唇部运动特征的非接触式命令输入接口的提案
DOI：
10.1541/ieejeiss.129.1865
复制
发表时间：
2009
影响因子：
--
通讯作者：
M. Nishida
中科院分区：
文献类型：
--
作者：
Yoshiyuki Sato;Y. Kageyama;M. Nishida
唇动特征在识别个体中具有实际用途。因此，开发非接触式接口非常重要。对于使用嘴唇运动功能的界面，应接受命令中的口音和方言等个体差异。在本文中，我们提出了一种方法来识别命令，通过分析三种嘴唇运动特征。它们是唇宽、唇长和宽长比。分析的基础上得到的这些特征的相对值，从主框架和目标框架。所提出的方法有三个步骤。首先，我们提取的嘴唇运动特征的基础上的位置和形状的嘴唇在每帧的人脸图像。第二，标准模式是从每个命令的六个话语的特征中创建的。标准模式能够减少唇部运动特征的相对差异。第三，通过动态编程（DP）匹配计算命令之间的相似性。实验结果表明，该方法能够有效地利用唇动特征构建非接触式命令输入界面。
Lip motion features are of practical use in identifying individuals. It is therefore important to develop non-contact type interface. For the interface using lip motion features, individual differences such as accents and dialects in commands should be accepted. In this paper, we propose a method to identify commands by analyzing three kinds of lip motion features. They are lip width, lip length, and ratio of width and length. The analysis is made on the basis of these features' relative values obtained from the primary and object frame. The proposed method has three steps. First, we extracted the lip motion features on the basis of both positions and shapes of lip in each frame of facial images. Second, standard patterns were created from features of six utterances per command. The standard pattern is able to reduce the relative difference in the lip motion features. Third, similarities among commands were computed by Dynamic-Programming (DP) matching. And then, the command with the largest similarity was selected as the target one.Our experimental results suggest that proposed method is useful to construct the non-contact type interface of command input using lip motion features.