Research of Daily Conversation Transmitting System Based on Mouth Part Pattern Recognition
Research of Daily Conversation Transmitting System Based on Mouth Part Pattern Recognition
复制标题
基于口部模式识别的日常对话传输系统研究
DOI：
10.1541/ieejeiss.124.680
复制
发表时间：
2004
影响因子：
--
通讯作者：
N. Nishi
中科院分区：
文献类型：
--
作者：
Mutsumi Watanabe;N. Nishi
作者正在开发一种通过识别用户面部表情和动作的基于视觉的强度转移技术，以帮助在说话、识别小字体、用手和手指操作键盘方面有困难的老年人或残疾人自由方便地进行交流。在本文中，我们报告了一个原型系统，其中通过使用用户面前的相机图像序列识别用户口部形状的转变，依次选择分层的日常对话。该系统使用了四种口型。本文提出了一种通过分析口腔周围区域的强度直方图数据来自动识别这些模式的方法。通过强度直方图数据的时间变化来检测嘴的张开和闭合运动，从而对途中的选择进行确认。该方法已通过vc++程序安装在台式PC机上。25人的口型模式识别实验结果表明了该方法的有效性。
The authors are developing a vision-based intension transfer technique by recognizing user’s face expressions and movements, to help free and convenient communications with aged or disabled persons who find difficulties in talking, discriminating small character prints and operating keyboards by hands and fingers. In this paper we report a prototype system, where layered daily conversations are successively selected by recognizing the transition in shape of user’s mouth parts using camera image sequences settled in front of the user. Four mouth part patterns are used in the system. A method that automatically recognizes these patterns by analyzing the intensity histogram data around the mouth region is newly developed. The confirmation of a selection on the way is executed by detecting the open and shut movements of mouth through the temporal change in intensity histogram data. The method has been installed in a desktop PC by VC++ programs. Experimental results of mouth shape pattern recognition by twenty-five persons have shown the effectiveness of the method.