Development of human machine interface by using lip reading technique in noisy circumstances

点击翻译按钮获取中文摘要

The importance of assistant behavior according to the human commands instead of the stand-alone behavior has been recognized in recent years. In such cases, communication methods between human and robots should be considered. The word recognition technique had been developed in several researchers and in calm situation it can be used for practical use. But in noisy circumstances, they are not still applicable and have a number of problems to solve. For word recognition method in noisy circumstances, the lip reading method is investigated in our research. By the lip reading method, additional trainings of user are not required to control robots.In this research, the video images of human speaking are input to the system and the lip shape movements are automatically extracted to provide word recognition parameters. For these automatic extractions of lip shapes of the NTSC video signal rate are realized by hardware realization of the active contour model techniques. For future works, the development of the lip area separation technique from complex background is remained.