Research on the non-uttering human interface between multiplelanguages using lips movements

我们发现，不仅在不同说话人之间，而且在同一说话人在不同时间或不同日期的说话人之间，通过嘴唇运动进行单词识别都具有稳健性。此外，我们还展示了嘴唇运动对铁路站名识别的有效性。此外，无论是以英语为母语的人还是日本人说，都有可能识别相同的英语单词。我们还开发了一个可以自动执行的系统，从发出单词时获取嘴唇动作到识别发出的单词，并展示了不同语言的非发声人机界面的可行性。

We found robustness of word recognition by lip movement without audible utterance, not only between the words of different speakers but also between the utterances of the same speaker at different times or on different days. Furthermore, we showed the effectiveness of lip movement for the recognition of the railway station names. Moreover, no matter whether a native English speaker or Japanese person spoke, recognition of the same English word was possible. We also developed a system which can beautomatically performed, from acquisition of lip movements when uttering the word to recognition of the uttered word, and showed the feasibility of the non-uttering human interface in various languages.