Research of Emotion and Intention Understanding Based on Human Action Analysis and Its Application to Man-machine Communication

点击翻译按钮获取中文摘要

In order to realize symbiotic machines with human beings, we studied a communication method focusing on body action habits and the inside emotion, based on data mining, image recognition, speech recognition and emotion information processing.1 Studies on rule discovery from motion data and quality analysis of emotion (Uehara)It is difficult to retrieve the motion data unless the human action is organized or structured in terms of their contents when the large amount of motion data is stored like digital archives. To solve this problem, motion data is presented as motion locus in the three-dimensional space, and the motion speed and the posture are analyzed. Through this analysis, we compared the motion skills and discovered the features of high degree of skills. Using the action data captured by the motion capture system Eva, we extracted the intrinsic features of the respective motion and the distinguished features compared with other motions.2 Intention understanding by integrating human action, emotion, speech and image recognition (Ariki, Kumano)It is possible to analyze intentions in terms of how it is expressed with action, speech, image and emotion through the studies of action, speech, image and emotion integration. From this point, we especially analyzed the intention based on the action and emotion. For example, when a user asks by speaking who is he and by pointing his face displayed on the large screen in the room like a classroom, the system integrates the speech recognition, pointing action and face recognition. We also analyzed the emotion to estimate the intention.