Research on recognition and synthetic system of individual characteristic in talk and face expression

为了对与自然花边表情相对应的人类口语和面部进行语音合成，作为获得适合人类交织的拟人化试剂所必需的基本技术，进行了以下研究。建立了三维人脸模型，实现了人脸的自然表情。人脸表情系统是利用FACS(面部动作编码系统)开发的。对日语发音中的口型进行了分类，有效地实现了与合成声音相匹配的自然发音同步，并确定了9种口型就足够了。为了发展用语言信息和非语言信息控制基本频率的技术，并检测话语的基本频率模式，研究了以下两种方法：(1)由于话语的基本频率是可以反向转换的，因此能够在每个人的基本频率上实现唯一的话语。(2)利用基本频率句子变化模式的分裂阶段的思想提出了测量方法，并通过实验验证了方法的有效性。对语音合成系统和人脸动态场景生成系统的基础理论进行了研究。对策略知识的自动学习方法进行了研究，提出了一种考虑时间和效率计划的调度技术和调度的动态修正技术，取得了较好的效果。

To do the voice synthesis of a human spoken language which is corresponded to a natural lace expression and the face as a basic technology necessary for achieving the personifying agent who suited the human interlace, the following research was done.1. The three-dimensional face model to achieve a natural face expression was made. The face expression system was developed by using FACS (Facial Action Coding System). The shape of the mouth in a Japanese utterance was classified to achieve natural rip synchronization matched to a synthetic sound efficiently, and it was confirmed that it was enough in the shape of nine kinds of mouths.2. To develop the technique to control a basic frequency by language information and non-language information, and to examine the basic frequency pattern of the utterance, the following two methods were examined.(1) It turned out to be able to achieve a unique utterance in a basic frequency of everybody because a basic frequency of the utterance was able to be reverse-converted.(2) The measurement method was proposed by using the idea of the break-up phrase of the change pattern in sentences of a basic frequency, and effectiveness was confirmed by the experiment.3. The voice synthesis system and the face dynamic scene generation system of a basic theory because of the delicious synchronization were researched. The automatic study method of the strategy knowledge was researched to hold a dynamic correction technique of the scheduling technique and the schedule which considered time and efficient plans, and the result was achieved.