Relationship between paralinguistic information and head motion/facial expression

本研究旨在阐明说话风格(包括韵律和音质特征)、副语言信息(如对话行为、意图和情绪)和视觉形式(如头部运动和面部表情)之间的关系。作为主要结果，我们阐明了呼吸/耳语和里奇米声音所承载的副语言功能，阐明了对话行为与头部运动之间的关系，并提出并评价了一个由对话行为产生点头和倾斜头部动作的模型。

The present research aimed on clarifying the relationship between speaking styles including prosodic and voice quality features, paralinguistic information such as dialogue acts, intentions and emotions, and visual modalities like head motion and facial expression. As main results, we clarified the paralinguistic functions carried by breathy/whispery voices and "rikimi" voices, we clarified the relations between dialogue acts and head motion, and proposed and evaluated a model for generating nod and head tilt motion from the dialogue acts.