Measurement and analysis of paralinguistic information and motion for psychotherapy with rich sensibility

点击翻译按钮获取中文摘要

In training programs for psychotherapists, the instructors teach various techniques mainly based on their experience which could be annotated with written language. It is, however, not easy to explain nonlinguistic factors like nodding, prosody, and attitude which may carry emotional information important for sympathy and mutual trust. In this study, we tried to quantify the emotional factors based on the measurement of speech and motion as usable information in the training. We studied three issues: (1) Recording video, speech, and head motion in psychotherapy sessions and archiving them with annotations in the database, (2) Development of tools for data recording and emotional state evaluation, (3) Analysis of speech and nodding data to extract regularity. We collected forty four dialogues which are marvelously large for future studies. We developed a simple, portable recording system and EMO (EMOtional Movement Observation) system for emotional state evaluation.