Changes in fundamental frequency and gesture of response corresponding to the understanding level of partner’s talk

Changes in fundamental frequency and gesture of response corresponding to the understanding level of partner’s talk
复制标题

与对方谈话的理解程度相对应的基频和反应姿势的变化

DOI:
10.1109/iicaiet.2018.8638457
复制
发表时间:
2018
期刊:
2018 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET)
影响因子:
--
通讯作者:
Nakatoh Yoshihisa
Nakatoh Yoshihisa
中科院分区:
--
文献类型:
--
作者:
Natsumi Kana;Saitoh Yuya;Wakita Yumi;Nakatoh Yoshihisa

文献摘要

相似文献

本研究探讨了一个系统,估计在驾驶能力下降的程度,在老年人使用非语言信息,从日常对话。为了建立这一系统,有必要找到有效的因素来估计在日常生活中已经达到有问题的水平的下降程度。在本文中,我们考虑的情况下,老年人不能理解的合作伙伴的谈话,他们的听力和集中能力下降,我们分析的合作伙伴的谈话的理解程度之间的关系和非言语特征的响应话语。根据分析结果,当一个人能够理解他们的伙伴的谈话时的响应场景的响应话语的基频(F0)值和帧差图像的亮度值倾向于高于当他/她不理解谈话时的响应场景的响应话语的基频(F0)值和帧差图像的亮度值。这些结果表明,语音的F0值和帧差图像的亮度值是评估听力和注意力下降的重要因素。
This study explores a system that estimates the degree of decline in driving ability in elderly people using nonverbal information from daily conversations. To create this system, it is necessary to find factors that are effective for estimating the degree of decline that has reached a problematic level in daily life. In this paper, we consider the case where elderly people cannot understand the partner's talk as their hearing and concentration abilities drop, and we analyze the relation between the degree of understanding of the partner's talk and the nonverbal characteristic of the response utterance. According to the analysis results, both fundamental frequency (F0) values of response utterance and brightness values of the frame difference image for a response scene when a person can understand their partner's talk tend to be higher than that when he/she does not understand the talk. These results indicate that the F0 value of utterances and brightness values of the frame difference images are important factors to estimate the decline in hearing and concentration abilities.