Video-based tracking approach for nonverbal synchrony: A comparison of Motion Energy Analysis and OpenPose
Video-based tracking approach for nonverbal synchrony: A comparison of Motion Energy Analysis and OpenPose
复制标题
DOI：
10.3758/s13428-021-01612-7
复制
发表时间：
2021-05-23
影响因子：
5.4
通讯作者：
Yokomitsu, K.
中科院分区：
文献类型：
--
作者：
Fujiwara, K.;Yokomitsu, K.
本研究探讨了两种基于视频的跟踪技术，即运动能量分析和OpenPose，在非语言同步研究的背景下的可比性。年龄在23-69岁之间的参与者与同一代的同性伴侣进行了15分钟的非结构化对话。每个参与者的动作都用两种算法进行量化，然后分别进行小波变换，以评估合作伙伴之间的同步性。小波相干性和相对相位中的信息分别用于测量同步性的强度和模式。作为测试结果的基准，性别效应和与大五人格特质的相关性进行了研究。无论使用的跟踪技术，结果一致说明性别效应：女性二分体比男性二分体表现出更多的同步性。在大五人格特征中，只有外向性与两种跟踪技术的同步性显着相关。即使在控制人格特质的情况下，性别效应在两种跟踪技术中仍然显著，这表明两个人（即，个性）和社会（即，性别）因素有助于同步。最后对视频跟踪技术在同步性研究中的应用进行了讨论。
The present study investigated the comparability of two video-based tracking techniques, namely, Motion Energy Analysis and OpenPose, in the context of nonverbal synchrony research. Participants aged 23-69 years held a 15-min unstructured conversation with a same-gender partner of the same generation. Each participant's movements were quantified with two algorithms, which were separately submitted to a wavelet transform to assess synchrony between the partners. Wavelet coherence and information in the relative phase were used to measure the intensities and patterns of synchrony, respectively. As a benchmark of the test results, gender effects and correlation with the Big Five personality traits were examined. Irrespective of the tracking technique used, the results consistently illustrated gender effects: female dyads showed more synchrony than male dyads. Among the Big Five personality traits, only Extraversion was significantly associated with synchrony in either tracking technique. The gender effect remained significant in both the tracking techniques even when controlling for personality traits, indicating that both individual (i.e., personality) and social (i.e., gender) factors contribute to synchrony. The use of video-tracking techniques in the research on synchrony for future studies was also discussed.