Measuring Social Modulation of Gaze in Autism Spectrum Condition With Virtual Reality Interviews
Measuring Social Modulation of Gaze in Autism Spectrum Condition With Virtual Reality Interviews
复制标题
DOI：
10.1109/tnsre.2022.3198933
复制
发表时间：
2022-01-01
影响因子：
4.9
通讯作者：
Cosman, Pamela
中科院分区：
文献类型：
--
作者：
Artiran, Saygin;Ravisankar, Raghav;Cosman, Pamela
二元对话中的凝视行为可以表明积极的倾听和关注。然而，凝视行为不同于在典型的神经社会互动线索中预期的参与，可能被解释为不感兴趣或不注意，这在个人和专业情况下都可能是有问题的。神经分化的个体，比如那些患有自闭症的人，经常表现出广泛的社会交流差异，包括凝视行为。本项目旨在通过使用HTC Vive Pro Eye VR头戴式设备进行虚拟现实（VR）模拟求职面试练习，支持情境社交凝视练习。我们展示了在模拟工作面试中，注视行为在神经发散性和神经典型参与者之间是如何变化的。我们还研究了基于会话角色（说和听）的凝视行为的社会调节。我们的三个主要贡献是：(i)一个全自动分析凝视行为社会调节的系统，该系统使用便携式VR头戴设备，具有新颖的逼真模拟工作面试；（ii）一个信号处理管道，采用卡尔曼滤波和基于时空密度的聚类技术，可以提高头戴设备内置眼动仪的准确性；（iii）第一个研究沉浸式VR领域中神经典型/发散个体凝视行为的社会调节。
Gaze behavior in dyadic conversations can indicate active listening and attention. However, gaze behavior that is different from the engagement expected during neurotypical social interaction cues may be interpreted as uninterested or inattentive, which can be problematic in both personal and professional situations. Neurodivergent individuals, such as those with autism spectrum conditions, often exhibit social communication differences broadly including via gaze behavior. This project aims to support situational social gaze practice through a virtual reality (VR) mock job interview practice using the HTC Vive Pro Eye VR headset. We show how gaze behavior varies in the mock job interview between neurodivergent and neurotypical participants. We also investigate the social modulation of gaze behavior based on conversational role (speaking and listening). Our three main contributions are: (i) a system for fully-automatic analysis of social modulation of gaze behavior using a portable VR headset with a novel realistic mock job interview, (ii) a signal processing pipeline, which employs Kalman filtering and spatial-temporal density-based clustering techniques, that can improve the accuracy of the headset's built-in eye-tracker, and (iii) being the first to investigate social modulation of gaze behavior among neurotypical/divergent individuals in the realm of immersive VR.