Combining first-person and third-person gaze for attention recognition
Combining first-person and third-person gaze for attention recognition
复制标题
结合第一人称和第三人称凝视进行注意力识别
DOI：
10.1109/fg.2013.6553735
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
E. Pissaloux
中科院分区：
文献类型：
--
作者：
Francis Martínez;Andrea Carbone;E. Pissaloux
提出了一种基于头戴式双目眼动仪的三元交互中注意行为识别方法。通过利用第一人称视角，我们同时估计第一人称和第三人称凝视。使用依赖于局部特征的基于外观的方法来计算第一人称注视。并行地，头部姿态跟踪允许确定场景相机中的人的粗略注视。最后，知道第一和第三人称的视线方向，分数计算允许分配注意力模式到每个帧。我们的贡献如下：（一）头部姿态估计的基础上本地化回归，（二）注意力分析，特别是相互和共享的凝视，包括第一人称凝视，（三）使用头戴式外观为基础的凝视跟踪器进行的实验。实验记录的数据显示令人鼓舞的结果。
This paper presents a method to recognize attentional behaviors from a head-mounted binocular eye tracker in triadic interactions. By taking advantage of the first-person view, we simultaneously estimate the first-person and third-person gaze. The first-person gaze is computed using an appearance-based method relying on local features. In parallel, head pose tracking allows determining the coarse gaze of people in the scene camera. Finally, knowing the first- and third-person gaze direction, scores are computed which permit to assign attention patterns to each frame. Our contributions are the followings: (i) head pose estimation based on localized regression, (ii) attention analysis, in particular mutual and shared gaze, including the first-person gaze, (iii) experiments conducted using a head-mounted appearance-based gaze tracker. Experiments on recorded data show encouraging results.