Pedagogical Agent Responsive to Eye Tracking in Educational VR
Pedagogical Agent Responsive to Eye Tracking in Educational VR
复制标题
教育虚拟现实中响应眼动追踪的教学代理
DOI：
10.1109/vr.2019.8797896
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
C. Borst
中科院分区：
文献类型：
--
作者：
Adil Khokhar;Andrew Yoshimura;C. Borst
我们提出了一种架构，使 VR 教学代理能够响应眼动追踪监控的用户注意力的变化。基于行为的人工智能包括低级传感器元件、计算称为广义热点的高级传感器注意力指标的传感器组合器、用于安排场景元素和响应的注释系统及其响应选择系统。我们证明，这些技术可以控制教师头像剪辑的播放，这些剪辑可以指出并解释 VR 石油钻机中的对象以进行培训。
We present an architecture to make a VR pedagogical agent responsive to shifts in user attention monitored by eye tracking. The behavior-based AI includes low-level sensor elements, sensor combiners that compute attention metrics for higher-level sensors called generalized hotspots, an annotation system for arranging scene elements and responses, and its response selection system. We show that the techniques can control the playback of teacher avatar clips that point out and explain objects in a VR oil rig for training.