权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

CHS: Small: Enhancing Educational Virtual Reality with Headset-based Eye Tracking

CHS：小型：通过基于耳机的眼动追踪增强教育虚拟现实

基本信息

批准号：
1815976
负责人：
Christoph Borst
金额：
$ 49.98万
依托单位：
University of Louisiana at Lafayette
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2018
资助国家：
美国
起止时间：
2018-08-01 至 2023-07-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1815976&HistoricalAwards=false
关键词：
CHS Small Enhancing Educational Virtual

项目摘要

Virtual reality (VR) can bring lab or field-trip-like experiences to students who are unable to visit physical sites because of location, budget, or schedule. Potential advantages of these experiences over traditional teaching tools include increased student engagement and motivation, more direct viewing of size and spatial relationships of modeled objects, and stronger memories of the content. Emerging consumer VR devices are starting to provide sufficient quality and affordability for home and school use, and this will eventually make educational VR experiences broadly available. Future consumer VR headsets are expected to include increased sensing, such as eye tracking cameras to determine where users are looking and strain gauges to detect facial expressions. The sensor data can be analyzed for insight into users' attention and emotional affect. The project will investigate how such insight into student attention can be used to improve educational VR through the design of personalized educational environments that respond to individual students' attention. The project will also develop techniques for using sensor data to give teachers enhanced real-time insight into student activities and behavior patterns to help them provide better teacher-guided VR experiences. This will involve development of new approaches for educational VR technology and experiments that generate fundamental knowledge and guidelines for applying such approaches. In addition to the potential long-term benefit of improving education, the project will provide a number of more immediate, direct educational benefits. The team will incorporate the work into courses and undergraduate research experiences on human-computer interaction and VR, as well as outreach activities and summer programs aimed at high school students across Louisiana. The team will design and assess methods including the following: 1) educational content that responds to student eye gaze for more responsive and engaging presentation; 2) visual effects or indicators, based on detected eye behaviors, to encourage student attention to particular content in a VR environment; and 3) visualizations of student eye gaze that use both raw and processed gaze data to help teachers understand and guide students. To understand the tradeoffs between approaches and to develop guidelines for wider development and use of these techniques, effects will be studied in terms of behavior, subjective experience, and learning. The most promising methods will be applied to a case study of a networked VR interface that allows teachers to monitor and guide students through an immersive educational VR environment. To do this, the team will build on their existing educational VR framework that has previously been deployed at regional high schools and to thousands of students at outreach events. The project is expected to improve the effectiveness of such VR systems and of teachers' ability to supervise and assist students. Resulting methods and principles will provide a foundation for headset-based eye tracking in educational VR and in other related applications such as simulation-based training and accessibility.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

虚拟现实（VR）可以为由于位置，预算或时间表而无法访问物理站点的学生带来实验室或实地考察般的体验。与传统教学工具相比，这些体验的潜在优势包括提高学生的参与度和动机，更直接地观察模型对象的大小和空间关系，以及更强的内容记忆。新兴的消费者VR设备开始为家庭和学校使用提供足够的质量和价格，这最终将使教育VR体验广泛可用。未来的消费者VR头显预计将包括增强的传感功能，例如眼动跟踪摄像头，以确定用户在看什么，应变仪检测面部表情。可以分析传感器数据以洞察用户的注意力和情绪影响。该项目将研究如何通过设计响应个别学生注意力的个性化教育环境，将这种对学生注意力的洞察用于改善教育VR。该项目还将开发使用传感器数据的技术，使教师能够增强对学生活动和行为模式的实时洞察，以帮助他们提供更好的教师指导VR体验。这将涉及开发教育VR技术的新方法和实验，以产生应用这些方法的基础知识和指导方针。除了改善教育的潜在长期效益外，该项目还将提供一些更直接、更直接的教育效益。该团队将把这项工作纳入人机交互和VR的课程和本科生研究经验，以及针对路易斯安那州高中生的外展活动和暑期项目。该团队将设计和评估包括以下内容的方法：1）响应学生眼睛凝视的教育内容，以获得更灵敏和更吸引人的演示; 2）基于检测到的眼睛行为的视觉效果或指示器，以鼓励学生注意VR环境中的特定内容;以及3）学生眼睛注视的可视化，其使用原始和处理的注视数据两者来帮助教师理解和引导学生。为了了解方法之间的权衡，并为更广泛的开发和使用这些技术制定指导方针，将从行为，主观经验和学习方面研究效果。最有前途的方法将应用于网络VR界面的案例研究，该界面允许教师通过沉浸式教育VR环境监控和指导学生。为此，该团队将建立在他们现有的教育VR框架基础上，该框架此前已部署在地区高中和数千名学生的外展活动中。该项目预计将提高此类VR系统的有效性以及教师监督和帮助学生的能力。由此产生的方法和原理将为教育VR和其他相关应用（如基于模拟的培训和可访问性）中的基于头戴式设备的眼动跟踪奠定基础。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

期刊论文数量（30）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Supervised vs Unsupervised Learning on Gaze Data to Classify Student Distraction Level in an Educational VR Environment

在教育 VR 环境中对注视数据进行监督与无监督学习以对学生分心程度进行分类

DOI：
10.1145/3485279.3488283
发表时间：
2021
期刊：
2021 ACM Symposium on Spatial User Interaction
影响因子：
0
作者：
Asish, Sarker Monojit;Kulshreshth, Arun K;Borst, Christoph W.
通讯作者：
Borst, Christoph W.

Modified Playback of Avatar Clip Sequences Based on Student Attention in Educational VR

教育 VR 中基于学生注意力的头像剪辑序列的修改播放

DOI：
10.1109/vrw50115.2020.00276
发表时间：
2020
期刊：
2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR
影响因子：
0
作者：
Khokhar, Adil;Yoshimura, Andrew;Borst, Christoph W.
通讯作者：
Borst, Christoph W.

User Identification Utilizing Minimal Eye-Gaze Features in Virtual Reality Applications

DOI：
10.3390/virtualworlds1010004
发表时间：
2022-09
期刊：
Virtual Worlds
影响因子：
0
作者：
S. Asish;Arun K. Kulshreshth;C. Borst
通讯作者：
S. Asish;Arun K. Kulshreshth;C. Borst

Design and Evaluation of Visual Cues for Restoring and Guiding Visual Attention in Eye-Tracked VR

眼动追踪 VR 中恢复和引导视觉注意力的视觉线索的设计和评估

DOI：
10.1109/vrw58643.2023.00096
发表时间：
2023
期刊：
IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops
影响因子：
0
作者：
Woodworth, Jason W.;Yoshimura, Andrew;Lipari, Nicholas G.;Borst, Christoph W.
通讯作者：
Borst, Christoph W.

Evaluation of Headset-based Viewing and Desktop-based Viewing of Remote Lectures in a Social VR Platform

社交 VR 平台中基于耳机的远程讲座观看和基于桌面的观看评估