Research on the Use of Real-Time Tracking and Eye-Tracking Technology for Integrating Metacognition and Augmented Reality into Undergraduate Engineering Laboratories

利用实时跟踪和眼动追踪技术将元认知和增强现实融入本科工程实验室的研究

• 批准号: 2202108
• 负责人: Jung Hyup Kim
• 金额: $ 85万
• 依托单位: University of Missouri-Columbia
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-07-01 至 2025-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2202108&HistoricalAwards=false
• 关键词: Research; Use; Real; Time; Tracking

This project aims to innovate Augmented Reality (AR) learning platforms in an undergraduate engineering laboratory. Recently, due to the COVID-19 pandemic, in-person engineering laboratories faced significant challenges in providing hands-on exercise. AR technology might be a solution to the current challenge. Unlike virtual reality, AR does not cover a physical world but mixes 3D virtual objects into physical objects to improve students’ laboratory experiences and spatial awareness. However, students faced difficulties navigating the AR device and have experienced a mismatch between computer-generated 3D images and physical objects while learning in an AR environment. To transform AR learning from a static and isolated experience into a dynamic self-study, this project includes research on using a real-time tracking sensor with a 3D full-body motion capture system to improve AR usability and detect student’s premature termination of learning using metacognitive monitoring feedback and eye-tracking technology. The primary goal of this project is to integrate real-time 3D motion and location tracking systems to meet a series of objectives to gain insight into scientific development and technological innovation in a location-based AR environment. The first objective is to create the next generation of an AR learning platform by integrating state-of-the-art indoor real-time location technology and a 3D full-body motion capture system. The second objective is to detect the early termination of learning by using metacognitive monitoring feedback and eye movement data. The researchers will apply advanced gaze behavior metrics, such as fractal analysis of pupil dilation and eye inter-fixation duration, to identify significant eye gaze behavior representing student’s premature termination of learning. The last objective is to implement the research findings to promote instructional improvement in an engineering laboratory on the impact of receiving metacognitive feedback on learning performance. The current project will address integrated research and education activities to enhance our knowledge of effective undergraduate engineering laboratory education using real-time 3D motion and location tracking capabilities.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在在本科工程实验室中创新增强现实（AR）学习平台。最近，由于COVID-19疫情，现场工程实验室在提供实践练习方面面临重大挑战。AR技术可能是解决当前挑战的一种方法。与虚拟现实不同，AR不覆盖物理世界，而是将3D虚拟对象混合到物理对象中，以改善学生的实验室体验和空间意识。然而，学生们在导航AR设备时遇到了困难，并且在AR环境中学习时遇到了计算机生成的3D图像与物理对象之间的不匹配。为了将AR学习从静态和孤立的体验转变为动态的自我学习，该项目包括研究使用实时跟踪传感器和3D全身运动捕捉系统来提高AR可用性，并使用元认知监测反馈和眼动跟踪技术来检测学生过早终止学习。 该项目的主要目标是集成实时3D运动和位置跟踪系统，以满足一系列目标，从而在基于位置的AR环境中深入了解科学发展和技术创新。第一个目标是通过整合最先进的室内实时定位技术和3D全身运动捕捉系统来创建下一代AR学习平台。第二个目标是通过使用元认知监测反馈和眼动数据来检测学习的提前终止。研究人员将应用先进的凝视行为指标，如瞳孔扩张和眼睛相互注视持续时间的分形分析，以确定代表学生过早终止学习的重要眼睛凝视行为。最后一个目的是在一个工程实验室中实施研究结果，以促进接受元认知反馈对学习绩效的影响的教学改进。目前的项目将解决综合研究和教育活动，以提高我们的知识，有效的本科工程实验室教育使用实时三维运动和位置跟踪capability.This奖项反映了NSF的法定使命，并已被认为是值得通过评估使用基金会的智力价值和更广泛的影响审查标准的支持。