Research on the Use of Real-Time Tracking and Eye-Tracking Technology for Integrating Metacognition and Augmented Reality into Undergraduate Engineering Laboratories

利用实时跟踪和眼动追踪技术将元认知和增强现实融入本科工程实验室的研究

• 批准号: 2202108
• 负责人: Jung Hyup Kim
• 金额: $ 85万
• 依托单位: University of Missouri-Columbia
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-07-01 至 2025-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2202108&HistoricalAwards=false
• 关键词: Research; Use; Real; Time; Tracking

This project aims to innovate Augmented Reality (AR) learning platforms in an undergraduate engineering laboratory. Recently, due to the COVID-19 pandemic, in-person engineering laboratories faced significant challenges in providing hands-on exercise. AR technology might be a solution to the current challenge. Unlike virtual reality, AR does not cover a physical world but mixes 3D virtual objects into physical objects to improve students’ laboratory experiences and spatial awareness. However, students faced difficulties navigating the AR device and have experienced a mismatch between computer-generated 3D images and physical objects while learning in an AR environment. To transform AR learning from a static and isolated experience into a dynamic self-study, this project includes research on using a real-time tracking sensor with a 3D full-body motion capture system to improve AR usability and detect student’s premature termination of learning using metacognitive monitoring feedback and eye-tracking technology. The primary goal of this project is to integrate real-time 3D motion and location tracking systems to meet a series of objectives to gain insight into scientific development and technological innovation in a location-based AR environment. The first objective is to create the next generation of an AR learning platform by integrating state-of-the-art indoor real-time location technology and a 3D full-body motion capture system. The second objective is to detect the early termination of learning by using metacognitive monitoring feedback and eye movement data. The researchers will apply advanced gaze behavior metrics, such as fractal analysis of pupil dilation and eye inter-fixation duration, to identify significant eye gaze behavior representing student’s premature termination of learning. The last objective is to implement the research findings to promote instructional improvement in an engineering laboratory on the impact of receiving metacognitive feedback on learning performance. The current project will address integrated research and education activities to enhance our knowledge of effective undergraduate engineering laboratory education using real-time 3D motion and location tracking capabilities.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目旨在在本科工程实验室中创新增强现实（AR）学习平台。最近，由于Covid-19大流行，面对面的工程实验室在提供动手运动方面面临着重大挑战。 AR技术可能是解决当前挑战的方法。与虚拟现实不同，AR不涵盖物理世界，而是将3D虚拟对象混合到物理对象中，以改善学生的实验室体验和空间意识。但是，学生在AR设备上面临困难，并在AR环境中学习时经历了计算机生成的3D图像和物理对象之间的不匹配。为了将AR的学习从静态和孤立的体验转变为动态的自学，该项目包括使用3D全身运动捕获系统的实时跟踪传感器的研究，以提高AR可用性，并检测学生使用元认知监测反馈和眼睛跟踪技术的学生对学习的过早终止。该项目的主要目标是整合实时3D运动和位置跟踪系统，以达到一系列目标，以深入了解基于位置的AR环境中的科学发展和技术创新。第一个目标是通过集成最新的室内实时位置技术和3D全身运动捕获系统来创建下一代AR学习平台。第二个目标是通过使用元认知监测反馈和眼动数据来检测学习的早期终止。研究人员将采用先进的凝视行为指标，例如对学生词典的分形分析和固定持续时间，以识别代表学生过早学习的重要眼睛凝视行为。最后的目标是实施研究结果，以促进工程实验室的教学改进，以了解接受元认知反馈对学习绩效的影响。当前的项目将使用实时3D运动和位置跟踪能力来提高我们对有效的本科工程实验室教育的知识，以提高我们对有效的本科工程实验室教育的了解。该奖项反映了NSF的法定任务，并被认为是通过基金会的知识分子优点和更广泛的影响审查标准通过评估来评估的支持。