FW-HTF-RM: Augmenting Spatial Cognition Capabilities of Future Workforce to Enhance Work Performance in Altered Environments Using Virtual Reality

这项研究的目标是使未来的劳动力能够在陌生的环境中工作，包括难以到达的荒凉地方，如：深空、近地轨道、深海和极地地区。研究团队将推出一种结合虚拟现实(VR)、眼球跟踪和脑电(EEG)的新的高性价比教育平台。该平台将为基于情景的模拟和游戏提供设计原则，以培训未来的劳动力适应变化的环境并在其中工作。主要目标是了解空间认知处理在变化的重力和视觉环境中有何不同，以及基于VR的模拟如何加快培训国家未来的劳动力以适应这种环境。该研究小组综合了信息建模、虚拟现实、注视分析、脑电信号和航空航天工程的原理，开展了改变条件下空间认知加工的研究。具体地说，研究小组将研究视觉和特性参照系的不对齐以及缺乏视觉空间线索如何以及在多大程度上影响空间能力、注视模式和大脑功能。这项研究将：(1)通过行为测试测量空间能力，并在模拟的正常和变化的环境中对比分数和反应时；(2)使用眼动跟踪和脑电(EEG)测量和分析认知策略和精神负荷，并在模拟的正常和变化的环境中对比结果；(3)应用空间能力、注意力分配和精神负荷的结果来创建模拟或游戏的框架，以训练未来的劳动力在变化的条件下工作。这项研究将在认知科学的行为和生理领域创造新的知识，从而更好地理解变化环境中的空间认知过程。这项工作的更广泛影响包括开发一种独特、安全和经济高效的方法来使用虚拟模拟来培训工人，并增强他们的空间能力，以提高他们的安全、工作生活质量、生产率和更多人参与未来劳动力的潜力。更广泛的影响还包括开发教育课程内容和增加对代表不足的学生群体的指导。教育活动包括一项针对K-12和大学生的强有力的外展计划，以增加他们在科学、技术、工程和数学(STEM)领域的参与，告知他们在改变条件下的未来工作，并解释人类技术前沿如何提高空间认知表现。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The goal of this research is to enable the future workforce to work in unfamiliar environments, including desolate hard to reach places such as: deep space, low Earth orbit, deep ocean, and polar regions. The research team will introduce a new cost-effective educational platform combining Virtual Reality (VR), Eye Tracking and electroencephalography (EEG). This platform will inform design principles for scenario-based simulations and games to train the future workforce to adapt to and work in altered environments. The main goal is to understand how spatial cognitive processing differs in altered gravitational and visual environments, and how VR-based simulation can accelerate training the nation's future workforce to adapt to such environments. The research team integrates the principles of information modeling, VR, fixation analysis, EEG, and aerospace engineering to conduct the proposed research on spatial cognitive processing in altered conditions.Specifically, the research team will address how, and to what extent, the non-alignment of visual and idiotropic frames of reference (FOR) and a lack of visuospatial cues offered by familiar landmarks influence spatial abilities, fixation patterns, and brain functions. This study will: (1) measure spatial abilities through behavioral tests, and contrast scores and reaction time in simulated normal and altered environments; (2) measure and analyze cognitive strategies and mental workload using eye tracking and electroencephalography (EEG) and contrast results in simulated normal and altered environments; and (3) apply the results of spatial abilities, attentional allocation, and mental workload to create the framework of a simulation or game to train the future workforce to work in altered conditions.The proposed research will lead to inventing, evaluating, and applying innovative methods and tools that use VR, eye tracking and EEG to design scenario-based simulations and games for workforce training. This study will create new knowledge in the behavioral and physiological domains of cognitive science leading to a better understanding of spatial cognitive processing in altered environments. The broader impacts of this work include developing a unique, safer, and cost-effective approach to train workers using virtual analogs and augment their spatial abilities to enhance their safety, quality of work life, productivity, and potential for more people to participate in the future workforce. Broader impacts also include developing educational course content and increased mentoring of underrepresented student groups. Educational activities include a strong outreach program for K-12 and college students to increase their participation in careers in science, technology, engineering and math (STEM), inform them about the future of work in altered conditions, and explain how a human-technology frontier can bolster spatial cognitive performance.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.