CAREER: Leveraging the Virtualness of Virtual Reality for More-Effective Training

本研究为基于计算机的虚拟现实（VR）培训提供了一种新的方法，利用VR的虚拟性来提供现实世界中无法实现的培训解决方案。其目标是开发比现实世界的练习和模拟它们的VR系统更有效、更省时的VR技术。为了证明这些新的虚拟现实培训技术的总体有效性，研究重点放在两个培训领域：(1)非外科医生团队成员的机器人手术室任务，包括术前设置、术中任务和术后清理。(2)非公路货车的换挡前检查，包括巡视检查、装车检查和驾驶室检查。形成性专家评论、新技术与传统VR培训版本的比较研究以及实际验证研究将用于确定技术的有效性和效率。教育活动包括研究生VR课程、本科生研究体验、面向代表性不足的高中生的暑期研究项目、面向高中生和中学生的年度VR夏令营，以及为VR开发创建在线视频教程，以支持正式和非正式的学习。一个设计和分析VR训练技术的新框架已经被开发出来，以促进这项研究，即改变保真度以影响记忆的框架。它连接了两个概念，系统保真度和工作记忆。系统保真度是虚拟现实系统再现真实世界体验的客观精确程度。工作记忆是人类使用者大脑中短期或长期的感知、认知和运动记忆网络的暂时激活。该框架的前提是操纵系统保真度的一个方面，以帮助一个阶段的工作记忆，这反过来应该提高训练的有效性。基于此框架确定的方法，将开发和研究六种新的VR技术：(1)因果信号，(2)感官口音，(3)情景戏剧化，(4)错误煽动，(5)物体召唤和(6)调节生物力学。例如，因果信号方法是有目的地改变时间和物理，以传达事件及其结果之间的因果关系。时间扭曲是一种因果信号技术，在这种技术中，训练场景可以在错误发生后快速前进到产生的结果，然后倒回到错误发生前的决策点。除了允许用户纠正错误之外，这种技术还将向用户传达错误和结果之间的因果关系。

This research takes a new approach to computer-based virtual reality (VR) training by leveraging the virtualness of VR to provide training solutions not possible in the real world. The aim is to develop VR techniques that are more effective and more time-efficient for training than real-world exercises and VR systems that emulate them. To demonstrate the general effectiveness of these new VR training techniques, the research focuses on two training domains: (1) Robotic operating room tasks for non-surgeon team members, including preoperative setup, intraoperative tasks, and postoperative cleanup. (2) Pre-shift inspections of off-highway trucks, which include walk-around inspections, mounting the vehicle, and in-cab inspections. Formative expert reviews, studies comparing the new techniques to traditional VR training versions, and real-world validation studies will be used to determine the effectiveness and efficiency of the techniques. Educational activities include a graduate VR course, research experiences for undergraduates, a summer research program for underrepresented high school students, an annual VR summer camp for high and middle school students, and the creation of online video tutorials for VR development to support formal and informal learning.A new framework for designing and analyzing VR training techniques has been developed to facilitate this research, the Framework for Altering Fidelity to Influence Memory. It connects two concepts, system fidelity and working memory. System fidelity is the objective degree of exactness with which real world experiences are reproduced by a VR system. Working memory is the temporal activation of short-term or long-term perceptual, cognitive, and motor memory networks in the mind of the human user. The premise of the framework is to manipulate an aspect of system fidelity to help a stage of working memory, which in turn should improve the effectiveness of training. Six novel VR techniques, based on approaches identified with this framework, will be developed and investigated: (1) causation signaling, (2) sensory accents, (3) situational dramatization, (4) error instigation, (5) object conjuration, and (6) regulated biomechanics. For example, the causation signaling method is to purposefully alter time and physics to convey the cause-and-effect relationship between an event and its consequence. Time warping is a causation signaling technique in which the training scenario can be fast-forwarded after an error to the resulting consequence and then rewound back to the decision point just before the error. This technique will convey to the user the cause-and-effect relationship between the error and resulting consequence, in addition to allowing the user to correct the mistake.