CAREER: Leveraging the Virtualness of Virtual Reality for More-Effective Training

这项研究为基于计算机的虚拟现实(VR)培训提供了一种新的方法，利用VR的虚拟特性来提供现实世界中不可能提供的培训解决方案。其目的是开发比现实世界练习和模拟它们的VR系统更有效、更省时的训练VR技术。为了证明这些新的VR训练技术的普遍有效性，研究集中在两个训练领域：(1)非手术团队成员的机器人手术室任务，包括术前设置、术中任务和术后清理。(2)非公路货车班前检查，包括巡视检查、车辆安装检查和驾驶室内检查。形成性专家评审、将新技术与传统VR培训版本进行比较的研究以及现实世界的验证研究将用于确定这些技术的有效性和效率。教育活动包括研究生VR课程，为本科生提供的研究体验，为未被充分代表的高中生举办的暑期研究项目，为高中生举办的一年一度的VR夏令营，以及为VR开发创建在线视频教程，以支持正式和非正式的学习。为了促进这项研究，我们开发了一个新的设计和分析VR培训技术的框架--改变保真度以影响记忆的框架。它将系统保真度和工作记忆这两个概念联系在一起。系统保真度是指VR系统再现真实世界体验的客观准确程度。工作记忆是人类大脑中短期或长期知觉、认知和运动记忆网络的暂时激活。该框架的前提是操纵系统保真度的一个方面，以帮助一个阶段的工作记忆，这反过来应该提高培训的有效性。基于这个框架确定的方法，将开发和研究六种新的VR技术：(1)因果信号，(2)感觉重音，(3)情景戏剧化，(4)错误煽动，(5)物体召唤，(6)调节生物力学。例如，因果信号方法是有目的地改变时间和物理，以传达事件及其结果之间的因果关系。时间扭曲是一种因果信号发送技术，其中训练场景可以在错误之后快进到结果结果，然后回到错误之前的决策点。这项技术除了允许用户纠正错误外，还将向用户传达错误和结果之间的因果关系。

This research takes a new approach to computer-based virtual reality (VR) training by leveraging the virtualness of VR to provide training solutions not possible in the real world. The aim is to develop VR techniques that are more effective and more time-efficient for training than real-world exercises and VR systems that emulate them. To demonstrate the general effectiveness of these new VR training techniques, the research focuses on two training domains: (1) Robotic operating room tasks for non-surgeon team members, including preoperative setup, intraoperative tasks, and postoperative cleanup. (2) Pre-shift inspections of off-highway trucks, which include walk-around inspections, mounting the vehicle, and in-cab inspections. Formative expert reviews, studies comparing the new techniques to traditional VR training versions, and real-world validation studies will be used to determine the effectiveness and efficiency of the techniques. Educational activities include a graduate VR course, research experiences for undergraduates, a summer research program for underrepresented high school students, an annual VR summer camp for high and middle school students, and the creation of online video tutorials for VR development to support formal and informal learning.A new framework for designing and analyzing VR training techniques has been developed to facilitate this research, the Framework for Altering Fidelity to Influence Memory. It connects two concepts, system fidelity and working memory. System fidelity is the objective degree of exactness with which real world experiences are reproduced by a VR system. Working memory is the temporal activation of short-term or long-term perceptual, cognitive, and motor memory networks in the mind of the human user. The premise of the framework is to manipulate an aspect of system fidelity to help a stage of working memory, which in turn should improve the effectiveness of training. Six novel VR techniques, based on approaches identified with this framework, will be developed and investigated: (1) causation signaling, (2) sensory accents, (3) situational dramatization, (4) error instigation, (5) object conjuration, and (6) regulated biomechanics. For example, the causation signaling method is to purposefully alter time and physics to convey the cause-and-effect relationship between an event and its consequence. Time warping is a causation signaling technique in which the training scenario can be fast-forwarded after an error to the resulting consequence and then rewound back to the decision point just before the error. This technique will convey to the user the cause-and-effect relationship between the error and resulting consequence, in addition to allowing the user to correct the mistake.