Design and Evaluation of Augmented Reality and VR-Based Task Simulators

该提案是一项总体研究计划的一部分，该计划旨在为基于任务的训练模拟器设计和评估3D可视化技术。我们将探索开发和评估基于虚拟现实和增强现实的模拟器的新方法。我们遵循的工程设计过程是经典的：需求获取阶段用于为用户与模拟器的交互开发正式的分层任务表示。这包括根据低级别用户交互对子任务进行分析，以促进量化用户性能指标的规范。*为了在每一个案例研究中继续进行，我们正在建立一种方法，在这种方法中，正在对基于模拟器的课程中正在培训的具体任务进行正式的分层任务分析(HTA)阶段。任务分析很重要，原因有两个：第一，HTA描述与UMLHarel Statecharts兼容，后者是独立于实现的表示，可以在各种平台上使用标准模式进行调整。这种方法允许我们根据视图类、控制器类和模型(软件工程的MVC范例)的输入-输出需求来形式化模拟器系统中主要软件类的需求。其次，它允许我们从信息处理的角度，根据图形显示输出和用户界面输入事件来检查任务需求。这有助于对跨越抽象层次的系统的行为描述(在Herb Simon和James Albus提出的意义上)，从而可以通过扩展尊重速度-精度折衷的经典Fitts范式来解决低水平的技术技能表现，并且还可以将涉及3D空间推理、路径规划和子任务的执行控制的抽象推广到更高级别。因此，可以根据任务完成时间和错误率来评估课程对非技术技能的吸收情况，以形成相应的绩效指标。*随着软件体系结构和硬件部署的实施，这些指标将不断得到改进。因此，我们的方法强调发展系统的以用户为中心的评估方法，使用改编自人类感知、认知和行动的纯科学研究的范式。换句话说，我们认为基于任务的模拟器的设计是人机界面设计软件工程领域的一个企业。HQP承担的研究项目的目标将是开发和评估从现有模拟器延伸出来的模块，通过开发基于GPU的算法，用于增强和虚拟现实中的3D交互计算机图形，并对其进行量化评估。

The proposal is part of an overarching research program on the design and evaluation of 3D visualization techniques for task-based training simulators. We will be exploring novel methods for the development and evaluation of Virtual Reality and Augmented Reality based Simulators. The Engineering Design process that we follow is classical: The requirements elicitation stage is used to develop a formal hierarchical task representation for the user's interaction with the simulator. This includes an analysis of the sub-tasks in terms of low-level user interactions that facilitate the specification of quantitative user performance metrics. ******To proceed in each of these case studies, we are establishing an approach in which a formal Hierarchical Task Analysis (HTA) phase is being conducted on the specific tasks being trained within simulator-based curricula. The task analysis is important for two reasons: First, the HTA description is compatible with UML Harel Statecharts, which are implementation-independent representations that can be adapted using standard patterns on a variety of platforms. This approach allows us to formalize the requirements of the main software classes in the simulator systems, in terms of the input-output requirements for the View classes, the Controller Classes, and those of the Model (Software Engineering's MVC paradigm). Secondly, it allows us to examine the task requirements from an information-processing standpoint, in terms of graphical display outputs, and user interface input events. This facilitates a behavioural description of the system which span the abstraction hierarchy (in the sense posed by Herb Simon and James Albus) so that low-level technical skills performance can be addressed by extending the classical Fitts paradigm which respects the speed-accuracy tradeoff, and also to generalize to higher levels of the abstraction involving 3D spatial reasoning, path planning, and executive control of sub-tasks. Curriculum uptake on non-technical skills can thereby be assessed based on task completion times and error rates to form the corresponding performance metrics.******These are refined iteratively as the software architecture and hardware deployment proceed to implementation. Our approach thereby stresses the development of systematic user-centred evaluation methodologies, using paradigms adapted from pure Science-based research in human perception, cognition, and action. In other words, we consider the design of task-based simulators to be an enterprise within the Software Engineering domain of Human-Computer Interface Design. The goals of the research projects undertaken by HQP will be to develop and evaluate modules that extend from current simulators, through the development of GPU-based algorithms for 3D interactive computer graphics in Augmented and Virtual Reality, and for their quantitative evaluation.**