Design and Evaluation of Augmented Reality and VR-Based Task Simulators

该提案是一个总体研究计划的一部分，该计划旨在设计和评估基于任务的训练模拟器的3D可视化技术。我们将探索开发和评估基于虚拟现实和增强现实的模拟器的新方法。我们遵循的工程设计过程是经典的：需求启发阶段是用来开发一个正式的分层任务表示用户与模拟器的交互。这包括在低级别用户交互方面对子任务的分析，以促进定量用户性能指标的规范。 ** 为了继续进行这些案例研究，我们正在建立一种方法，其中正式的分层任务分析（HTA）阶段正在进行基于模拟器的课程中培训的特定任务。任务分析之所以重要，有两个原因：首先，HTA描述与UML Harel Statecharts兼容，后者是独立于实现的表示，可以在各种平台上使用标准模式进行调整。这种方法使我们能够形式化的主要软件类在模拟器系统中的要求，在视图类，控制器类的输入输出要求，和那些模型（软件工程的MVC范式）。其次，它允许我们从信息处理的角度，在图形显示输出和用户界面输入事件方面检查任务需求。这有助于跨越抽象层次的系统的行为描述（在Herb Simon和James Albus提出的意义上），以便通过扩展经典的Fitts范式（尊重速度-准确性权衡）来解决低级别的技术技能性能，并推广到更高级别的抽象，包括3D空间推理，路径规划和子任务的执行控制。因此，可以根据任务完成时间和错误率评估非技术技能的课程学习情况，以形成相应的绩效指标。随着软件体系结构和硬件部署的实施，这些将迭代地进行改进。因此，我们的方法强调系统的以用户为中心的评价方法的发展，使用从纯科学为基础的研究，在人类的感知，认知和行动的范式。换句话说，我们认为基于任务的模拟器的设计是人机界面设计的软件工程领域内的一个企业。HQP开展的研究项目的目标将是开发和评估从当前模拟器扩展的模块，通过开发基于GPU的增强和虚拟现实3D交互式计算机图形算法，并对其进行定量评估。

The proposal is part of an overarching research program on the design and evaluation of 3D visualization techniques for task-based training simulators. We will be exploring novel methods for the development and evaluation of Virtual Reality and Augmented Reality based Simulators. The Engineering Design process that we follow is classical: The requirements elicitation stage is used to develop a formal hierarchical task representation for the user's interaction with the simulator. This includes an analysis of the sub-tasks in terms of low-level user interactions that facilitate the specification of quantitative user performance metrics. ******To proceed in each of these case studies, we are establishing an approach in which a formal Hierarchical Task Analysis (HTA) phase is being conducted on the specific tasks being trained within simulator-based curricula. The task analysis is important for two reasons: First, the HTA description is compatible with UML Harel Statecharts, which are implementation-independent representations that can be adapted using standard patterns on a variety of platforms. This approach allows us to formalize the requirements of the main software classes in the simulator systems, in terms of the input-output requirements for the View classes, the Controller Classes, and those of the Model (Software Engineering's MVC paradigm). Secondly, it allows us to examine the task requirements from an information-processing standpoint, in terms of graphical display outputs, and user interface input events. This facilitates a behavioural description of the system which span the abstraction hierarchy (in the sense posed by Herb Simon and James Albus) so that low-level technical skills performance can be addressed by extending the classical Fitts paradigm which respects the speed-accuracy tradeoff, and also to generalize to higher levels of the abstraction involving 3D spatial reasoning, path planning, and executive control of sub-tasks. Curriculum uptake on non-technical skills can thereby be assessed based on task completion times and error rates to form the corresponding performance metrics.******These are refined iteratively as the software architecture and hardware deployment proceed to implementation. Our approach thereby stresses the development of systematic user-centred evaluation methodologies, using paradigms adapted from pure Science-based research in human perception, cognition, and action. In other words, we consider the design of task-based simulators to be an enterprise within the Software Engineering domain of Human-Computer Interface Design. The goals of the research projects undertaken by HQP will be to develop and evaluate modules that extend from current simulators, through the development of GPU-based algorithms for 3D interactive computer graphics in Augmented and Virtual Reality, and for their quantitative evaluation.**