Design and Evaluation of Augmented Reality and VR-Based Task Simulators

该提案是一个总体研究计划的一部分，该计划旨在设计和评估基于任务的训练模拟器的3D可视化技术。我们将探索开发和评估基于虚拟现实和增强现实的模拟器的新方法。我们遵循的工程设计过程是经典的：需求启发阶段是用来开发一个正式的分层任务表示用户与模拟器的交互。我们将这种分析细化到低级别用户交互的子任务：空间中的移动以及与工作区中实体的交互。这使我们能够根据这些交互的速度和准确性来指定定量的用户性能指标。 任务分析之所以重要，有两个原因：首先，这些交互行为可以使用UML Harel Statecharts表示，这是独立于实现的表示，可以在各种平台上使用标准模式进行调整。这种方法使我们能够形式化的主要软件类在模拟器系统中的要求，在视图类，控制器类的输入输出要求，和那些模型（软件工程的MVC范式）。其次，它允许我们从信息处理的角度，在图形显示输出和用户界面输入事件方面检查任务需求。 虽然增强现实和虚拟现实提供了令人信服的沉浸式环境，但仍然存在一些挑战，我们计划在这个拟议的计划中进行实证研究。在混合现实环境中的沉浸式交互体验是通过人类感知、运动和认知系统的丰富能力来实现的--然而，这些人类能力中固有的限制还没有得到很好的理解。在这些沉浸式环境中出现了许多感知问题，这些问题是本提案中概述的经验工作的基础。因此，我们的方法强调系统的以用户为中心的评价方法的发展，使用从纯科学为基础的研究，在人类的感知，认知和行动的范式。换句话说，我们认为基于任务的模拟器的设计是人机界面设计的软件工程领域内的一个企业。HQP开展的研究项目的目标是开发和评估从当前模拟器扩展的模块，通过开发基于GPU的增强和虚拟现实3D交互式计算机图形算法，并对其进行定量评估。

This proposal is part of an overarching research program on the design and evaluation of 3D visualization techniques for task-based training simulators. We will be exploring novel methods for the development and evaluation of Virtual Reality and Augmented Reality based Simulators. The Engineering Design process that we follow is classical: The requirements elicitation stage is used to develop a formal hierarchical task representation for the user's interaction with the simulator. We refine this analysis down to the level sub-tasks in terms of low-level user interactions: movements in space, and interactions with entities in the workspace. This allows us to specify quantitative user performance metrics in terms of the speed and accuracy of those interactions. The task analysis is important for two reasons: First, these interaction behaviours can be represented using UML Harel Statecharts, which are implementation-independent representations that can be adapted using standard patterns on a variety of platforms. This approach allows us to formalize the requirements of the main software classes in the simulator systems, in terms of the input-output requirements for the View classes, the Controller Classes, and those of the Model (Software Engineering's MVC paradigm). Secondly, it allows us to examine the task requirements from an information-processing standpoint, in terms of graphical display outputs, and user interface input events. While Augmented Reality and Virtual Reality provide compelling immersive environments, a number of challenges remain, which we plan to address as the empirical research in this proposed program. The experience of immersive interaction in a mixed-reality environment comes to us through the rich capacities of the human perceptual, motor, and the cognitive system - yet the constraints that are inherent in these human capacities are not well understood. There are a number of perceptual issues that arise in these immersive environments, and these issues for the basis for the empirical work that is outlined in this proposal. Our approach thereby stresses the development of systematic user-centred evaluation methodologies, using paradigms adapted from pure Science-based research in human perception, cognition, and action. In other words, we consider the design of task-based simulators to be an enterprise within the Software Engineering domain of Human-Computer Interface Design. The goals of the research projects undertaken by HQP will be to develop and evaluate modules that extend from current simulators, through the development of GPU-based algorithms for 3D interactive computer graphics in Augmented and Virtual Reality, and for their quantitative evaluation.