Design and Evaluation of Augmented Reality and VR-Based Task Simulators

这项建议是一项总体研究计划的一部分，该计划旨在为基于任务的训练模拟器设计和评估3D可视化技术。我们将探索开发和评估基于虚拟现实和增强现实的模拟器的新方法。我们遵循的工程设计过程是经典的：需求获取阶段用于为用户与模拟器的交互开发正式的分层任务表示。我们将这种分析细化到低级用户交互方面的层级子任务：空间中的移动，以及与工作区中实体的交互。这使我们能够根据这些交互的速度和准确性来指定量化的用户性能指标。任务分析很重要，原因有两个：第一，这些交互行为可以使用UML Harel Statecharts表示，这些交互行为是独立于实现的表示，可以在各种平台上使用标准模式进行调整。这种方法允许我们根据视图类、控制器类和模型(软件工程的MVC范例)的输入-输出需求来形式化模拟器系统中主要软件类的需求。其次，它允许我们从信息处理的角度，根据图形显示输出和用户界面输入事件来检查任务需求。虽然增强现实和虚拟现实提供了引人入胜的身临其境的环境，但仍然存在一些挑战，我们计划在这个拟议的项目中作为实证研究来解决这些挑战。通过人类感知、运动和认知系统的丰富能力，我们可以在混合现实环境中体验身临其境的互动--然而，这些人类能力所固有的限制并没有得到很好的理解。在这些身临其境的环境中出现了许多感知问题，这些问题是本提案中概述的经验性工作的基础。因此，我们的方法强调发展系统的以用户为中心的评估方法，使用改编自人类感知、认知和行动的纯科学研究的范式。换句话说，我们认为基于任务的模拟器的设计是人机界面设计软件工程领域的一个企业。HQP承担的研究项目的目标将是通过开发基于GPU的增强和虚拟现实中3D交互计算机图形的算法，并对其进行量化评估，开发和评估从现有模拟器延伸出来的模块。

This proposal is part of an overarching research program on the design and evaluation of 3D visualization techniques for task-based training simulators. We will be exploring novel methods for the development and evaluation of Virtual Reality and Augmented Reality based Simulators. The Engineering Design process that we follow is classical: The requirements elicitation stage is used to develop a formal hierarchical task representation for the user's interaction with the simulator. We refine this analysis down to the level sub-tasks in terms of low-level user interactions: movements in space, and interactions with entities in the workspace. This allows us to specify quantitative user performance metrics in terms of the speed and accuracy of those interactions. The task analysis is important for two reasons: First, these interaction behaviours can be represented using UML Harel Statecharts, which are implementation-independent representations that can be adapted using standard patterns on a variety of platforms. This approach allows us to formalize the requirements of the main software classes in the simulator systems, in terms of the input-output requirements for the View classes, the Controller Classes, and those of the Model (Software Engineering's MVC paradigm). Secondly, it allows us to examine the task requirements from an information-processing standpoint, in terms of graphical display outputs, and user interface input events. While Augmented Reality and Virtual Reality provide compelling immersive environments, a number of challenges remain, which we plan to address as the empirical research in this proposed program. The experience of immersive interaction in a mixed-reality environment comes to us through the rich capacities of the human perceptual, motor, and the cognitive system - yet the constraints that are inherent in these human capacities are not well understood. There are a number of perceptual issues that arise in these immersive environments, and these issues for the basis for the empirical work that is outlined in this proposal. Our approach thereby stresses the development of systematic user-centred evaluation methodologies, using paradigms adapted from pure Science-based research in human perception, cognition, and action. In other words, we consider the design of task-based simulators to be an enterprise within the Software Engineering domain of Human-Computer Interface Design. The goals of the research projects undertaken by HQP will be to develop and evaluate modules that extend from current simulators, through the development of GPU-based algorithms for 3D interactive computer graphics in Augmented and Virtual Reality, and for their quantitative evaluation.