Towards "Walk-Up" Usable 3D User Interfaces

从桌面应用程序到沉浸式虚拟现实（VR），许多交互式计算机系统都需要三维用户界面（3DUIs）。虽然VR和相关技术（如增强现实）正在兴起，但桌面3d ui已经是成熟的技术，具有有效的ui。本研究计划的目标是满足桌面和空间界面之间的需求，并开发新颖有效的“步行可用”3d用户界面。这项工作主要有三个方面。首先是利用过去的研究结果，如延迟、输入噪音、触觉反馈和疲劳等因素来设计改进的3DUIs交互技术。例如，空间输入在长时间使用后会产生疲劳，并且在没有触觉反馈的情况下很难确定物体深度。相反，忽略深度输入（例如，简单地将手与物体排列在一起）可以增强3DUI的可用性。人工视觉反馈（例如，触摸时改变物体颜色）有助于减少对触觉反馈的需求。简单的手势（指、滑）提供强大的助记功能，避免使用模式，或用窗口和图标等2D UI工件混淆3D环境。本研究将采用这些方法，从而解决VR广泛采用中的两个主要问题：可学习性（在VR中高，但在桌面3dui中低）和有效性（桌面3dui高，但在VR中较低）。第二个方面是进一步量化复杂应用中的这些因素，扩展如何更好地设计3ui的知识。三是解决虚拟现实的“应用问题”。虽然VR早已抓住了我们的想象力，但研究人员很难在专业领域（例如培训，心理治疗，可视化）之外找到它的实际应用。在某种程度上，这似乎源于使用VR界面与桌面系统的相对困难。我认为，通过降低UI的复杂性，接触工业、教育和医疗保健等领域的潜在合作者，VR和空间技术的新应用领域可能会被发现。这项工作在许多依赖于3D数据可视化表示的领域都有应用。它将量化3dui中最重要的因素，并帮助开发评估其有效性的新方法。它将向新用户开放3D内容制作。考虑到目前的计算机辅助设计（CAD）和3D建模工具几乎用于所有工程领域，在成品之前设计人工制品，但需要广泛的培训。类似地，3D用户界面在电子游戏中几乎无处不在，这些游戏通常至少涉及3D环境的导航。仅游戏一项就代表了加拿大23亿美元的产业。这项工作将有助于了解是什么使这些ui有效，如何进一步改进它们，以及如何在其他新型3DUI系统中利用它们的有效性。

Three-dimensional user interfaces (3DUIs) are required in many interactive computer systems, from desktop applications to immersive virtual reality (VR). While VR and related technologies (e.g., augmented reality) are emerging, desktop 3DUIs are now mature technologies with effective UIs.The objective of this research program is to meet in the middle between desktop and spatial interfaces, and develop novel and effective “walk-up usable” 3DUIs. There are three main aspects of this work. The first is to leverage past results investigating factors such as latency, input noise, tactile feedback, and fatigue to design improved interaction techniques for 3DUIs. For example, spatial input yields fatigue with extended use and it is difficult to determine object depth without tactile feedback. Instead, ignoring depth input (e.g., simply visually lining the hand up with the object) can enhance 3DUI usability. Artificial visual feedback (e.g., changing object colour on touch) helps reduce the need for tactile feedback. Simple gestures (pointing, swiping) offer strong mnemonics and avoid use of modes, or cluttering the 3D environment with 2D UI artefacts such as windows and icons. This research will employ these approaches, thus addressing two major problems in the widespread adoption of VR: learnability (which is high in VR, but low in desktop 3DUIs) and effectiveness (high in desktop 3DUIs, but lower in VR). The second aspect is to further quantify these factors in complex applications, expanding knowledge on how to better design 3DUIs.The third aspect is addressing the “application problem” of VR. While VR has long captured our imagination, researchers have had a hard time finding practical applications for it outside of specialized domains (e.g., training, psychotherapy, visualization). In part, this seems to stem from the comparatively difficulty in using VR interfaces versus desktop systems. I argue that by reducing UI complexity, and approaching potential collaborators in sectors like industry, education, and health care, new application areas of VR and spatial technologies might be discovered.This work has application in many domains that rely on visual representation of 3D data. It will quantify factors that matter most in 3DUIs, and help develop new methodologies for evaluating their effectiveness. It will open up 3D content production to new users. Consider that current computer-aided design (CAD) and 3D modeling tools are used in virtually all fields of engineering to design artefacts prior to the finished product, but require extensive training. Similarly, 3DUIs are nearly ubiquitous in video games, which usually involve at least navigation of a 3D environment. Gaming alone represents a $2.3 billion industry in Canada. This work will help understand what makes these UIs effective, how to further improve them, and how to leverage their effectiveness in other novel 3DUI systems.