Towards "Walk-Up" Usable 3D User Interfaces

从桌面应用到沉浸式虚拟现实（VR），许多交互式计算机系统都需要三维用户界面（3DUI）。虽然VR和相关技术（例如，增强现实）正在出现，桌面3DUI现在是具有有效UI的成熟技术。 这项研究计划的目标是满足桌面和空间界面之间的中间，并开发新颖有效的“步行可用”3DUI。这项工作主要有三个方面。第一个是利用过去的结果调查因素，如延迟，输入噪声，触觉反馈和疲劳设计改进的交互技术的3DUI。例如，空间输入随着延长使用而产生疲劳，并且在没有触觉反馈的情况下难以确定对象深度。相反，忽略深度输入（例如，简单地在视觉上将手与对象对齐）可以增强3DUI可用性。人工视觉反馈（例如，在触摸时改变对象颜色）有助于减少对触觉反馈的需要。简单的手势（指向，滑动）提供了强大的助记符，并避免使用模式，或用2D UI工件（如窗口和图标）扰乱3D环境。这项研究将采用这些方法，从而解决VR广泛采用的两个主要问题：可学习性（VR中高，但桌面3DUI低）和有效性（桌面3DUI高，但VR中较低）。第二个方面是进一步量化复杂应用中的这些因素，扩大如何更好地设计3DUI的知识。 第三个方面是解决VR的“应用问题”。虽然VR长期以来一直吸引着我们的想象力，但研究人员很难在专业领域之外找到它的实际应用（例如，培训、心理治疗、可视化）。在某种程度上，这似乎源于使用VR界面与桌面系统相比的相对困难。我认为，通过降低UI复杂性，并接近工业，教育和医疗保健等部门的潜在合作者，可能会发现VR和空间技术的新应用领域。 这项工作在许多依赖于3D数据的可视化表示的领域中具有应用。它将量化3DUI中最重要的因素，并帮助开发评估其有效性的新方法。它将向新用户开放3D内容制作。考虑到目前的计算机辅助设计（CAD）和3D建模工具几乎用于所有工程领域，在成品之前设计人工制品，但需要大量的培训。类似地，3DUI在视频游戏中几乎无处不在，其通常至少涉及3D环境的导航。仅游戏就代表了加拿大23亿美元的产业。这项工作将有助于了解是什么使这些UI有效，如何进一步改进它们，以及如何在其他新颖的3DUI系统中利用它们的有效性。

Three-dimensional user interfaces (3DUIs) are required in many interactive computer systems, from desktop applications to immersive virtual reality (VR). While VR and related technologies (e.g., augmented reality) are emerging, desktop 3DUIs are now mature technologies with effective UIs. The objective of this research program is to meet in the middle between desktop and spatial interfaces, and develop novel and effective “walk-up usable” 3DUIs. There are three main aspects of this work. The first is to leverage past results investigating factors such as latency, input noise, tactile feedback, and fatigue to design improved interaction techniques for 3DUIs. For example, spatial input yields fatigue with extended use and it is difficult to determine object depth without tactile feedback. Instead, ignoring depth input (e.g., simply visually lining the hand up with the object) can enhance 3DUI usability. Artificial visual feedback (e.g., changing object colour on touch) helps reduce the need for tactile feedback. Simple gestures (pointing, swiping) offer strong mnemonics and avoid use of modes, or cluttering the 3D environment with 2D UI artefacts such as windows and icons. This research will employ these approaches, thus addressing two major problems in the widespread adoption of VR: learnability (which is high in VR, but low in desktop 3DUIs) and effectiveness (high in desktop 3DUIs, but lower in VR). The second aspect is to further quantify these factors in complex applications, expanding knowledge on how to better design 3DUIs. The third aspect is addressing the “application problem” of VR. While VR has long captured our imagination, researchers have had a hard time finding practical applications for it outside of specialized domains (e.g., training, psychotherapy, visualization). In part, this seems to stem from the comparatively difficulty in using VR interfaces versus desktop systems. I argue that by reducing UI complexity, and approaching potential collaborators in sectors like industry, education, and health care, new application areas of VR and spatial technologies might be discovered. This work has application in many domains that rely on visual representation of 3D data. It will quantify factors that matter most in 3DUIs, and help develop new methodologies for evaluating their effectiveness. It will open up 3D content production to new users. Consider that current computer-aided design (CAD) and 3D modeling tools are used in virtually all fields of engineering to design artefacts prior to the finished product, but require extensive training. Similarly, 3DUIs are nearly ubiquitous in video games, which usually involve at least navigation of a 3D environment. Gaming alone represents a $2.3 billion industry in Canada. This work will help understand what makes these UIs effective, how to further improve them, and how to leverage their effectiveness in other novel 3DUI systems.