Towards "Walk-Up" Usable 3D User Interfaces

从桌面应用到沉浸式虚拟现实(VR)，许多交互式计算机系统都需要三维用户界面(3DUI)。虽然VR和相关技术(如增强现实)正在兴起，但桌面3DUI现在是具有有效用户界面的成熟技术。*本研究计划的目标是在桌面界面和空间界面之间相遇，开发新颖而有效的可步行使用的3DUI。这项工作主要有三个方面。第一种是利用过去对延迟、输入噪声、触觉反馈和疲劳等因素进行调查的结果，为3DUI设计改进的交互技术。例如，空间输入在长时间使用时会产生疲劳，如果没有触觉反馈，就很难确定对象深度。相反，忽略深度输入(例如，简单地在视觉上将手与对象对齐)可以增强3DUI的可用性。人工视觉反馈(例如，在触摸时改变对象颜色)有助于减少对触觉反馈的需求。简单的手势(指向、滑动)提供了强大的助记力，避免了使用模式或使用窗口和图标等2D UI人工制品扰乱3D环境。本研究将采用这些方法，从而解决虚拟现实广泛应用的两个主要问题：可学习性(虚拟现实高，但桌面3DUI低)和有效性(桌面3DUI高，但虚拟现实低)。第二个方面是在复杂的应用中进一步量化这些因素，扩大如何更好地设计3DUI的知识。*第三个方面是解决VR的“应用问题”。虽然虚拟现实长期以来激发了我们的想象力，但研究人员很难在专业领域(如培训、心理治疗、可视化)之外找到它的实际应用。在一定程度上，这似乎源于使用VR界面与桌面系统相比相对困难。我认为，通过降低用户界面的复杂性，并与工业、教育和医疗等领域的潜在合作伙伴接洽，可能会发现VR和空间技术的新应用领域。*这项工作在许多依赖3D数据视觉表示的领域都有应用。它将量化3DUI中最重要的因素，并帮助开发评估其有效性的新方法。它将向新用户开放3D内容制作。考虑到目前的计算机辅助设计(CAD)和3D建模工具几乎用于所有工程领域，以便在成品之前设计人工制品，但需要进行广泛的培训。同样，3DUI在视频游戏中几乎无处不在，通常至少涉及3D环境的导航。在加拿大，仅游戏一项就代表着23亿美元的产业。这项工作将有助于理解是什么使这些用户界面有效，如何进一步改进它们，以及如何在其他新型3DUI系统中利用它们的有效性。**

Three-dimensional user interfaces (3DUIs) are required in many interactive computer systems, from desktop applications to immersive virtual reality (VR). While VR and related technologies (e.g., augmented reality) are emerging, desktop 3DUIs are now mature technologies with effective UIs.***The objective of this research program is to meet in the middle between desktop and spatial interfaces, and develop novel and effective “walk-up usable” 3DUIs. There are three main aspects of this work. The first is to leverage past results investigating factors such as latency, input noise, tactile feedback, and fatigue to design improved interaction techniques for 3DUIs. For example, spatial input yields fatigue with extended use and it is difficult to determine object depth without tactile feedback. Instead, ignoring depth input (e.g., simply visually lining the hand up with the object) can enhance 3DUI usability. Artificial visual feedback (e.g., changing object colour on touch) helps reduce the need for tactile feedback. Simple gestures (pointing, swiping) offer strong mnemonics and avoid use of modes, or cluttering the 3D environment with 2D UI artefacts such as windows and icons. This research will employ these approaches, thus addressing two major problems in the widespread adoption of VR: learnability (which is high in VR, but low in desktop 3DUIs) and effectiveness (high in desktop 3DUIs, but lower in VR). The second aspect is to further quantify these factors in complex applications, expanding knowledge on how to better design 3DUIs.***The third aspect is addressing the “application problem” of VR. While VR has long captured our imagination, researchers have had a hard time finding practical applications for it outside of specialized domains (e.g., training, psychotherapy, visualization). In part, this seems to stem from the comparatively difficulty in using VR interfaces versus desktop systems. I argue that by reducing UI complexity, and approaching potential collaborators in sectors like industry, education, and health care, new application areas of VR and spatial technologies might be discovered.***This work has application in many domains that rely on visual representation of 3D data. It will quantify factors that matter most in 3DUIs, and help develop new methodologies for evaluating their effectiveness. It will open up 3D content production to new users. Consider that current computer-aided design (CAD) and 3D modeling tools are used in virtually all fields of engineering to design artefacts prior to the finished product, but require extensive training. Similarly, 3DUIs are nearly ubiquitous in video games, which usually involve at least navigation of a 3D environment. Gaming alone represents a $2.3 billion industry in Canada. This work will help understand what makes these UIs effective, how to further improve them, and how to leverage their effectiveness in other novel 3DUI systems.**