Towards "Walk-Up" Usable 3D User Interfaces

点击翻译按钮获取中文摘要

Three-dimensional user interfaces (3DUIs) are required in many interactive computer systems, from desktop applications to immersive virtual reality (VR). While VR and related technologies (e.g., augmented reality) are emerging, desktop 3DUIs are now mature technologies with effective UIs. The objective of this research program is to meet in the middle between desktop and spatial interfaces, and develop novel and effective “walk-up usable” 3DUIs. There are three main aspects of this work. The first is to leverage past results investigating factors such as latency, input noise, tactile feedback, and fatigue to design improved interaction techniques for 3DUIs. For example, spatial input yields fatigue with extended use and it is difficult to determine object depth without tactile feedback. Instead, ignoring depth input (e.g., simply visually lining the hand up with the object) can enhance 3DUI usability. Artificial visual feedback (e.g., changing object colour on touch) helps reduce the need for tactile feedback. Simple gestures (pointing, swiping) offer strong mnemonics and avoid use of modes, or cluttering the 3D environment with 2D UI artefacts such as windows and icons. This research will employ these approaches, thus addressing two major problems in the widespread adoption of VR: learnability (which is high in VR, but low in desktop 3DUIs) and effectiveness (high in desktop 3DUIs, but lower in VR). The second aspect is to further quantify these factors in complex applications, expanding knowledge on how to better design 3DUIs. The third aspect is addressing the “application problem” of VR. While VR has long captured our imagination, researchers have had a hard time finding practical applications for it outside of specialized domains (e.g., training, psychotherapy, visualization). In part, this seems to stem from the comparatively difficulty in using VR interfaces versus desktop systems. I argue that by reducing UI complexity, and approaching potential collaborators in sectors like industry, education, and health care, new application areas of VR and spatial technologies might be discovered. This work has application in many domains that rely on visual representation of 3D data. It will quantify factors that matter most in 3DUIs, and help develop new methodologies for evaluating their effectiveness. It will open up 3D content production to new users. Consider that current computer-aided design (CAD) and 3D modeling tools are used in virtually all fields of engineering to design artefacts prior to the finished product, but require extensive training. Similarly, 3DUIs are nearly ubiquitous in video games, which usually involve at least navigation of a 3D environment. Gaming alone represents a $2.3 billion industry in Canada. This work will help understand what makes these UIs effective, how to further improve them, and how to leverage their effectiveness in other novel 3DUI systems.