High-Performance Spatial Hybrid User Interfaces

与三维（3D）空间数据的交互越来越普遍。空间数据对许多领域都很重要，包括室内设计、建筑、城市规划、工业规划和设计、模拟、培训、动画、游戏和娱乐产业，以及新的“创客”运动。然而，空间数据的用户界面复杂、难以学习或功能有限。我的研究项目是为3D内容研究更好的空间用户界面。*新的空间混合用户界面是用户界面的组合，用户可以在空中快速操作虚拟对象，具有最好的桌面用户界面。为了实现像二维界面一样高效的空间用户界面的愿景，该研究项目涉及三个主要重点：基本操作的表征、准确的交互和新技术。*第一个推力研究当前的基本空间交互技术，如3D旋转、对接和旅行，在速度和准确性方面的表现如何。此外，该研究还调查了空中界面和桌面界面之间的转换速度有多快，以及手势作为按钮和键的替代品有多可靠。虽然空中操纵看起来很有吸引力，但现有的实验数据表明，它缺乏精度。因此，我们在第二次推力中研究了空气和桌面界面的混合组合，其中桌面界面用于对最终结果进行微调。这样的组合将产生用于3D内容创建和编辑的混合空间用户界面，既快速又精确。此外，我们还研究了解决深度模糊的新技术，以及在单视角和立体视角之间切换的新技术。这项研究计划的最后推力是研究手指和笔的新跟踪技术，目的是进一步提高跟踪精度。*我的研究项目的基本贡献将是对现有和新的空间交互技术的吞吐量进行准确的量化，对交互方法进行评估的新方法，新颖的设计指南，以及新技术。总之，这项工作构成了向高性能空间用户界面迈出的重要一步，这些界面仍然易于学习。*更好的空间用户界面将增加非专业人士对3D建模的可访问性，这反过来将加速大众对3D内容操作和创作的采用，例如，由新的制造商/3D打印运动驱动。此外，3D内容制作和游戏是加拿大的核心优势。加拿大将通过许多在用户界面设计和3D图形方面具有全球竞争力的HQP，以及潜在的启动，从这里提出的研究计划中受益。此外，结果的广泛适用性将增加对科学和技术学科的兴趣。

Interaction with three-dimensional (3D), spatial data is increasingly common. Spatial data are important for many sectors, including interior design, architecture, urban planning, industrial planning and design, simulation, training, animation, the game and entertainment industry, and the new "maker" movement. Yet, user interfaces for spatial data are complex, difficult to learn, or limited in functionality. My research program investigates better spatial user interfaces for 3D content. *The new spatial hybrid user interfaces are a combination of user interfaces, where the user manipulates virtual objects quickly in the air, with the best of desktop user interfaces. Working towards the vision of spatial user interfaces that are efficient as 2D interfaces, the research program involves three main thrusts: characterization of basic operations, accurate interaction, and new technologies.*The first thrust investigates how well current, basic spatial interaction techniques, such as 3D rotations, docking, and travel, perform in terms of speed and accuracy. Moreover, the research also investigates how fast transitions between in-air and desktop interfaces are and how reliable gestures are as a substitute for buttons and keys. While in-air manipulation seems attractive, the available experimental data points to a lack of precision. Thus, we investigate hybrid combinations of in-air and desktop interfaces in the second thrust, where the desktop interface is used for fine-tuning of the final result. Such combinations will yield hybrid spatial user interfaces for 3D content creation and editing that are both fast and precise. Moreover, we study new techniques for resolving depth ambiguities and switching between mono- and stereoscopic viewing. The final thrust of this research program investigates new tracking technologies for fingers and pens, with the aim to further increase tracking accuracy.*The fundamental contributions of my research program will be accurate quantifications of the throughput of existing and new spatial interaction techniques, new methodologies for evaluation of interaction methods, novel design guidelines, as well as new technologies. Together, the work constitutes a major step forward towards high-performance spatial user interfaces that are still easy to learn. *Better spatial user interfaces will increase the accessibility of 3D modeling for non-specialists, which in turn will accelerate the adoption of 3D content manipulation and creation by the general public, e.g., driven by the new maker/3D printing movement. Moreover, 3D content creation and gaming are core Canadian strengths. Canada will benefit from the research program presented here through many globally competitive HQP in user interface design and 3D graphics, as well as a potential startup. Also, the broad applicability of the results will increase interest in science and technical disciplines.