Human-Computer Interaction in Spatial Augmented Reality

空间增强现实中的人机交互

• 批准号: RGPIN-2018-05187
• 负责人: Vogel, Daniel
• 金额: $ 6.99万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=750233
• 关键词: Human; Computer; Interaction; Spatial; Augmented

We are at the dawn of the next computing paradigm, where everything around us will be augmented with digital information. Instead of an augmented reality viewable only through a phone or special glasses, multiple projector-camera units will place addressable pixels on arbitrary objects and surfaces to create a Spatial Augmented Reality (SAR). This will mean a revolutionary change in how we access digital information. For example: a sterile and clutter-free way for surgical pre-visualizations to be accessed during an operation; a ubiquitous display method for smart homes and the internet of things; a more flexible and accessible use of display space in offices and design studios; and new possibilities for training and customization in human-powered manufacturing and maintenance. Companies are developing SAR display technologies now, but displaying information is only part of the solution. There is a fundamental open question for Human-Computer Interaction (HCI) research: “How should human input be integrated into SAR?” The candidate has already secured funds to build a $1.8 million facility to conduct HCI research in non-immersive, interactive SAR (which we call Fully Interactive Physio-digital Spaces, or “FIPS”). The proposed research program supports HQP to use this state-of-the-art facility to specifically explore SAR input and interaction when performed at a distance. The two objectives are: contribute empirical results which characterise and model distant input; and invent distant interaction techniques that are practical, usable, comfortable, and efficient. These objectives will be pursued as three streams of work, each focused on one input context. Stream 1 focuses on device-based input, and explores using a smartwatch to manipulate content in SAR (as a technology that is currently practical), as well as inventing a totally new type of hand-held device inspired by the candidate's contact-sensing “Conté”. The focus of stream 2 is hand-based input, which investigates key research problems when using bare hands to interact in SAR: mode-switching, visual feedback, and the best style of hand-based interaction. Stream 3 looks at how implicit whole-body poses (like sitting or standing) and explicit body movements (like foot taps) can augment and refine techniques from streams 1 and 2. Finally, a capstone topic ties all results together in an exemplar SAR demonstration application and encodes findings in a HCI SAR development toolkit.The proposed research program will train 4 PhD, 3 Master's, and multiple undergraduates in core HCI research skills by inventing the future of HCI in a cutting-edge technology facility. The results of the proposed research will be a greater understanding for the potential of SAR interaction based on human needs and capabilities, and ultimately, the invention of new interaction techniques and methods to lead the way towards commercial applications.

我们正处于下一个计算范式的黎明，我们周围的一切都将被数字信息增强。与只能通过手机或特殊眼镜观看的增强现实不同，多个投影仪相机单元将在任意物体和表面上放置可寻址像素，以创建空间增强现实（SAR）。这将意味着我们获取数字信息的方式发生革命性的变化。举例来说：一种无菌和无杂波的方式，用于在手术期间访问手术预可视化;智能家居和物联网的无处不在的显示方法;办公室和设计工作室中显示空间的更灵活和可访问的使用;以及人力制造和维护中培训和定制的新可能性。公司现在正在开发SAR显示技术，但显示信息只是解决方案的一部分。人机交互（HCI）研究中有一个基本的开放问题：“如何将人类输入集成到SAR中？”候选人已经获得了180万美元的资金，用于在非沉浸式交互式SAR（我们称之为完全交互式生理数字空间，或“FIPS”）中进行HCI研究。拟议的研究计划支持HQP使用这种最先进的设施，专门探讨SAR输入和互动时，在距离进行。这两个目标是：贡献经验性的结果，验证和模拟远程输入;并发明实用，可用，舒适和有效的远程交互技术。这些目标将作为三个工作流来实现，每个工作流侧重于一个投入背景。流1专注于基于设备的输入，并探索使用智能手表来操作SAR中的内容（作为目前实用的技术），以及发明一种全新类型的手持设备，灵感来自候选人的接触感应“Conté”。流2的重点是基于手的输入，它调查了在SAR中使用徒手交互时的关键研究问题：模式切换，视觉反馈和基于手的交互的最佳风格。流3着眼于隐含的全身姿势（如坐或站）和显式的身体动作（如踢腿）如何增强和改进流1和流2中的技术。最后，一个顶点主题将所有结果联系在一起，在一个典型的SAR演示应用和编码的HCI SAR开发toolkit.The拟议的研究计划将培养4个博士，3个硕士，和多个核心HCI研究技能的本科生通过发明未来的HCI在一个尖端的技术设施。拟议研究的结果将是更好地了解基于人类需求和能力的SAR交互潜力，并最终发明新的交互技术和方法，引领商业应用。