In-Situ User Interfaces

越来越需要在进行身体活动的同时访问信息。这可能很简单，比如在烹饪时遵循食谱，在美化环境时浏览Pinterest上的想法，或者更复杂的任务，比如在发动机维修期间被引导或查看复苏陌生人的分步说明。所有这些活动的共同点是，需要在任务或现场互动中仔细阅读信息。当前的计算平台不足以提供现场信息访问。普及的智能手机具有有限的显示器，需要大量的注意力资源，而这些资源可以用于主要活动。此外，这样的设备限制了手用于其他任务，因为用户需要握住设备进行交互。因此，当前装置用于原位活动的大多数适应性改变导致笨拙的物理配置，这在某些情况下是危及生命的（例如，浏览内容或边走边发短信）。** 新兴技术，如头戴式显示器，智能手表或智能纺织品，虽然还不成熟，但为探索现场用户界面设计指南的关键要求提供了早期平台。理想情况下，这样的界面应该将信息集成到用户附近，提供比当前移动的设备上可用的更大的视觉画布，从而减少内容和任务之间的注意力分散，并旨在简化信息交互。然而，还需要开展大量工作，以培养这些技术对现场信息获取的支持。** 我们根据产生此类交互所需的四个关键要求来制定短期目标：内容，演示，交互和社交要求。我们通过重新利用现有媒体（包括教学视频）来满足内容要求。通过智能视觉嵌入来满足呈现要求，智能地将内容与用户活动领域相结合，考虑到显着性并支持用户的空间记忆。交互需求建立在可以将内容与用户活动交织在一起的感官信息之上。我们通过检测共处用户的显著交互来满足社交需求，包括社交包容。**将信息获取整合到我们忙碌的生活中的重要性日益增长，这强烈表明现场用户界面将成为标准的计算范例。拟议的计划将导致在上述四个关键轴的8个项目中培训15名HQP。在人机交互（HCI）、个人和沉浸式视觉分析以及普适计算方面将取得开创性的进展。开发这种下一代计算模式将使我们能够在加拿大可穿戴设备和智能纺织品行业日益重要的领域保持领导地位，并通过开发可以直接改善其社会福祉的技术来帮助加拿大人。*****

There is a growing need for accessing information while carrying out a physical activity. This could be as simple as following a recipe while cooking, browsing ideas on Pinterest while landscaping, or more complex tasks such as being guided during engine repair or viewing stepwise instructions for resuscitating a stranger. Common among all these activities, is the need to peruse information in the midst of a task, or in-situ interaction.******Current computing platforms do not adequately provide in-situ information access. The pervasive smartphone has a limited display, requiring significant attentional resources that could instead be used on the primary activity. Furthermore, such devices limit the use of hands for other tasks, as users need to hold the device for interaction. As a result, most adaptations of current devices for in-situ activity result in awkward physical configurations, which in some cases are life-threatening (e.g., browsing content or texting while walking). ******Emerging technologies, such as head-worn displays, smartwatches or smart-textiles, although not mature yet, offer an early platform for exploring the key requirements for developing design guidelines for in-situ user interfaces. Ideally such interfaces should integrate information into the user's vicinity, providing a larger visual canvas than that available on current mobile devices, thereby reducing split attention between content and task, and designed to ease information interaction. However, much work is needed to cultivate in such technologies support for in-situ information access. ******We frame our short-term goals in terms of four key requirements needed to engender such types of interactions: Content, Presentation, Interaction and Social Requirements. We address Content requirements through means of repurposing existing media, including instructional videos. Presentation requirements are met through smart visual embeddings, that intelligently intermesh content in the user's field-of-activity, taking into account saliency and supporting users' spatial memory. Interaction requirements build off sensory information that can interleave content with user activity. We address Social requirements, including social inclusion, through means of detecting salient interactions of co-located users.******The growing importance of integrating information acquisition into our busy lives suggests strongly that in-situ user interfaces will become a standard computing paradigm. The proposed program will lead to training 15 HQP in 8 projects across the above four key axes. Pioneering advances will be made in Human-Computer Interaction (HCI), Personal and Immersive Visual Analytics, and Ubiquitous Computing. Developing this next generation computing paradigm will enable us to maintain a leadership position in fields of growing importance to the Canadian wearables and smart-textiles industries, and help Canadians by developing technologies that can directly improve their social well-being. *****