In-Situ User Interfaces

人们越来越需要在进行体力活动的同时获取信息。这可以是简单的，比如做饭时遵循食谱，在美化环境时浏览Pinterest上的想法，也可以是更复杂的任务，比如在发动机维修期间得到指导，或者查看抢救陌生人的循序渐进的说明。在所有这些活动中，共同的是需要在任务或现场互动中仔细阅读信息。*目前的计算平台不能充分提供现场信息访问。无处不在的智能手机的显示屏有限，需要大量的注意力资源，而这些资源本可以用于主要活动。此外，这种设备限制了手执行其他任务的使用，因为用户需要握住设备进行交互。因此，当前设备对现场活动的大多数适应都会导致笨拙的物理配置，在某些情况下会危及生命(例如，边走边浏览内容或发短信)。*新兴技术，如头戴式显示器、智能手表或智能纺织品，虽然还不成熟，但为探索制定现场用户界面设计指南的关键要求提供了一个早期平台。理想情况下，这样的界面应该将信息集成到用户附近，提供比当前移动设备上可用的更大的视觉画布，从而减少内容和任务之间的分散注意力，并旨在简化信息交互。然而，在支持现场信息获取的这类技术方面还需要做很多工作。*我们根据产生此类互动所需的四个关键要求来制定我们的短期目标：内容、展示、互动和社交需求。我们通过重新调整现有媒体(包括教学视频)的用途来满足内容要求。通过智能视觉嵌入来满足演示要求，智能视觉嵌入将内容智能地交织在用户的活动领域中，考虑到显着性并支持用户的空间记忆。交互需求建立在可以将内容与用户活动交织在一起的感觉信息上。我们通过检测共存用户的显著交互来满足社交需求，包括社交包容。*将信息获取整合到我们繁忙的生活中的重要性日益增长，这有力地表明，就地用户界面将成为标准的计算范例。拟议的计划将在上述四个关键轴线的8个项目中培训15名HQP。将在人机交互(HCI)、个人和沉浸式视觉分析以及普适计算方面取得开创性进展。开发这一下一代计算模式将使我们能够在对加拿大可穿戴设备和智能纺织品行业日益重要的领域保持领先地位，并通过开发能够直接改善其社会福利的技术来帮助加拿大人。*****

There is a growing need for accessing information while carrying out a physical activity. This could be as simple as following a recipe while cooking, browsing ideas on Pinterest while landscaping, or more complex tasks such as being guided during engine repair or viewing stepwise instructions for resuscitating a stranger. Common among all these activities, is the need to peruse information in the midst of a task, or in-situ interaction.******Current computing platforms do not adequately provide in-situ information access. The pervasive smartphone has a limited display, requiring significant attentional resources that could instead be used on the primary activity. Furthermore, such devices limit the use of hands for other tasks, as users need to hold the device for interaction. As a result, most adaptations of current devices for in-situ activity result in awkward physical configurations, which in some cases are life-threatening (e.g., browsing content or texting while walking). ******Emerging technologies, such as head-worn displays, smartwatches or smart-textiles, although not mature yet, offer an early platform for exploring the key requirements for developing design guidelines for in-situ user interfaces. Ideally such interfaces should integrate information into the user's vicinity, providing a larger visual canvas than that available on current mobile devices, thereby reducing split attention between content and task, and designed to ease information interaction. However, much work is needed to cultivate in such technologies support for in-situ information access. ******We frame our short-term goals in terms of four key requirements needed to engender such types of interactions: Content, Presentation, Interaction and Social Requirements. We address Content requirements through means of repurposing existing media, including instructional videos. Presentation requirements are met through smart visual embeddings, that intelligently intermesh content in the user's field-of-activity, taking into account saliency and supporting users' spatial memory. Interaction requirements build off sensory information that can interleave content with user activity. We address Social requirements, including social inclusion, through means of detecting salient interactions of co-located users.******The growing importance of integrating information acquisition into our busy lives suggests strongly that in-situ user interfaces will become a standard computing paradigm. The proposed program will lead to training 15 HQP in 8 projects across the above four key axes. Pioneering advances will be made in Human-Computer Interaction (HCI), Personal and Immersive Visual Analytics, and Ubiquitous Computing. Developing this next generation computing paradigm will enable us to maintain a leadership position in fields of growing importance to the Canadian wearables and smart-textiles industries, and help Canadians by developing technologies that can directly improve their social well-being. *****