Multi-Device interaction in Interactive Physio-Digital Environments

互动空间、智能设备、物联网——现实情况是，我们的世界正变得越来越多，这些设备可以主动向最终用户提供信息，并主动接收输入。输入和输出空间的挑战是，每个表面和所有东西都用计算增强，这种计算海啸变成了用户既无法理解也无法控制的杂音。在这笔拨款中，我制定了一个研究议程，旨在探索个人设备计算、世界嵌入式计算、人类生理学和人类认知的极限，以设计、原型和评估在丰富的互动环境中新的沉浸式和无处不在的体验。我的研究活动将在五年的时间间隔内进行三次。1. 我将利用我在设计商品个人设备（可穿戴设备，手持设备）手势交互方面的专业知识，探索如何在计算丰富的环境中传达功能和捕获输入。2. 我将对特定领域的丰富交互空间进行原型化，并与最终用户一起评估这些空间。3. 我将在这些空间中探索认知负荷、注意力、隐私、美学和体现的限制。为了探索这个丰富互动但认知可控的世界的愿景，我将利用我在过去三年中开发的定性调查研究专业知识来指导设计；我将利用我和合作者通过基础设施拨款获得的基础设施（CFI/LFI关于完全互动物理数字空间的拨款——共同研究者）来实现原型体验；我将利用我目前在手势界面、信息搜索、大型显示器交互、人机循环计算智能和游戏方面指导的学生研究项目来启动研究项目。方法将包括指导设计的快速人种学，用于捕获和交流信息的先进软件和硬件工程，用于评估成功的定量方法和经验评估技术，以及用于扩大本研究影响和存在的现实世界原型部署。

Interactive spaces, smart devices, internet of things -- the reality is that our world is becoming ever-more-populated with devices that can proactively provide information to end-users and reactively receive input. The challenge with input and output spaces where every surface and every thing is augmented with computation is that this tsunami of computation becomes a cacophony the user can neither comprehend or control. In this grant, I set out a research agenda that seeks explore the limits of personal device computation, world-embedded computation, human physiology, and human cognition to design, prototype and evaluate new immersive and ubiquitous experiences within richly interactive environments. My research activities over the five year interval of this grant will be threefold. 1. I will leverage my expertise in designing gestural interaction on commodity personal devices (wearables, handhelds) to explore both how to communicate affordances and capture input within computationally rich environments. 2. I will prototype domain-specific rich interactive spaces and evaluate these spaces with end-users. 3. I will explore the limits of cognitive load, attention, privacy, aesthetics, and embodiment within these spaces. To explore this vision of a richly interactive yet cognitively manageable world, I will leverage research expertise in qualitative inquiry which I have developed over the past three years to guide design; I will leverage the infrastructure I and collaborators have obtained through an infrastructure grant (CFI/LFI Grant on Fully Interactive Physio-Digital Spaces -- co-investigator) to prototype experiences; and I will leverage current student research thrusts that I supervise in gestural interfaces, information seeking, large display interaction, human-in-the-loop computational intelligence, and gaming to jumpstart research projects. Methodologies will include rapid ethnography to guide design, advanced software and hardware engineering to capture and communicate information, quantitative methods and experiential evaluation techniques to evaluate success, and real-world prototype deployments to broaden the impact and presence of this research.