Multi-Device interaction in Interactive Physio-Digital Environments

点击翻译按钮获取中文摘要

Interactive spaces, smart devices, internet of things -- the reality is that our world is becoming ever-more-populated with devices that can proactively provide information to end-users and reactively receive input. The challenge with input and output spaces where every surface and every thing is augmented with computation is that this tsunami of computation becomes a cacophony the user can neither comprehend or control. In this grant, I set out a research agenda that seeks explore the limits of personal device computation, world-embedded computation, human physiology, and human cognition to design, prototype and evaluate new immersive and ubiquitous experiences within richly interactive environments. My research activities over the five year interval of this grant will be threefold. 1. I will leverage my expertise in designing gestural interaction on commodity personal devices (wearables, handhelds) to explore both how to communicate affordances and capture input within computationally rich environments. 2. I will prototype domain-specific rich interactive spaces and evaluate these spaces with end-users. 3. I will explore the limits of cognitive load, attention, privacy, aesthetics, and embodiment within these spaces. To explore this vision of a richly interactive yet cognitively manageable world, I will leverage research expertise in qualitative inquiry which I have developed over the past three years to guide design; I will leverage the infrastructure I and collaborators have obtained through an infrastructure grant (CFI/LFI Grant on Fully Interactive Physio-Digital Spaces -- co-investigator) to prototype experiences; and I will leverage current student research thrusts that I supervise in gestural interfaces, information seeking, large display interaction, human-in-the-loop computational intelligence, and gaming to jumpstart research projects. Methodologies will include rapid ethnography to guide design, advanced software and hardware engineering to capture and communicate information, quantitative methods and experiential evaluation techniques to evaluate success, and real-world prototype deployments to broaden the impact and presence of this research.