Exploring Human Perception and Interaction in Multi-Device Environments

点击翻译按钮获取中文摘要

Today's computing devices have not fully realized the potential imagined by early computer scientists and engineers when they imagined a world in which computing infrastructure seamlessly supported our everyday computing needs; mobile, portable, and large, shared devices pervade our lives yet are rarely used together. For example, a smartphone in your pocket and a nearby tablet might contain important data, but cannot easily interface with a nearby interactive TV for sharing with co-workers, even though wireless networks are readably available. These interactions are useful in unlocking potential from data stored on small devices with nearby large displays. Even if such interactions were allowed, it is unclear how software should be designed to enable cross-device sharing of data and whether doing so may impact a user's ability to accurately and effectively utilize data.  This research explores human ability to interact and perceive with data that is spread across multiple devices, with the goal of ultimately enabling cross-device interaction. We will develop three sets of test-beds that will be used to conduct controlled, empirical studies that investigate human perception and interaction across personal and shared devices in three contexts. The first series of experiments will explore interaction in laboratory setting, with carefully focused studies on aspects of human perception such as magnitude judgement, visual search, reading comprehension, and navigation. The second and third series of experiments will explore interaction in an applied setting, in collaboration with industrial partners, where simulated tasks will be used to determine negative effects of cross-device information. Finally, results will be ecologically validated by conducting By developing such an understanding, we will inform the design of multi-device software systems that support collaborative work, such as data analytics, command and control, and emergency response, where information is divided across any number of individuals, devices, or displays.