Exploring Human Perception and Interaction in Multi-Device Environments

今天的计算设备还没有完全实现早期计算机科学家和工程师所设想的潜力，当时他们设想了一个计算基础设施无缝支持我们日常计算需求的世界；移动的、便携的、大型的、共享的设备充斥着我们的生活，但很少一起使用。例如，口袋里的智能手机和附近的平板电脑可能包含重要数据，但无法轻松地与附近的交互式电视连接，以便与同事共享，即使无线网络可用。这些互动有助于释放存储在小型设备上的数据的潜力，这些设备附近有大型显示器。即使允许这样的交互，也不清楚应该如何设计软件来实现跨设备的数据共享，以及这样做是否会影响用户准确有效地利用数据的能力。***这项研究探索了人类与分布在多个设备上的数据进行交互和感知的能力，最终目标是实现跨设备交互。我们将开发三套测试平台，用于进行受控的实证研究，以调查在三种情况下个人和共享设备上的人类感知和互动。第一个系列的实验将在实验室环境中探索交互作用，重点研究人类感知的各个方面，如大小判断、视觉搜索、阅读理解和导航。第二和第三个系列的实验将探索应用环境中的交互作用，与工业伙伴合作，其中模拟任务将用于确定跨设备信息的负面影响。通过开发这样的理解，我们将为支持协同工作的多设备软件系统的设计提供信息，例如数据分析、命令和控制以及应急响应，其中信息被分配到任意数量的个人、设备或显示器上。**

Today's computing devices have not fully realized the potential imagined by early computer scientists and engineers when they imagined a world in which computing infrastructure seamlessly supported our everyday computing needs; mobile, portable, and large, shared devices pervade our lives yet are rarely used together. For example, a smartphone in your pocket and a nearby tablet might contain important data, but cannot easily interface with a nearby interactive TV for sharing with co-workers, even though wireless networks are readably available. These interactions are useful in unlocking potential from data stored on small devices with nearby large displays. Even if such interactions were allowed, it is unclear how software should be designed to enable cross-device sharing of data and whether doing so may impact a user's ability to accurately and effectively utilize data. ***This research explores human ability to interact and perceive with data that is spread across multiple devices, with the goal of ultimately enabling cross-device interaction. We will develop three sets of test-beds that will be used to conduct controlled, empirical studies that investigate human perception and interaction across personal and shared devices in three contexts. The first series of experiments will explore interaction in laboratory setting, with carefully focused studies on aspects of human perception such as magnitude judgement, visual search, reading comprehension, and navigation. The second and third series of experiments will explore interaction in an applied setting, in collaboration with industrial partners, where simulated tasks will be used to determine negative effects of cross-device information. Finally, results will be ecologically validated by conducting By developing such an understanding, we will inform the design of multi-device software systems that support collaborative work, such as data analytics, command and control, and emergency response, where information is divided across any number of individuals, devices, or displays. **