Fostering Person-Centric User Experiences and Interaction On, Across, and in the Spaces Between Devices in Fragmented Digital Landscapes

想象一下，你是一个励志演说家，在演讲时漫步在舞台上。你可以使用投影仪进行演讲，但只有你和你的听众才能看到你的幻灯片。如果您连接了智能手机，则可以看到幻灯片列表、演讲者备注，并通过在智能手机屏幕上滑动来切换幻灯片。如果你在这个组合中添加了一个智能手表，那么它可以显示当前时间以及你的演讲还剩多长时间。如果你戴上一个头戴式显示器，比如谷歌眼镜，它可以在你自己的私人电话上显示你的演讲者笔记，而不是在你的智能手机上。如果你突然想解放双手，你可以把智能手机放在一边，你的幻灯片列表可以出现在你的谷歌眼镜上，你可以点击眼镜的镜腿来切换幻灯片。在这种情况下，您可以选择使用哪些设备，在哪些时间以及用于哪些目的，可以自由忽略后台所需的软件和交互。虽然这个例子提供了一个简单、统一的体验，但如果我们考虑到我们一天中可能遇到的其他任务、场景和可用设备的集合，那么对开发人员来说，开发和设计能够满足我们无限需求的应用程序的任务即使不是不可能，也是一项艰巨的任务。为了让这种统一的用户体验成为现实，我过去的研究项目，设备的交响乐，调查了当我们与多个设备交互和互动时出现的需求和机会。它导致了新的方法，可以用来创作应用程序的行为，结合不同的设备集合，也导致了新的算法，使软件可以优化自己，以最好地适应我们现有的设备。虽然这项研究帮助我们更接近单一、统一的用户体验，但许多用户仍然认为应用程序和数字内容被锁定在特定设备上，而不是自由地存在于我们的环境中，我们能够将设备用作这些数字产品的窗口或门户。因此，本研究的目标是协调我们所处的分散的数字景观，以便我们可以可视化并获得有关我们可以访问的数字文物的反馈，我们可以在我们的设备上、跨设备和设备之间无缝地与这些文物进行交互。在我们的空间中，我们可以与其他人合作，无论他们是远程的还是并列的。 由于这种统一的体验应该将我们的日常体验与这些体验的数字增强无缝融合，我将使用混合现实技术，例如，增强现实耳机、虚拟现实环境等，以确保我们可以通过基于其固有功能选择我们想要使用的设备来创作和选择必要的应用行为，而不是使用具有我们所需软件功能的设备。

Imagine you are a motivational speaker roaming a stage while giving a talk. You could give your talk using a projector, but then only you and your audience would see your slides. If you connected a smartphone, then you could see a list of your slides, your speaker notes, and switch between slides by swiping on the smartphone's screen. If you added a smartwatch to the mix, then it could show you the current time and how long you have left in your talk. If you put on a head-mounted display, such as Google Glass, it could display your speaker notes on your own private teleprompter rather than on your smartphone. If you suddenly wanted your hands free, you could put the smartphone away, your list of slides could appear on your Google Glass, and you could tap on the temple of your glasses to switch slides. In this scenario, you get to choose which devices you use, at which times, and for which purposes, being free to ignore the software and interactions that are needed behind the scenes. Although this example presents one simple, unified experience, if we consider the other tasks, scenarios, and collections of available devices that we could encounter throughout our day, then the task of foreseeing and designing applications that can tailor themselves to meet our limitless needs becomes a daunting, if not impossible, activity for developers. To make such unified user experiences a reality, my past research project, the Symphony of Devices, investigated the needs and opportunities that arise when we interact and engage with multiple devices. It led to new methods that could be used to author application behaviors that combined different collections of devices and also resulted in new algorithms so that software could optimize its itself to best fit the devices that we have available. While this research helped to bring us closer to a single, unified user experience, many users still view applications and digital content as locked to a specific device rather than freely existing in our environments and us being able to use devices as windows or portals to these digital artifacts. Therefore, the goal of this research is to harmonize the scattered digital landscapes that we all find ourselves in so that we can visualize and get feedback about the digital artifacts we have access to, we can seamlessly interact with these artifacts on, across, and between our devices and in our spaces, and we can collaborate with others, regardless of if they are remote or collocated. As this unified experience should seamlessly blend our everyday experiences with digital augmentations of those experiences, I will use mixed reality technologies, e.g., augmented reality headsets, virtual reality environments, and so on, to ensure that we can author and select necessary application behaviours by choosing the devices we want to use based on its inherent capabilities, rather than using the devices that have the software functionality we need.