Multi channel and multi degree-of-freedom user interfaces for heterogeneous display environments

我们的计算环境越来越多样化，包括具有各种尺寸、分辨率和形状因子的显示器。就尺寸和分辨率而言，这些范围从手表上的微小低分辨率显示器到由多个拼接投影仪驱动的巨大高分辨率墙壁大小的显示器。形状因素也越来越多地变化，范围从可以在任何位置、位置和取向中使用的高度便携式显示器到在水平（例如，桌面）或垂直格式。此外，投影仪变得越来越小，允许用户在任何位置创建可变大小的动态显示。尽管显示器有这种多样性，但我们目前使用的用户界面几乎没有什么不同，而不管显示器的特性如何，并且倾向于依赖于一个或至多两个输入通道（例如，键盘和鼠标/笔）。此外，当前的用户界面不支持以一致的整体方式无缝使用多个异构显示器。最终结果是用户不能在其计算环境中最大限度地利用多个显示器。建议的研究旨在开发多通道和多自由度的用户输入和交互技术，使用户能够有效地工作在计算环境中的各种异构显示。该研究将调查单人使用的用户界面，以及支持多人在这种环境中协作工作的界面。除了明确的互动，我们还打算专注于在这些空间中进行更多环境和微妙互动的技术。该方法将包括探索性用户研究，更好地了解人类用户在这些环境中工作时的能力，开发交互性能的预测模型，以及新界面的迭代设计。

Our computing environments are increasingly diversifying to include displays with a variety of sizes, resolutions, and form-factors. In terms of size and resolution, these range from tiny low-resolution displays found on watches to gigantic high-resolution wall-size displays driven by multiple tiled projectors. Form factors are also increasingly varied, ranging from highly portable displays that can be used in any location, position and orientation, to more static displays used in either a horizontal (e.g., tabletop) or vertical format. In addition, projectors are getting increasingly smaller, allowing users to create dynamic displays of variable size at any location. Despite this diversity in displays, the user interfaces we currently use differ very little regardless of the display's characteristics, and tend to rely on one or at most two channels of input (e.g., keyboard and mouse/pen) with limited degrees-of-freedom. Furthermore, current user interfaces do not support the seamless use of multiple heterogeneous displays in a coherent holistic manner. The net result is that users are unable to utilize the multiple displays in their computing environment to their fullest potential. The proposed research intends to develop multi channel and multi degree-of-freedom user input and interaction techniques to allow users to work effectively in computational environments consisting of a variety heterogeneous displays. The research will investigate user interfaces for single person use, as well as interfaces to support multiple people working collaboratively in such environments. In addition to explicit interaction, we also intend to focus on techniques for more ambient and subtle interaction in these spaces. The methodology will include exploratory user studies better understand the human user's capabilities when working in these environments, developing predictive models of interaction performance, and the iterative design of new interfaces.