Multi channel and multi degree-of-freedom user interfaces for heterogeneous display environments

我们的计算环境越来越多样化，包括各种尺寸、分辨率和形状因素的显示器。在尺寸和分辨率方面，从手表上的小分辨率显示器到由多个平铺投影仪驱动的巨大的高分辨率墙壁显示器。形式因素也越来越多样化，从可用于任何位置、位置和方向的高度便携显示器，到用于水平（例如桌面）或垂直格式的静态显示器。此外，投影仪变得越来越小，允许用户在任何位置创建可变大小的动态显示。尽管显示器有这种多样性，我们目前使用的用户界面差异很小，不管显示器的特性如何，并且倾向于依赖一个或最多两个输入通道（例如，键盘和鼠标/笔），自由度有限。此外，当前的用户界面不支持以连贯的整体方式无缝使用多个异构显示。最终的结果是用户无法在他们的计算环境中充分利用多个显示器。提出的研究旨在开发多通道和多自由度的用户输入和交互技术，以允许用户在由各种异构显示组成的计算环境中有效地工作。该研究将调查供单人使用的用户界面，以及在这种环境中支持多人协同工作的界面。除了明确的互动之外，我们还打算关注在这些空间中进行更多环境和微妙互动的技术。该方法将包括探索性用户研究，以便更好地理解在这些环境中工作时人类用户的能力，开发交互性能的预测模型，以及新界面的迭代设计。

Our computing environments are increasingly diversifying to include displays with a variety of sizes, resolutions, and form-factors. In terms of size and resolution, these range from tiny low-resolution displays found on watches to gigantic high-resolution wall-size displays driven by multiple tiled projectors. Form factors are also increasingly varied, ranging from highly portable displays that can be used in any location, position and orientation, to more static displays used in either a horizontal (e.g., tabletop) or vertical format. In addition, projectors are getting increasingly smaller, allowing users to create dynamic displays of variable size at any location. Despite this diversity in displays, the user interfaces we currently use differ very little regardless of the display's characteristics, and tend to rely on one or at most two channels of input (e.g., keyboard and mouse/pen) with limited degrees-of-freedom. Furthermore, current user interfaces do not support the seamless use of multiple heterogeneous displays in a coherent holistic manner. The net result is that users are unable to utilize the multiple displays in their computing environment to their fullest potential. The proposed research intends to develop multi channel and multi degree-of-freedom user input and interaction techniques to allow users to work effectively in computational environments consisting of a variety heterogeneous displays. The research will investigate user interfaces for single person use, as well as interfaces to support multiple people working collaboratively in such environments. In addition to explicit interaction, we also intend to focus on techniques for more ambient and subtle interaction in these spaces. The methodology will include exploratory user studies better understand the human user's capabilities when working in these environments, developing predictive models of interaction performance, and the iterative design of new interfaces.