Touching the 3rd Dimension (T3D) - Design and Analysis of Perceptually-Inspired Interaction Concepts for Stereoscopic Multi-Touch enabled Surfaces

两种技术主导了最近的科技展览和娱乐市场：多点触控表面和3D立体显示器。目前，这些前景看好的技术被组合在不同的设置中，并且第一个支持(多)触摸交互以及立体显示的商业系统可用。最近的研究项目解决了用户如何在二维触摸面上与立体显示的三维内容交互的技术问题。组合多点触摸表面和3D立体显示器的方法具有巨大的潜力，可以为广泛的应用，例如在娱乐、规划和设计、教育和决策中提供可信的和自然的交互。它还可以应用于不同的用户界面系统，从3D桌面环境到更具沉浸感的协作大型桌面或其他基于投影的设置。尽管支持立体多点触摸的表面引起了几个感知冲突，例如视觉-触觉或调节-收敛冲突，但由于它们的潜力以及对人类用户的吸引力，它们将在各种环境中进一步主导未来的用户界面是合理的。到目前为止，大多数方法都没有考虑到所提到的知觉冲突，在大多数情况下，它们的关注点仅限于实际的触摸时刻(即当手指接触表面时)，而很少考虑触摸之前的基本时间段。显然，在立体显示的情况下，这些时刻特别重要，因为大多数虚拟对象不是在表面上渲染的，而是在表面之前或之后渲染的。因此，触摸虚拟物体和触摸物理表面通常发生在交互过程中的不同时刻。使用这种组合的好处、挑战和限制尚未得到深入研究，到目前为止也没有得到很好的理解。因此，触摸第三维度(T3D)项目旨在通过分析触摸生命周期中的感知方面，即触摸前以及实际触摸阶段来解决这些问题。一方面，我们打算设计和评估基于用户感知限制的立体多点触控支持表面的不同交互概念，另一方面，我们将利用我们的设置来获得对现实世界中触摸和感知的本质的新见解。此外，我们还将探索潜在的应用领域，特别是在城市建模和计算机辅助设计(CAD)领域的3D建模。

Two technologies have dominated recent tech exhibitions as well as the entertainment market: multi-touch surfaces and 3D stereoscopic displays. Currently, these promising technologies are combined in different setups, and first commercial systems are available that support (multi-)touch interaction as well as stereoscopic display. Recent research projects address technological questions of how users interact with stereoscopically displayed three-dimensional content on a two-dimensional touch surface. The approach of combining multi-touch surfaces and 3D stereoscopic displays has great potential to provide plausible as well as natural interaction for a wide range of applications, e.g. in entertainment, planning and design, education, and decision-making. It can also be applied to different user interface systems ranging from 3D desktop environments to more immersive collaborative large tabletop or other projection-based setups. Although stereoscopic multi-touch enabled surfaces induce several perceptual conflicts, e.g. visual-haptic or accommodation-vergence conflicts, it is reasonable that they will further dominate future user interfaces in various settings due to their potential as well as attractiveness for human users. So far most approaches have not taken into account the mentioned perceptual conflicts and are in most cases limited in their focus on the actual moment of touch (i.e. when the finger touches the surface), whereas the essential time period before the touch is rarely considered. Obviously - in the case of stereoscopic display - these moments are particularly important since most virtual objects are rendered not on the surface, but before or behind it. Hence, usually touching virtual objects and touching the physical surface occur at different moments during the interaction. The benefits, challenges and limitations of using this combination have not been examined in-depth and are so far not well understood so far. The project Touching the 3rd Dimension (T3D) therefore aims to address these questions by analyzing the perceptual aspects during the lifetime of a touch, i.e. the pre-touch, as well as the actual touch phase. On the one hand we intend to design and evaluate different interaction concepts for stereoscopic multi-touch enabled surfaces based on perceptual limitations of the user, and on the other hand we will exploit our setup to gain novel insights into the nature of touch and perception in the real world. In addition we will explore potential application areas, in particular 3D modeling in the domains of city modeling and computer-aided design (CAD).