Touching the 3rd Dimension (T3D) - Design and Analysis of Perceptually-Inspired Interaction Concepts for Stereoscopic Multi-Touch enabled Surfaces

两种技术主导了最近的科技展览和娱乐市场：多点触摸表面和3D立体显示器。目前，这些有前途的技术结合在不同的设置，第一个商业系统是支持（多）触摸交互以及立体显示。最近的研究项目解决了用户如何在二维触摸表面上与立体显示的三维内容交互的技术问题。结合多点触摸表面和3D立体显示器的方法具有很大的潜力，可以为广泛的应用提供合理和自然的交互，例如在娱乐、规划和设计、教育和决策中。它还可以应用于不同的用户界面系统，从3D桌面环境到更具沉浸式协作的大型桌面或其他基于投影的设置。 尽管支持立体多点触摸的表面引起若干感知冲突，例如视觉-触觉或视向-聚散冲突，但是由于它们的潜力以及对人类用户的吸引力，它们将在各种设置中进一步主导未来的用户界面是合理的。到目前为止，大多数方法还没有考虑到所提到的感知冲突，并且在大多数情况下，它们的焦点局限于触摸的实际时刻（即，当手指触摸表面时），而触摸之前的基本时间段很少被考虑。显然，在立体显示的情况下，这些时刻特别重要，因为大多数虚拟对象不是在表面上呈现，而是在表面之前或之后呈现。因此，触摸虚拟对象和触摸物理表面通常发生在交互期间的不同时刻。使用这一组合的好处、挑战和局限性尚未得到深入研究，迄今为止也没有得到很好的理解。因此，触摸第三维（T3 D）项目旨在通过分析触摸生命周期（即预触摸）以及实际触摸阶段的感知方面来解决这些问题。一方面，我们打算设计和评估不同的交互概念的立体多点触摸功能的表面上的用户的感知限制的基础上，另一方面，我们将利用我们的设置，以获得新的见解触摸和感知的性质在真实的世界。此外，我们还将探索潜在的应用领域，特别是城市建模和计算机辅助设计（CAD）领域的3D建模。

Two technologies have dominated recent tech exhibitions as well as the entertainment market: multi-touch surfaces and 3D stereoscopic displays. Currently, these promising technologies are combined in different setups, and first commercial systems are available that support (multi-)touch interaction as well as stereoscopic display. Recent research projects address technological questions of how users interact with stereoscopically displayed three-dimensional content on a two-dimensional touch surface. The approach of combining multi-touch surfaces and 3D stereoscopic displays has great potential to provide plausible as well as natural interaction for a wide range of applications, e.g. in entertainment, planning and design, education, and decision-making. It can also be applied to different user interface systems ranging from 3D desktop environments to more immersive collaborative large tabletop or other projection-based setups. Although stereoscopic multi-touch enabled surfaces induce several perceptual conflicts, e.g. visual-haptic or accommodation-vergence conflicts, it is reasonable that they will further dominate future user interfaces in various settings due to their potential as well as attractiveness for human users. So far most approaches have not taken into account the mentioned perceptual conflicts and are in most cases limited in their focus on the actual moment of touch (i.e. when the finger touches the surface), whereas the essential time period before the touch is rarely considered. Obviously - in the case of stereoscopic display - these moments are particularly important since most virtual objects are rendered not on the surface, but before or behind it. Hence, usually touching virtual objects and touching the physical surface occur at different moments during the interaction. The benefits, challenges and limitations of using this combination have not been examined in-depth and are so far not well understood so far. The project Touching the 3rd Dimension (T3D) therefore aims to address these questions by analyzing the perceptual aspects during the lifetime of a touch, i.e. the pre-touch, as well as the actual touch phase. On the one hand we intend to design and evaluate different interaction concepts for stereoscopic multi-touch enabled surfaces based on perceptual limitations of the user, and on the other hand we will exploit our setup to gain novel insights into the nature of touch and perception in the real world. In addition we will explore potential application areas, in particular 3D modeling in the domains of city modeling and computer-aided design (CAD).