The Multimodal Approach of Rendering Soft Textures on Touch Displays

在触摸显示器上渲染软纹理的多模式方法

• 批准号: 498783029
• 负责人: Professor Dr.-Ing. Ercan Altinsoy
• 金额: --
• 依托单位: Professur für Akustik und Haptik
• 依托单位国家: 德国
• 项目类别: Research Grants
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/498783029?language=en
• 关键词: Multimodal; Approach; Rendering; Soft; Textures

Touch devices are becoming one of the most significant accessory of our daily lives due to being capable of running numerous tasks and being portable as opposed to computers. Nowadays, they are easily accessible, cheap and programmable input tools being used at various electronic devices. However, increasing number of applications and software have begun including complicated and critical tasks, and these tasks have been mostly operated on displays based on only visual cues. However, for more reliable and comfortable human-display interaction, precise haptic feedback should be promptly implemented to touch displays. For instance, reproducing tactile texture sensation on displays has been an emerging topic in the haptic field. In the last decade, landmark studies introduced measurement-based rendering techniques that enabled creating realistic haptic textures by recording surface information. However, such methods inevitably blend perceptually redundant data with the necessary texture information. Therefore, the first goal of this study is to determine the perceptual limits of the tactile sensation so that necessary amount of information can be driven for creating plausible texture feeling on displays. This goal will be also investigated using auditory feedback due to the fact that perceiving a texture is a complex fusion process of tactile and auditory modalities. Previously, various studies showed the effect of auditory feedback on tactile texture perception. Thanks to this effect, the influence of auditory feedback on further tactile data simplification and augmenting the plausibility of vibrations will be evaluated. Another concern of this study arises from the fact that touch displays have been limited with tactile feedback due to their fixed glass surface as opposed to traditional kinesthetic devices. Lately, several studies introduced different implementation ideas of kinesthetic feedback on touch displays, and these studies validated their actuation mechanisms using only simple stiffness models. Apart from these kinesthetic displays, even traditional force feedback devices have been used to render soft materials using linear second-order stiffness model which is commonly used to replicate the dynamics in the environment. On the other hand, soft materials cannot be well-described using linear models due to their nonlinear viscoelastic properties. Because of this, precise softness effect may not be generated on any kinesthetic devices. Thus, the second goal of this study is to reproduce realistic softness effect corresponding to various soft materials on touch displays. This aim will be realized by investigating human stiffness sensation and various non-linear stiffness models to mimic softness response precisely avoiding unnecessary complex models producing unperceivable details. At the end of this study, perception-based multimodal soft texture rendering strategy will be established.

触摸设备正在成为我们日常生活中最重要的配件之一，因为它能够运行许多任务，并且与计算机相反，它是便携式的。如今，它们是在各种电子设备中使用的容易获得、便宜且可编程的输入工具。然而，越来越多的应用程序和软件已经开始包括复杂和关键的任务，并且这些任务大多仅基于视觉提示在显示器上操作。然而，为了更可靠和舒适的人机交互，精确的触觉反馈应该被及时地实现到触摸显示器。例如，在显示器上再现触觉纹理感觉已经是触觉领域中的新兴主题。在过去的十年中，具有里程碑意义的研究介绍了基于测量的渲染技术，使创建逼真的触觉纹理记录表面信息。然而，这样的方法不可避免地混合感知冗余数据与必要的纹理信息。因此，本研究的第一个目标是确定触觉的感知极限，以便能够驱动必要的信息量，以在显示器上创建合理的纹理感觉。这一目标也将使用听觉反馈进行研究，因为感知纹理是触觉和听觉模态的复杂融合过程。以前，各种研究表明听觉反馈对触觉纹理感知的影响。由于这种效果，听觉反馈对进一步的触觉数据简化和增强振动的可扩展性的影响将被评估。这项研究的另一个关注点是，与传统的动觉设备相比，触摸显示器由于其固定的玻璃表面而受到触觉反馈的限制。最近，一些研究介绍了不同的实现思路的动觉反馈的触摸显示器，这些研究验证了他们的驱动机制，使用简单的刚度模型。除了这些动觉显示器之外，甚至传统的力反馈设备也被用于使用线性二阶刚度模型来渲染软材料，该模型通常用于复制环境中的动态。另一方面，由于软材料的非线性粘弹性特性，使用线性模型不能很好地描述软材料。因此，在任何动觉设备上可能不会产生精确的柔软效果。因此，本研究的第二个目标是再现触摸显示器上的各种软材料对应的真实柔软效果。这一目标将通过研究人体的刚度感觉和各种非线性刚度模型来实现，以精确地模拟柔软度响应，避免不必要的复杂模型产生不可感知的细节。在本研究的最后，将建立基于感知的多模态软纹理绘制策略。