Saliency-Driven Real-Time Video-to-Tactile Translation
Saliency-Driven Real-Time Video-to-Tactile Translation
复制标题
显着性驱动的实时视频到触觉翻译
DOI：
--
复制
发表时间：
2014
影响因子：
2.9
通讯作者：
Seungmoon Choi
中科院分区：
文献类型：
--
作者：
Myongchan Kim;Sungkil Lee;Seungmoon Choi
触觉反馈与视觉刺激相协调，已经证明了它在调解沉浸式多模态体验方面的价值，但它的创作依赖于内容艺术家。本文提出了一个完全自动化的框架，从流图像生成触觉线索，以提供同步的视觉触觉刺激在真实的时间。视频图像的时空特征进行分析的基础上的视觉显着性，然后映射到触觉提示，安装在椅子上的触觉器呈现。我们还进行了两个用户实验的性能评估。第一个实验研究了视觉触觉渲染对仅视觉渲染的影响，表明视觉触觉渲染改善了电影观看体验，使其更有趣，更身临其境，更容易理解。第二个实验进行创作方法的有效性进行比较，发现自动创作的方法，小心使用，可以产生合理的触觉效果类似的质量手动创作。
Tactile feedback coordinated with visual stimuli has proven its worth in mediating immersive multimodal experiences, yet its authoring has relied on content artists. This article presents a fully automated framework of generating tactile cues from streaming images to provide synchronized visuotactile stimuli in real time. The spatiotemporal features of video images are analyzed on the basis of visual saliency and then mapped into the tactile cues that are rendered on tactors installed on a chair. We also conducted two user experiments for performance evaluation. The first experiment investigated the effects of visuotactile rendering against visual-only rendering, demonstrating that the visuotactile rendering improved the movie watching experience to be more interesting, immersive, and understandable. The second experiment was performed to compare the effectiveness of authoring methods and found that the automated authoring approach, used with care, can produce plausible tactile effects similar in quality to manual authoring.