Haptic Exploration during Fast Video Playback: Vibrotactile Support for Event Search in Robot Operation Videos
Haptic Exploration during Fast Video Playback: Vibrotactile Support for Event Search in Robot Operation Videos
复制标题
快速视频播放期间的触觉探索：振动触觉支持机器人操作视频中的事件搜索
DOI：
10.1109/toh.2019.2957792
复制
发表时间：
2019
影响因子：
2.9
通讯作者：
Tadokoro Satoshi
中科院分区：
文献类型：
--
作者：
Gongora Flores Daniel Marcell;Konyo Masashi;Nagano Hikaru;Tadokoro Satoshi
快速回放允许快速视频浏览，但也会降低短事件的显着性。我们提出了一种在快速视频回放中检测短事件的触觉探索，考虑到使用为音频开发的时间尺度修改(TSM)方法在快速回放过程中可以保留振动触觉反馈中的事件相关信息。我们使用第一人称视角(FPV)视频在两个碰撞检测实验中对我们的建议进行了评估。在第一个实验中，观众以固定的回放速度观看，即安装在平台车上的摄像头拍摄的视频。在这个实验中，我们测量了相机背面与事件相关的振动。在第二个实验中，观众使用媒体控制器来调节模拟移动机器人探索的视频的播放速度。在这个实验中，事件相关的振动是由第一个实验中使用的测量产生的。我们表明，在恒定或可调的播放速度下，触觉探索都可以提高碰撞感知能力。在这两个实验中，报告的没有振动触觉反馈的碰撞次数与视频中的实际碰撞次数偏离最大。此外，在没有时间尺度修正(TSM)的情况下，使用振动进行时间缩放的碰撞检测性能与没有振动的碰撞检测性能没有显著差异。
Fast playback allows quick video exploration, but it also decreases the saliency of short events. We propose a haptic exploration for detection of short events during fast video playback, considering that event-related information in vibrotactile feedback can be preserved during fast playback using Time Scale Modification (TSM) methods developed for audio. We evaluate our proposal in two collision detection experiments using first-person view (FPV) videos. In the first experiment, viewers watched at a fixed playback speed, i.e.,or, videos recorded with a camera mounted on a platform cart. In this experiment, event-related vibrations were measured at the back of the camera. In the second experiment, viewers used a media controller to adjust the playback speed in videos simulating an exploration with a mobile robot. In this experiment, event-related vibrations were generated from the measurements used in the first experiment. We show that a haptic exploration improves collision awareness under either constant or adjustable playback speed. In both experiments, the number of collisions reported without vibrotactile feedback deviated the greatest from the actual number of collisions in a video. Moreover, collision detection performance with vibrations time-scaled without Time Scale Modification (TSM) methods was not significantly different from performance without vibrations.