Haptic Telepresence System for Individuals with Visual Impairments
Haptic Telepresence System for Individuals with Visual Impairments
复制标题
DOI：
10.18494/sam.2017.1594
复制
发表时间：
2017-01-01
影响因子：
1.2
通讯作者：
Ryu, Eun-Seok
中科院分区：
文献类型：
--
作者：
Ryu, Yeongil;Ryu, Eun-Seok
在本文中，我们提出了一个新的触觉临场感系统的个人与视觉障碍（维斯）使用红-绿-蓝-深度（RGB-D）传感器和触觉设备。RGB-D传感器的最新改进使得能够实时访问3D空间信息。然而，有形的触觉体验的实时表示还没有受到足够的挑战。因此，所提出的系统通过视频编码和3D深度图增强使用RGB-D传感器解决远程3D信息的远程呈现。在所实现的系统中，来自Microsoft的Kinect传感器是RGB-D传感器，其以大约30 fps的速率提供深度和2D彩色图像。Kinect深度数据帧被缓存，投影到分辨率为640 x 480像素的3D坐标系中，然后转换为3D地图。为了验证所提出的视频内容自适应方法的好处，个人与维斯，在这项研究中，我们实现了一个“2D加深度图”为基础的触觉临场感系统，它进行用户体验实验，并提出了用户响应时间的结果。
In this paper, we propose a new haptic telepresence system for individuals with visual impairments (VIs) using a red-green-blue-depth (RGB-D) sensor and a haptic device. Recent improvements in RGB-D sensors have enabled real-time access to 3D spatial information. However, the real-time representation of the tangible haptic experience has not been sufficiently challenged. Thus, the proposed system addresses the telepresence of remote 3D information using an RGB-D sensor through video encoding and 3D depth-map enhancement. In the implemented system, the Kinect sensor from Microsoft is an RGB-D sensor that provides depth and 2D color images at a rate of approximately 30 fps. The Kinect depth data frame is buffered, projected into a 3D coordinate system with a resolution of 640 x 480 pixels, and then is transformed into a 3D map. To verify the benefits of the proposed video content adaptation method for individuals with VIs, in this study, we implemented a '2D plus depth map'-based haptic telepresence system; it conducts user experience experiments and presents the results of user response time.