Navigating from a Depth Image Converted into Sound.
Navigating from a Depth Image Converted into Sound.
复制标题
DOI：
10.1155/2015/543492
复制
发表时间：
2015
影响因子：
2.2
通讯作者：
Graff C
中科院分区：
文献类型：
--
作者：
Stoll C;Palluel-Germain R;Fristot V;Pellerin D;Alleysson D;Graff C
背景。普通制造的深度传感器产生的深度图像通常是人类从眼睛和手获得的。最近提出了各种将空间数据转换为声音的设计，推测它们作为感官替代装置（ssd）的适用性。目标。我们在一个导航任务中测试了这种设计作为旅行辅助工具。方法。我们的便携式设备（MeloSee）将二维深度图像阵列实时转换为旋律。与传感器的距离被转换成声强，横向立体声调制，音高表示垂直度。21名被蒙住眼睛的年轻人在间隔一周的两次会议中沿着四条不同的路径航行。在某些情况下，双重任务要求他们在导航时识别通过触觉振动器施加的时间模式。结果。参与者学习了如何在新路径和他们已经走过的路径上使用该系统。基于行程时间和误差，性能从一周到下一周都在提高。这两项任务都成功地完成了，但对有效导航有轻微影响，但没有妨碍。结论。使用kinect类型的传感器来实现ssd是有希望的，但它仅限于室内使用，并且在太短的范围内效率低下。
Background. Common manufactured depth sensors generate depth images that humans normally obtain from their eyes and hands. Various designs converting spatial data into sound have been recently proposed, speculating on their applicability as sensory substitution devices (SSDs). Objective. We tested such a design as a travel aid in a navigation task. Methods. Our portable device (MeloSee) converted 2D array of a depth image into melody in real-time. Distance from the sensor was translated into sound intensity, stereo-modulated laterally, and the pitch represented verticality. Twenty-one blindfolded young adults navigated along four different paths during two sessions separated by one-week interval. In some instances, a dual task required them to recognize a temporal pattern applied through a tactile vibrator while they navigated. Results. Participants learnt how to use the system on both new paths and on those they had already navigated from. Based on travel time and errors, performance improved from one week to the next. The dual task was achieved successfully, slightly affecting but not preventing effective navigation. Conclusions. The use of Kinect-type sensors to implement SSDs is promising, but it is restricted to indoor use and it is inefficient on too short range.