Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with 'The vOICe'
Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with 'The vOICe'
复制标题
DOI：
10.1068/p5631
复制
发表时间：
2007-01-01
期刊：
影响因子：
1.7
通讯作者：
O'Regan, J. Kevin
中科院分区：
文献类型：
--
作者：
Auvray, Malika;Hanneton, Sylvain;O'Regan, J. Kevin
我们研究了参与者在三维环境中使用动态任务能在多大程度上掌握一种视觉听觉替代设备（“The vOICe”）。经过大量训练后，参与者参加了四项实验。在第一项实验中，我们探究了移动和定位能力。参与者蒙上眼睛并配备该设备，必须通过移动手持摄像机来定位一个目标，朝着目标走去，并指向它。在第二项实验中，我们研究了在受限指向任务中的定位能力。在第三项实验中，我们探究了参与者通过声音呈现识别自然物体的能力。在第四项实验中，我们测试了参与者区分同类物体的能力。我们从客观和主观两个角度分析了参与者的表现。结果表明，参与者在使用手持摄像机时通过与感知场景的感觉运动交互，能够利用听觉刺激来获得运动引导、定位、指向以及物体识别所需的信息。此外，从主观角度进行的分析深入了解了参与者的定性体验以及他们掌握该设备所使用的策略，从而从一种演绎推理转变为对所感知事物的一种即时理解形式。
We investigated to what extent participants can acquire the mastery of an auditory-substitution-of-vision device ('The vOICe') using dynamic tasks in a three-dimensional environment. After extensive training, participants took part in four experiments. In the first experiment we explored locomotion and localisation abilities. Participants, blindfolded and equipped with the device, had to localise a target by moving a hand-held camera, walk towards the target, and point at it. In the second experiment, we studied the localisation ability in a constrained pointing task. In the third experiment we explored participants' ability to recognise natural objects via their auditory rendering. In the fourth experiment we tested the ability of participants to discriminate objects belonging to the same category. We analysed participants' performance from both an objective and a subjective point of view. The results showed that participants, through sensorimotor interactions with the perceptual scene while using the hand-held camera, were able to make use of the auditory stimulation to obtain the information necessary for locomotor guidance, localisation, and pointing, as well as for object recognition. Furthermore, analysis from a subjective perspective yielded insights into participants' qualitative experience and into the strategies they used to master the device, and thus to pass from a kind of deductive reasoning to a form of immediate apprehension of what is being perceived.