Auditory coding of visual patterns for the blind
Auditory coding of visual patterns for the blind
复制标题
DOI：
10.1068/p2607
复制
发表时间：
1999-01-01
期刊：
影响因子：
1.7
通讯作者：
Veraart, C
中科院分区：
文献类型：
--
作者：
Arno, P;Capelle, C;Veraart, C
简单视觉模式的识别任务被用来评估早期的视觉-听觉感觉替代系统，该系统由人类视网膜的粗略模型和耳蜗逆模型的耦合组成，通过像素-频率关系。与以前的设备相比，该设备的潜在优势是让盲人能够定位和识别视觉模式。四次评估会议评估了24名蒙眼视力受试者使用该设备的表现。受试者必须识别25种视觉模式，一次一个，使用一个头戴式的小型摄像头，并解释设备发出的相应声音。一半的受试者在评估期间的十个一小时的培训期间通过纠正反馈程序进行了培训。结果显示，训练效果非常成功。与未受过训练的控制组相比，受过训练的受试者的成绩随着练习而显著提高。对于新的模式，也观察到了改进，展示了学习过程的泛化。成绩与加工时间之间的负相关表明：被试的反应准确度与他们的速度有关。总而言之，考虑到受试者在使用该设备时有感觉-运动相互作用的可能性，通过相当自然的视觉-听觉编码方案，简单的模式识别是可能的。
Recognition tasks of simple visual patterns have been used to assess an early visual-auditory sensory-substitution system, consisting of the coupling of a rough model of the human retina with an inverse model of the cochlea, by means of a pixel-frequency relationship. The potential advantage of the device, compared with previous ones, is to give the blind the ability to both localise and recognise visual patterns. Four evaluation sessions assessed the performance of twenty-four blindfolded sighted subjects using the device. Subjects had to recognise twenty-five visual patterns, one at a time, using a head-mounted small camera and interpreting the corresponding sounds given by the device. Half the subjects were trained by means of a correction feedback procedure during ten one-hour training sessions embedded in between the evaluation sessions. Results revealed extremely successful training effects. Performance of trained subjects significantly increased with practice compared with the untrained control group. The improvement was also observed for new patterns, demonstrating a learning-process generalisation. The negative correlation observed between scores and processing time showed that the: subjects' response accuracy was related to their speed. In conclusion, simple pattern recognition is possible with a fairly natural vision-to-audition coding scheme, given the possibility for the subjects to have sensory-motor interactions while using the device.