Seeing through the Ears

这是一份修改后的提案，旨在利用心理物理学和脑成像来研究与呈现给听觉系统的环境视觉信息处理相关的脑活动 盲人和有视力的人。Peter Meijer开发了第一个基于摄像机的听觉显示器，以保留声音中大量的环境视觉信息，同时考虑到主要的 由人类听觉系统和频率-时间不确定性关系两者施加的约束（The vOICe，美国专利5，097，326）。vOICe为盲人提供了一种视觉替代工具， 的手段，提出现场图像到声音转换的风景，并允许跨模态可塑性的研究。将研究三组受试者：有视力的对照组、盲人和有视力的蒙眼受试者。我们将 在使用图像到声音转换系统的训练之前和之后，比较组间和组内的结果。培训将每天进行，持续四周，并将结合使用受控练习的联合收割机正式指导和受试者在实验室环境中导航时对vOICe的更自然、身临其境的使用。本研究将探讨听觉系统解码与处理视觉资讯的三个主要任务：（1）地形组织，（2）客体机制 （3）对象恒常性。将使用行为测量、功能性磁共振成像（fMRI）和经颅磁刺激（TMS）。我们希望能发现 在行为测量和与图像-声音转换信息的处理相关的大脑活动之间的受试者组之间。这项研究将提供关键的见解的机制 潜在的跨通道可塑性和处理环境空间视觉信息通过听觉系统在盲人，以及关于元通道对象和空间表征。图像到声音的转换最终可能成为盲人的合适假肢。

This is a revised submission of a proposal to use psychophysics and brain imaging to investigate the brain activity associated with the processing of environmental visual information presented to the auditory system in blind and sighted individuals. Peter Meijer developed the first camera-based auditory display to preserve a significant amount of environmental visual information in sound, while taking into account the major constraints imposed by both the human auditory system and the frequency-time uncertainty relation (The vOICe, U.S. Patent 5,097,326). The vOICe results in a vision substitution tool for the blind providing a means of presenting live image-to-sound converted scenery and permits the study of cross-modal plasticity. Three groups of subjects will be studied: sighted controls, blind, and sighted-blindfolded subjects,. We will compare results across and within groups before and after training in the use of the image-to-sound conversion system. Training will be conducted daily for four weeks and will combine formal instruction using controlled exercises and more naturalistic, immersive use of the vOICe by the subject while navigating the environment in the laboratory. Three main tasks of decoding and processing visual information by the auditory system will be studied to address: (1) Topographic organization, (2) Mechanisms of object identification, and (3) Object constancy. Behavioral measures, functional magnetic resonance imaging (fMRI), and transcranial magnetic stimulation (TMS) will be used. We expect to find significant differences between the groups of subjects in the behavioral measures and brain activity associated with the processing of image-to-sound converted information. This study will provide critical insights into the mechanisms underlying cross-modal plasticity and processing of environmental spatial visual information presented via the auditory system in blind, as well as about metamodal object and space representation. Image-to-sound conversion may eventually become a suitable prosthesis for the blind.