The perception of visual images encoded in musical form: a study in cross-modality information transfer
The perception of visual images encoded in musical form: a study in cross-modality information transfer
复制标题
DOI：
10.1098/rspb.1999.0942
复制
发表时间：
1999-12-07
影响因子：
4.7
通讯作者：
Gregory, RPF
中科院分区：
文献类型：
--
作者：
Cronly-Dillon, J;Persaud, K;Gregory, RPF
这项研究表明，盲人（以前的视力）和蒙眼（视力）的科目在重建和识别的视觉目标转化为等效的音乐表示的数量的能力。视觉图像通过一个过程被解构，该过程选择性地将图像的不同特征分离到单独的包中。然后这些声音被编码成声音，并呈现为复调音乐旋律，类似于具有许多声音的巴洛克赋格曲，允许受试者选择性地组合或单独地按顺序分析组成声音，以一种允许受试者在心理上将物体的不同特征拼凑在一起并结合成一个单一可识别实体的心理感受的方式。本研究中使用的视觉目标包括各种各样的几何图形、人造物体的简单高对比度线条画、自然和城市场景等，翻译成声音并以复调音乐形式呈现给主体。
This study demonstrates the ability of blind (previously sighted) and blindfolded (sighted) subjects in reconstructing and identifying a number of visual targets transformed into equivalent musical representations. Visual images are deconstructed through a process which selectively segregates different features of the image into separate packages. These are then encoded in sound and presented as a polyphonic musical melody which resembles a Baroque fugue with many voices, allowing subjects to analyse the component voices selectively in combination, or separately in sequence, in a manner which allows a subject to patch together and bind the different features of the object mentally into a mental percept of a single recognizable entity The visual targets used in this study included a variety of geometrical figures, simple high-contrast line drawings of man-made objects, natural and urban scenes, etc., translated into sound and presented to the subject in polyphonic musical form.