Auditory scene analysis and sonified visual images. Does consonance negatively impact on object formation when using complex sonified stimuli?
Auditory scene analysis and sonified visual images. Does consonance negatively impact on object formation when using complex sonified stimuli?
复制标题
DOI：
10.3389/fpsyg.2015.01522
复制
发表时间：
2015
影响因子：
3.8
通讯作者：
Proulx MJ
中科院分区：
文献类型：
--
作者：
Brown DJ;Simpson AJ;Proulx MJ
大脑的一项关键任务是对世界上感知对象的感官表征和识别。当视觉受损时，听觉和触觉必须发挥主要作用，最近已经开发了补偿技术，其采用触觉或听觉系统作为视觉系统的替代品。视觉到听觉的发音提供了一个复杂的，基于特征的听觉表示，必须由听者解码和集成到基于对象的表示中。然而，我们还不知道听觉系统在物体整合阶段扮演什么角色，以及听觉场景分析的原理是否适用。在这里，我们使用粗声化的图像在一个双音的歧视任务，以测试是否听觉特征为基础的表示视觉对象会混淆时，他们的功能与听觉和谐的原则相冲突。我们发现，听众（N = 36）在对象识别任务中表现较差时，基于听觉特征的表示是和谐的辅音。我们还发现，这种冲突并没有被否定与提供一致的视听信息。研究结果表明，早期的听觉过程的谐波分组占主导地位的对象形成过程中，信号的复杂性，和额外的感官信息有有限的影响。
A critical task for the brain is the sensory representation and identification of perceptual objects in the world. When the visual sense is impaired, hearing and touch must take primary roles and in recent times compensatory techniques have been developed that employ the tactile or auditory system as a substitute for the visual system. Visual-to-auditory sonifications provide a complex, feature-based auditory representation that must be decoded and integrated into an object-based representation by the listener. However, we don’t yet know what role the auditory system plays in the object integration stage and whether the principles of auditory scene analysis apply. Here we used coarse sonified images in a two-tone discrimination task to test whether auditory feature-based representations of visual objects would be confounded when their features conflicted with the principles of auditory consonance. We found that listeners (N = 36) performed worse in an object recognition task when the auditory feature-based representation was harmonically consonant. We also found that this conflict was not negated with the provision of congruent audio–visual information. The findings suggest that early auditory processes of harmonic grouping dominate the object formation process and that the complexity of the signal, and additional sensory information have limited effect on this.