CONGRUENCE EFFECTS IN CROSS SENSORY INTERACTIONS

描述(从摘要修改)：人类感觉-神经信息 处理从感觉通道处的输入开始。一旦这些输入 都是感知编码的，当然也可以在语言上重新编码。任何 然后，可以假设跨通道的交互过程发生在 信息流中至少有两个区域，即感觉区域 或者在认知层面上。本提案涉及这项研究 指视觉、听觉和触觉信号之间的相互作用； 具体地说，本研究的兴趣在于一组现象 这可以被称为同余效应。这些都被描述为影响 当受试者被要求识别目标刺激时， 当同时呈现一种不相关的特定情态时 另一种形式的刺激。当无关紧要的刺激符合时，或者 研究发现，在某些维度上匹配，或者与相关维度一致 结果表明，与传统方法相比，识别时间和准确率都有所提高 不相关的刺激与不一致的状态 目标。可以举一个简单的例子来说明这种现象：当受试者 当被要求辨别高音时，他们会更迅速地 当它伴随着高密度的视觉刺激时， 视觉空间，与与空间低视觉相伴时 刺激。出于同样的原因，低调的音调会更有效 当伴随着比高的空间低的视觉刺激时被处理 一。首席调查员已经证明了 在一些研究中的同余效应，现在建议扩展 这一领域的研究通过一系列实验来测试 无论是作为干扰还是作为促进处理的效果存在 更多地在基本感官事件领域或在后来的事件中涉及 语言重新编码。他的计划是研究减少 在他所说的语义级别上的交互的可能性，通过， 例如，利用听觉系统的两侧不对称性 用于语言输入。因为众所周知的左耳优势 在处理语言的权利上(在大多数科目中)，它应该是 可以证明具有语义的视觉事件的一致性 听觉的价值将在处理过程中产生改进。在……里面 此外，首席调查员将重复一些拟议的 对报告联觉的单独一组受试者进行的实验 经历。例如，这些人的经历听起来不仅 听觉上和视觉上，除了有生动的色彩体验外 听觉上的感知。因为这些人表现出一种相当固定的 两种模式感知的关系，例如，特定色调总是 当特定的声音模式出现时，感知到的产生 一致和不一致的刺激必须针对每个受试者的 个人跨模式配对。否则，一致/不一致效应将 不会被检测到。由于以下事实，即 普通人群中的通感相当低，人们的期望是 在三年的时间里，只有几个主题会被发现 格兰特。这些和类似的感官之间的关系的操纵 维度及其语义价提供了测试的基础 一小套相互作用过程的基本定量模型。 这项工作的结果很可能被证明在 使用不止一种模式的感官辅助工具的开发 通信(例如，视觉-触觉或听觉-动觉组合)， 除了提高我们对结构关系的认识外， 认知事件。

DESCRIPTION (modified from abstract): Human sensory-neural information processing begins with inputs at the sense modalities. Once these inputs are encoded perceptually, they may of course be recoded linguistically. Any interactive processes across modalities may then be assumed to take place in at least two regions in the information stream, viz., at the sensory level,or at the cognitive level. The present proposal deals with the study of interactions between visual, auditory, and tactual signals; in particular, the interest of the present research is in a set of phenomena that can be called congruence effects. These are characterized as effects that occur when the subject is asked to identify a target stimulus in a particular modality when there is simultaneously presented an irrelevant stimulus in another modality. When the irrelevant stimulus agrees with, or matches in some dimension, or is congruent to the relevant one, research has shown that both identification time and accuracy improve in comparison with the condition in which the irrelevant stimulus is incongruent with the target. A simple example of the phenomenon can be cited: When subjects are asked to identify a high-pitched tone, they will do so more rapidly and accurately when it is accompanied by a visual stimulus that is high in visual space, compared with when accompanied by a spatially low visual stimulus. By the same token, a low-pitched tone will be more efficiently processed when accompanied by a spatially low visual stimulus than a high one. The principal investigator has already demonstrated the existence of the congruence effect in a number of studies, and now proposes to extend this area of research with a series of experiments that test whether the effect, either as interference with or as facilitation of processing, lies more in the realm of elementary sensory events or in later events involving linguistic recoding. It is his plan to examine the effects of reducing the possibility of interactions at what he calls the semantic level by, for example, taking advantage of the bilateral asymmetry of the auditory system for linguistic input. Because of the well-known advantage of the left ear over the right (in most subjects) for processing language, it should be possible to demonstrate whether congruence of visual events having semantic value with auditory ones will produce an improvement in processing. In addition, the principal investigator will repeat some of the proposed experiments on a separate group of subjects who report synesthetic experiences. These are persons who, for example, experience sounds not only auditorily but also visually, having vivid color experiences in addition to the auditory perceptions. Because these persons exhibit a rather fixed relation of the two modal perceptions, e.g., a specific hue is always perceived when a particular sound pattern occurs, the production of congruent and incongruent stimuli must be tailored to each subject's personal cross-modal pairs. Otherwise, congruence/incongruence effects will not be detected. Owing to the fact that the frequency of occurrence of synesthesia in the general population is rather low, the expectation is that only a few subjects will be found in the three-year period devoted to the grant. These and similar manipulations of the relations between the sensory dimensions and their semantic valences provides the basis for the testing of a small set of elementary quantitative models of the interaction process. The results of this work may very well prove of significant use in the development of sensory aids that use more than one modality for communication (e.g., visual-tactual or auditory-kinesthetic combinations), in addition to advancing our knowledge of the structural relations among cognitive events.