Cross-modal processing and lexical development

在许多情况下，人们不得不同时处理呈现的听觉和视觉 信息，而这种能力对于词汇发展尤其重要，在听力上 呈现的词语通常与视觉呈现的对象和场景同时出现。我们认为 跨模式输入的处理取决于两个关键参数：(A)定向到 与竞争的情态有关的情态，以及(B)注意的停留时间。我们还认为， 这两个参数都经历了发展变化，这导致了更快和更有效的 处理跨模式输入。基于这些想法，我们提出了一个(A)估计的项目 听觉-视觉处理的关键参数(研究1)和(B)使用这些参数 理解从视觉输入中提取结构的能力，例如类别学习或 学习相关性(研究2)。本研究的主要创新点在于理论上的创新。 将认知发展的一些重要方面与更基本的机制联系起来的建议(S) 基础跨模式处理。拟议的项目有两个具体目标。具体目标1是 确定听觉输入如何影响分配给相应视觉输入的注意力 开发独立于通道的测量方法，能够检查听觉、视觉和跨通道 正在处理。具体目标2是直接测试跨通道的注意机制的能力 考虑到听觉输入对提取统计结构能力的影响的处理 从视觉输入。这些实验将以我们的假设为指导，即注意机制 潜在的跨通道加工可以解释高阶认知任务的表现， 它们需要对视觉结构进行加工，如单词学习、类别学习和学习 多个偶发事件。每项研究将包括8个月、12个月和16个月大的多个实验 并将包括各种方法。建议的研究是重要的。 因为它将产生新的知识，影响我们对 注意及其在跨情态加工中的作用，从而揭示了早期的一些基本机制。 词汇和认知发展。这一知识也可能对临床产生更广泛的影响 通过阐明特定语言障碍(SLI)的潜在因素，促进社区的发展。

In many situations people have to process simultaneously presented auditory and visual information, and this ability is especially important for lexical development where auditorily presented words often co-occur with visually presented objects and scenes. We argue that processing of cross-modal input depends on two critical parameters: (a) the speed of orienting to a modality relative to the competing modality and (b) the dwell time of attention. We also argue that both parameters undergo developmental change, which results in faster and more efficient processing of cross-modal input. Based on these ideas, we propose a project that (a) estimates the critical parameters of auditory-visual processing (Study 1) and (b) uses these parameters to understand the ability to extract the structure from visual input, such as category learning or learning of correlations (Study 2). The major innovation of the proposed research is the theoretical proposal linking some important aspects of cognitive development to more basic mechanism(s) underlying cross-modal processing. The proposed project has two specific aims. Specific aim 1 is to determine how auditory input affects attention allocated to corresponding visual input and to develop a modality-independent measure capable of examining auditory, visual and cross-modal processing. Specific aim 2 is to directly test the ability of attentional mechanisms underlying crossmodal processing to account for effects of auditory input on the ability to extract statistical structure from visual input. The experiments will be guided by our hypothesis that the attentional mechanism underlying cross-modal processing can account for performance on higher-order cognitive tasks, which require processing of visual structure such as word learning, category learning and learning of multiple contingencies. Each study will include multiple experiments with 8-, 12- and 16-monthold infants and will include a variety of methodologies. The proposed research is important because it will generate new knowledge affecting our understanding of the development of attention and its role in cross-modal processing, thus revealing some basic mechanisms of early lexical and cognitive development. This knowledge may also have broader impact on the clinical community by elucidating factors underlying Specific Language Impairments (SLI).