Visual speech primes open-set recognition of spoken words
Visual speech primes open-set recognition of spoken words
复制标题
DOI：
10.1080/01690960802536357
复制
发表时间：
2009-01-01
期刊：
影响因子：
--
通讯作者：
Pisoni, David B.
中科院分区：
文献类型：
--
作者：
Buchwald, Adam B.;Winters, Stephen J.;Pisoni, David B.
视觉言语感知已成为言语研究者的研究热点。先前的研究已经表明，感知器神经编码和使用语音信息的视觉模态，并已发现这些信息，以促进口语单词识别任务，如词汇决策（金，戴维斯，克林斯，2004年）。本研究采用跨通道重复启动实验范式，考察了视觉-言语词汇启动和听觉-言语词汇目标启动的特点。首先，我们报告说，参与者确定的话与噪音混合更准确的话之前的视觉语音总理相同的词相比，控制条件。第二，对反应的分析表明，正确和不正确的反应都受到了在启动时的视觉言语信息的限制。这些互补的结果表明，视觉言语启动对词汇通达的影响，通过增加的可能性，具有某些语音特性的单词被选中。第三，我们发现，即使视觉和听觉信号来自不同的说话人，从而同一个词项的不同实例，跨通道重复启动效应仍然维持。我们讨论了这些结果对当前言语感知理论的影响。
Visual speech perception has become a topic of considerable interest to speech researchers. Previous research has demonstrated that perceivers neurally encode and use speech information from the visual modality, and this information has been found to facilitate spoken word recognition in tasks such as lexical decision (Kim, Davis, Krins, 2004). In this paper, we used a cross-modality repetition priming paradigm with visual speech lexical primes and auditory lexical targets to explore the nature of this priming effect. First, we report that participants identified spoken words mixed with noise more accurately when the words were preceded by a visual speech prime of the same word compared with a control condition. Second, analyses of the responses indicated that both correct and incorrect responses were constrained by the visual speech information in the prime. These complementary results suggest that the visual speech primes have an effect on lexical access by increasing the likelihood that words with certain phonetic properties are selected. Third, we found that the cross-modality repetition priming effect was maintained even when visual and auditory signals came from different speakers, and thus different instances of the same lexical item. We discuss implications of these results for current theories of speech perception.