Cross-modal source information and spoken word recognition
Cross-modal source information and spoken word recognition
复制标题
DOI：
10.1037/0096-1523.30.2.378
复制
发表时间：
2004-04-01
影响因子：
2.1
通讯作者：
Pisoni, DB
中科院分区：
文献类型：
--
作者：
Lachs, L;Pisoni, DB
在跨模态匹配任务中，参与者被要求根据说话者的身份匹配语音的视觉和听觉显示。本研究使用声学转换语音的这项任务来检查可以传达跨模态信息的声音属性。单词识别性能也在相同的转换下进行了测量。作者发现，只有在保留共振峰频率的相对频谱和时间模式的变换下，跨模态匹配才是可能的。此外，跨模态匹配只可能在相同的条件下，产生强大的单词识别性能;结果是一致的假设，即声学和光学显示的语音同时进行发音信息的潜在的语言信息和索引属性的谈话者。
In a cross-modal matching task, participants were asked to match visual and auditory displays of speech based on the identity of the speaker. The present investigation used this task with acoustically transformed speech to examine the properties of sound that can convey cross-modal information. Word recognition performance was also measured under the same transformations. The authors found that cross-modal matching was only possible under transformations that preserved the relative spectral and temporal patterns of formant frequencies. In addition, cross-modal matching was only possible under the same conditions that yielded robust word recognition performance; The results are consistent with the hypothesis that acoustic and optical displays of speech simultaneously carry articulatory information about both the underlying linguistic message and indexical properties of the talker.