Psychophysics of the McGurk and other audiovisual speech integration effects.
Psychophysics of the McGurk and other audiovisual speech integration effects.
复制标题
DOI：
10.1037/a0023100
复制
发表时间：
2011-08
影响因子：
2.1
通讯作者：
Bernstein, Lynne E.
中科院分区：
文献类型：
--
作者：
Jiang, Jintao;Bernstein, Lynne E.
关键词：
When the auditory and visual components of spoken audiovisual nonsense syllables are mismatched, perceivers produce four different types of perceptual responses, auditory correct, visual correct, fusion (the so-called McGurk effect), and combination (i.e., two consonants are reported). Here, quantitative measures were developed to account for the distribution of types of perceptual responses to 384 different stimuli from four talkers. The measures included mutual information, the presented acoustic signal versus the acoustic signal recorded with the presented video, and the correlation between the presented acoustic and video stimuli. In Experiment 1, open-set perceptual responses were obtained for acoustic /bA/ or /lA/ dubbed to video /bA, dA, gA, vA, zA, lA, wA, ΔA/. The talker, the video syllable, and the acoustic syllable significantly influenced the type of response. In Experiment 2, the best predictors of response category proportions were a subset of the physical stimulus measures, with the variance accounted for in the perceptual response category proportions between 17% and 52%. That audiovisual stimulus relationships can account for response distributions supports the possibility that internal representations are based on modality-specific stimulus relationships.
登录
查看更多内容
DOI：
10.1080/14640749108400991
发表时间：
1991-08-01
期刊：
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION A-HUMAN EXPERIMENTAL PSYCHOLOGY
影响因子：
--
作者：
BRAIDA, LD
通讯作者：
BRAIDA, LD
影响因子：
3.2
作者：
Blumstein, SE;Myers, EB;Rissman, J
通讯作者：
Rissman, J
DOI：
10.1098/rstb.2007.2155
发表时间：
2008-03-12
影响因子：
6.3
作者：
Campbell, Ruth
通讯作者：
Campbell, Ruth
影响因子：
5.4
作者：
LIBERMAN, AM;COOPER, FS;STUDDERT.M
通讯作者：
STUDDERT.M
影响因子：
4.3
作者：
Chandrasekaran C;Trubanova A;Stillittano S;Caplier A;Ghazanfar AA
通讯作者：
Ghazanfar AA