Modality-Specific Perceptual Learning of Vocoded Auditory versus Lipread Speech: Different Effects of Prior Information.
Modality-Specific Perceptual Learning of Vocoded Auditory versus Lipread Speech: Different Effects of Prior Information.
复制标题
DOI：
10.3390/brainsci13071008
复制
发表时间：
2023-06-29
期刊：
影响因子：
3.3
通讯作者：
Eberhardt, Silvio P. P.
中科院分区：
文献类型：
--
作者：
Bernstein, Lynne E. E.;Auer, Edward T. T.;Eberhardt, Silvio P. P.
关键词：
传统上，言语感知训练范式没有充分考虑到可能存在仅视觉（VO）言语刺激与仅视觉（AO）言语刺激的感知学习的特定模态要求的可能性。本文报告的研究调查了这样的假设：正常听力参与者在声码与VO语音训练期间如何使用先验信息存在特定于模态的差异。两个不同的实验，一个与声码AO语音（实验1）和一个VO，lipread，语音（实验2），研究了不同类型的先验信息的受训者在每次试验中的培训效果。训练时间为4 ~20 min，在此期间，参与者学习使用新颖的口语单词标记新颖的视觉图像。在培训期间，参与者被分配到不同类型的先验信息：单词组学员看到每个培训单词的打印版本（例如，“tethon”），而辅音组的受训者只看到它的辅音（例如，“t_th_n”）。另外的组没有收到先前的信息（即，实验1，AO组;实验2，VO组）或口语版本的刺激在一个不同的模态从训练刺激（实验1，唇扩散组;实验2，声码器组）。也就是说，在每个实验中，都有一组接受来自另一个实验的训练刺激模态的先验信息。在这两个实验中，单词组很难记住他们在训练中试图学习的新单词。然而，当训练刺激声编码，字组提高了他们的音素识别。当训练刺激为视觉言语时，辅音组的音素识别能力和开放句唇读能力均有所提高。结果被认为是在光的理论帐户的感知学习的感知模态的关系。
Traditionally, speech perception training paradigms have not adequately taken into account the possibility that there may be modality-specific requirements for perceptual learning with auditory-only (AO) versus visual-only (VO) speech stimuli. The study reported here investigated the hypothesis that there are modality-specific differences in how prior information is used by normal-hearing participants during vocoded versus VO speech training. Two different experiments, one with vocoded AO speech (Experiment 1) and one with VO, lipread, speech (Experiment 2), investigated the effects of giving different types of prior information to trainees on each trial during training. The training was for four ~20 min sessions, during which participants learned to label novel visual images using novel spoken words. Participants were assigned to different types of prior information during training: Word Group trainees saw a printed version of each training word (e.g., “tethon”), and Consonant Group trainees saw only its consonants (e.g., “t_th_n”). Additional groups received no prior information (i.e., Experiment 1, AO Group; Experiment 2, VO Group) or a spoken version of the stimulus in a different modality from the training stimuli (Experiment 1, Lipread Group; Experiment 2, Vocoder Group). That is, in each experiment, there was a group that received prior information in the modality of the training stimuli from the other experiment. In both experiments, the Word Groups had difficulty retaining the novel words they attempted to learn during training. However, when the training stimuli were vocoded, the Word Group improved their phoneme identification. When the training stimuli were visual speech, the Consonant Group improved their phoneme identification and their open-set sentence lipreading. The results are considered in light of theoretical accounts of perceptual learning in relationship to perceptual modality.
登录
查看更多内容
影响因子：
19.9
作者：
Awh, Edward;Belopolsky, Artem V.;Theeuwes, Jan
通讯作者：
Theeuwes, Jan
影响因子：
4.8
作者：
Bernstein, Lynne E.;Jiang, Jintao;Pantazis, Dimitrios;Lu, Zhong-Lin;Joshi, Anand
通讯作者：
Joshi, Anand
DOI：
10.3758/bf03205546
发表时间：
2000-02-01
期刊：
PERCEPTION & PSYCHOPHYSICS
影响因子：
--
作者：
Bernstein, LE;Demorest, ME;Tucker, PE
通讯作者：
Tucker, PE
影响因子：
2.4
作者：
Bernstein, Joshua G. W.;Venezia, Jonathan H.;Grant, Ken W.
通讯作者：
Grant, Ken W.
DOI：
10.1037/xlm0000277
发表时间：
2016-11-01
影响因子：
2.6
作者：
Ashby, F. Gregory;Vucovich, Lauren E.
通讯作者：
Vucovich, Lauren E.