Look who s talking: Interactions between face processing and speech perception during perceptual narrowing in monolingual and bilingual German and French infants

看看谁在说话：单语和双语德国和法国婴儿知觉缩小过程中面部处理和言语感知之间的相互作用

• 批准号: 389636291
• 负责人: Professorin Dr. Gudrun Schwarzer
• 金额: --
• 依托单位: Laboratoire de Psychologie et NeuroCognition
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2018
• 资助国家: 德国
• 起止时间: 2017-12-31 至 2021-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/389636291?language=en
• 关键词: Look; who; talking; Interactions; between

From the beginning of life infants are exposed to talking faces. During their first year they become attuned to their native language as well as to faces which belong to their parents ethnic group. In learning their native language, infants will use auditory as well as visual information. Although parallels in infants speech and face processing have been assumed, systematic research on the development of both abilities is still lacking. It is the aim of this project to investigate this issue by analyzing the interaction between speech and face processing in infants. In particular, we will investigate the extent to which this interaction is shaped by perceptual narrowing, which has been shown to take place in both modalities, and whether this interaction is modulated by bilingualism. To address these questions we will test native vs. non-native speech and own- vs. other-race face processing in French and German mono- and bilingual infants. These infants belong to the same Caucasian ethnic group, which will allow us to systematically test the influence of varying native languages by keeping ambient face race constant. We will investigate the proposed interaction between speech and face processing in 4 experiments. In the first set of experiments we will assess whether infants integration of audio-visual speech differs when the faces of the speakers belong to an unfamiliar race and when infants grow up bilingually. In a second set, we will examine the role of language in the emergence of the implicit racial bias in infants. We want first to uncover if native language is more likely to be associated to infants own race and vice versa and if this association impacts infants confidence in other people. Our unique French-German collaboration between baby labs makes it possible to address these crucial questions on infants audio-visual processing in two typologically different languages with a single face category. It will also allow us to have access to a large population of bilingual infants, among which we expect a sufficient number of French-German bilinguals. The expected theoretical outcome of the BabyFaceSpeech project is a thorough account of the interaction between speech and face processing during development and of the modulatory role of bilingualism on multimodal perceptual narrowing. Our project also has clinical applications as it will provide standards to assess infants and children who are at risk for speech and face processing delays and disorders (such as specific language impairment, autism spectrum syndrome, developmental prosopagnosia or developmental phonagnosia). The BabyFaceSpeech project also has societal outcomes as it will help disentangle factors that influence the development of the implicit racial bias.

从生命的开始，婴儿就暴露在会说话的面孔中。在他们的第一年里，他们开始适应他们的母语以及属于他们父母种族群体的面孔。在学习母语时，婴儿将使用听觉和视觉信息。虽然婴儿的语音和面孔处理能力被认为是相似的，但仍然缺乏对这两种能力发展的系统研究。本研究的目的是通过分析婴儿言语和面孔加工之间的相互作用来研究这个问题。特别是，我们将调查在何种程度上这种相互作用是由知觉狭窄，这已被证明是发生在这两种方式，以及这种相互作用是否调制双语。为了解决这些问题，我们将测试母语与非母语的语言和自己与其他种族的面孔处理在法国和德国的单语和双语婴儿。这些婴儿属于同一个高加索种族群体，这将使我们能够通过保持周围面孔种族不变来系统地测试不同母语的影响。我们将在4个实验中研究语音和面部处理之间的交互作用。在第一组实验中，我们将评估当说话者的面孔属于一个不熟悉的种族时，以及当婴儿双语长大时，婴儿的视听言语整合是否不同。在第二组中，我们将研究语言在婴儿内隐种族偏见出现中的作用。我们首先要揭示的是，母语是否更有可能与婴儿自己的种族相关联，反之亦然，以及这种关联是否会影响婴儿对他人的信心。我们独特的法国和德国婴儿实验室之间的合作，使我们有可能解决这些关键问题的婴儿视听处理在两个类型不同的语言与一个单一的面孔类别。它还将使我们能够接触到大量的双语婴儿，其中我们预计有足够数量的法德双语者。BabyFaceSpeech项目的预期理论成果是对发展过程中语音和面部处理之间的相互作用以及双语对多模态感知缩小的调节作用进行了彻底的阐述。我们的项目也有临床应用，因为它将提供标准，以评估有语言和面部处理延迟和障碍风险的婴儿和儿童（如特定语言障碍，自闭症谱系综合征，发育性面容失认症或发育性语音失认症）。BabyFaceSpeech项目也有社会成果，因为它将有助于解开影响隐性种族偏见发展的因素。