Cross-modal integration of language and face cues in German and French infants

德国和法国婴儿语言和面部线索的跨模式整合

基本信息

项目摘要

The project aims to investigate when and how infants are able to link audio speech cues and visual face cues in a coherent and meaningful representation. The few studies investigating this question provided surprising links between voice characteristics and facial movements but so far failed to identify any relevant matching cues. We aim to determine when this link emerges, how specific it is to a particular language and whether it narrows to the native language toward the end of the first year. To address those questions we will use two languages, French and German, that greatly differ in terms of phonetics and prosody. On the contrary, German and French faces are rather similar which will avoid any "other-race effect". In 5 experiments, we will systematically investigate the proposed link between auditory and visual face cues and the role of phonetic and prosodic information. Using languages which belong to the same or different rhythmic classes as German or French, we also intend to investigate the generalization of the visual-auditory association. We will study whether the link can be generalized to languages belonging to the same rhythmic class, such as English (like German) and Spanish (like French). The cross-linguistic aspect of the project requires a French-German collaboration. This makes it possible to recruit and study French and German learning infants from monolingual families. Most previous cross linguistic studies focused on very different topics and only tested participants from one language with different language Stimuli. The intended project, however, will take advantage of a cross-over design and use the unique possibility of a French-German collaboration to study participants with different native languages by using the same language Stimuli in a joint project.
该项目旨在研究婴儿何时以及如何能够将音频语音线索和视觉面部线索联系起来,形成连贯和有意义的表示。为数不多的研究调查了这个问题,提供了声音特征和面部运动之间令人惊讶的联系,但到目前为止还没有发现任何相关的匹配线索。我们的目标是确定这种联系何时出现,它对特定语言的具体程度,以及它是否在第一年年底缩小到母语。为了回答这些问题,我们将使用两种语言,法语和德语,这两种语言在语音和韵律方面有很大的不同。相反,德国人和法国人的面孔相当相似,这将避免任何“其他种族效应”。在5个实验中,我们将系统地研究听觉和视觉面孔线索之间的联系以及语音和韵律信息的作用。使用语言属于相同或不同的节奏类,如德语或法语,我们还打算调查的推广的视觉-听觉协会。我们将研究这种联系是否可以推广到属于同一节奏类的语言,如英语(如德语)和西班牙语(如法语)。该项目的跨语言方面需要法德合作。这使得有可能招募和研究来自单语家庭的学习法语和德语的婴儿。大多数以前的跨语言研究集中在非常不同的主题,只测试了来自一种语言的参与者与不同的语言刺激。然而,计划中的项目将利用交叉设计,并利用法德合作的独特可能性,通过在联合项目中使用相同的语言Stimuli来研究具有不同母语的参与者。

项目成果

期刊论文数量(3)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Face-scanning behavior to silently-talking faces in 12-month-old infants: The impact of pre-exposed auditory speech
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Professorin Dr. Gudrun Schwarzer其他文献

Professorin Dr. Gudrun Schwarzer的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Professorin Dr. Gudrun Schwarzer', 18)}}的其他基金

Look who s talking: Interactions between face processing and speech perception during perceptual narrowing in monolingual and bilingual German and French infants
看看谁在说话:单语和双语德国和法国婴儿知觉缩小过程中面部处理和言语感知之间的相互作用
  • 批准号:
    389636291
  • 财政年份:
    2018
  • 资助金额:
    --
  • 项目类别:
    Research Grants
Prozesse der Objektverarbeitung in visueller Wahrnehmung und Handlung im Säuglings- und Kindesalter
婴儿期和儿童期视觉感知和行动中的物体处理过程
  • 批准号:
    5438921
  • 财政年份:
    2004
  • 资助金额:
    --
  • 项目类别:
    Research Units
Prozesse der Gesichtserkennung im Säuglingsalter: Die Rolle natürlicher Variationen
婴儿期面部识别过程:自然变化的作用
  • 批准号:
    5235094
  • 财政年份:
    1996
  • 资助金额:
    --
  • 项目类别:
    Research Units

相似国自然基金

基于异构医学影像数据的深度挖掘技术及中枢神经系统重大疾病的精准预测
  • 批准号:
    61672236
  • 批准年份:
    2016
  • 资助金额:
    64.0 万元
  • 项目类别:
    面上项目

相似海外基金

Cross-modal sensory interactions, processing, and representation in the Drosophila brain
果蝇大脑中的跨模式感觉交互、处理和表征
  • 批准号:
    10645611
  • 财政年份:
    2023
  • 资助金额:
    --
  • 项目类别:
How does our brain tell us where we are based on what we see and hear? - Neuronal basis of cross-modal sensory integration for navigation
我们的大脑如何根据我们所看到和听到的内容告诉我们我们在哪里?
  • 批准号:
    2547012
  • 财政年份:
    2021
  • 资助金额:
    --
  • 项目类别:
    Studentship
Presenting Robust Pseudo-Haptics by Manipulating Contribution Ratio of Haptics in Cross-Modal Integration
通过操纵跨模态集成中触觉的贡献率来呈现鲁棒的伪触觉
  • 批准号:
    21J12284
  • 财政年份:
    2021
  • 资助金额:
    --
  • 项目类别:
    Grant-in-Aid for JSPS Fellows
Research on Rescue Robot Based on Cross-Modal Integration
基于跨模态集成的救援机器人研究
  • 批准号:
    19K04454
  • 财政年份:
    2019
  • 资助金额:
    --
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
Multisensory integration, sensory recalibration, and the reduction of cross-modal perceptual discrepancies
多感官整合、感官重新校准和减少跨模式感知差异
  • 批准号:
    425795980
  • 财政年份:
    2019
  • 资助金额:
    --
  • 项目类别:
    Research Grants
Single Neuron Analyzer for Multi-modal, Cross-dataset (Epi)genomic Cell Type Datasets
用于多模式、跨数据集(表观)基因组细胞类型数据集的单神经元分析仪
  • 批准号:
    9795063
  • 财政年份:
    2019
  • 资助金额:
    --
  • 项目类别:
Cellular and circuit mechanisms mediating the cross-modal modulation of sensory processing
介导感觉处理跨模式调制的细胞和电路机制
  • 批准号:
    9906285
  • 财政年份:
    2018
  • 资助金额:
    --
  • 项目类别:
Cross modal integration of molecular and physiological networks in ASD (2/2)
ASD 中分子和生理网络的跨模式整合 (2/2)
  • 批准号:
    9753368
  • 财政年份:
    2017
  • 资助金额:
    --
  • 项目类别:
1/2 Cross modal integration of molecular and physiological networks in ASD
1/2 自闭症谱系障碍中分子和生理网络的跨模态整合
  • 批准号:
    9479597
  • 财政年份:
    2017
  • 资助金额:
    --
  • 项目类别:
Cross modal integration of molecular and physiological networks in ASD (2/2)
ASD 中分子和生理网络的跨模式整合 (2/2)
  • 批准号:
    10225520
  • 财政年份:
    2017
  • 资助金额:
    --
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了