Audiomotor Speech Rhythms and Their Perceptual Consequences

音频运动言语节奏及其感知结果

• 批准号: 2043717
• 负责人: David Poeppel
• 金额: $ 49.55万
• 依托单位: New York University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-03-01 至 2024-02-29
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2043717&HistoricalAwards=false
• 关键词: Audiomotor; Speech; Rhythms; Their; Perceptual

A long-standing puzzle in psychology and the brain sciences is how the systems that underpin perception and cognition (e.g., vision, hearing, intention) are coordinated with those that generate action (e.g., reaching, speaking, walking). Although a great deal has been learned about how these individual systems work, how these critical functions interact remains poorly understood. This interaction is especially important in speech communication, which is of remarkable significance in humans. In order to use speech successfully, both to communicate with others and to monitor oneself speaking, the auditory speech perception circuit and the motor speech production system must precisely align in time. This temporal coordination is important for planning to speak, monitoring one’s errors, learning language sounds, and learning new words from a conversation. In this research program, the investigators study this alignment through auditory-motor synchronization. They use behavioral, neuroscience, and computational approaches to characterize auditory-motor synchronization and test the consequences of this synchronization for real-life behaviors such as word learning. An important feature of recent work that motivates this research is the discovery of a simple behavioral paradigm, the “spontaneous speech synchronization test” (SSS test). The test measures how precisely listeners synchronize their own spoken output to speech that they hear. The procedure is remarkably sensitive to individual differences, revealing that not all listeners synchronize equally well. Notably, the synchronization scores from the SSS test not only correlate highly with brain anatomy and physiology but are also predictive of listeners’ performance in important real-life challenges, such as word-learning. The new research builds on the novelty, sensitivity, and broad utility of the SSS test. The research plan is organized into four aims. First, the investigators will optimize the test for broad use by other scientists. Second, they will perform new experiments that test how auditory-motor synchronization, i.e., the rhythmic alignment between speech perception and speech production systems, guides speech perception. Third, they will develop a computational model constructed to provide a mechanistic description as well as to generate further testable predictions of auditory-motor synchronization. Fourth, the team will explore the consequences of synchronization for the essential capacity of word learning. An overarching practical, final goal is to release the SSS test in an open access format. Because the test outcome correlates with word learning, specific patterns of neural connectivity, and other cognitive features, it can be a useful, quick, easy-to-implement assay for researchers, educators, and clinicians.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

心理学和脑科学中一个长期存在的难题是，支撑感知和认知的系统(例如，视觉、听力、意图)如何与那些产生行动的系统(例如，伸手、说话、行走)相协调。尽管人们已经了解了很多关于这些独立系统是如何工作的，但这些关键功能是如何相互作用的仍然知之甚少。这种互动在语音交流中尤其重要，这对人类来说意义非凡。为了成功地使用语音，无论是与他人交流还是监控自己的说话，听觉语音感知电路和运动语音产生系统必须在时间上精确对准。这种时间协调对于计划说话、监控自己的错误、学习语言发音以及从对话中学习新单词都很重要。在这个研究项目中，研究人员通过听觉-运动同步来研究这种对齐。他们使用行为学、神经科学和计算方法来表征听觉-运动同步，并测试这种同步对现实生活行为(如单词学习)的影响。推动这项研究的最近工作的一个重要特征是发现了一种简单的行为范式--自发语音同步测试(SSS测试)。这项测试衡量了听者将自己的口语输出与他们听到的语音同步的精确度。这一过程对个体差异非常敏感，表明并不是所有的听众都能同样好地同步。值得注意的是，SSS测试的同步分数不仅与大脑解剖学和生理学高度相关，而且还可以预测听者在重要的现实生活挑战中的表现，比如单词学习。这项新的研究建立在SSS测试的新颖性、敏感性和广泛实用性的基础上。研究计划分为四个目标。首先，研究人员将优化该测试，以供其他科学家广泛使用。其次，他们将进行新的实验，测试听觉-运动同步，即语音感知和语音产生系统之间的节奏对齐，如何指导语音感知。第三，他们将开发一个计算模型，以提供机械描述，并产生进一步的听觉-运动同步的可测试预测。第四，研究小组将探索同步化对单词学习基本能力的影响。一个最重要的实用的最终目标是以开放访问的格式发布SSS测试。由于测试结果与单词学习、神经连接的特定模式和其他认知特征相关，因此它可以为研究人员、教育工作者和临床医生提供有用、快速、易于实施的测试。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。