Transfer of statistical learning from perception to production

无论是在咖啡馆与朋友聊天，在教室讨论一个话题，还是与亲戚辩论政治，我们都依赖于与许多不同的人交流的能力。在75亿英语使用者中，只有5%的人是以英语为母语的人，而且在地区英语中也存在巨大的方言差异。因此，我们经常会遇到一个说话者，他的讲话与我们的不同。先前的研究表明，大脑如何协调听和说的联系可以导致谈话伙伴听起来更像彼此。一个人所听到的东西对他说话方式的影响通常被称为“转移”。迁移提供了一个窗口，通过它可以更好地理解言语感知和言语产生之间的机制联系。这一点很重要，因为它为在各个领域产生更广泛的影响奠定了基础，例如：1）在语言多样性的教室中开发有效教育方法的新技术; 2）帮助个人应对口吃等沟通挑战; 3）提供约束条件以完善人工智能和机器语音识别系统; 4）设计大脑假体，恢复因中风而丧失的语言能力。目前的项目集中在了解大脑如何将我们听到的东西与我们说话的方式联系起来，即使变化是微妙的，也无法有意识地识别。研究人员采用了一种新颖的方法来研究迁移，通过微妙但系统的方式操纵语音流的构成。这种方法允许明确预测生产的预期变化，如果它隐含地受到感知的影响。初步数据表明，情况确实如此：通过操纵声音的音高来创造一种微妙的口音，会导致说话者产生相同维度的方式发生强烈变化。这种影响超越了对听到的话语的即时模仿（例如，重复刚刚听到的单词）。相反，它意味着说话者的生产系统发生了更根本的变化，可能涉及到通过对大脑进行小而持久的神经可塑性变化来进行增量学习的形式。目前的项目将系统地调查转移发生的时间和方式，以揭示负责任的机制。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Whether chatting with a friend at a café, discussing a topic in a classroom, or debating politics with a relative, we depend on our ability to communicate with many different people. Only 5 percent of the 7.5 billion English speakers are native talkers and there are also tremendous dialect differences in regional English. Thus, we quite often encounter a speaker whose speech differs from our own. Prior research demonstrates that links in how the brain coordinates listening and speaking can lead conversation partners to sound more like one another. The influence of what one hears on how one talks is often referred to as “transfer.” Transfer provides a window through which to better understand the mechanistic links between speech perception and speech production. This is important because it provides a foundation for broader impacts across a variety of domains, such as: 1) developing new technologies for effective education approaches in classrooms with language diversity; 2) assisting individuals with communication challenges like stuttering; 3) providing constraints to refine artificial intelligence and machine speech recognition systems; and 4) engineering brain prostheses that can restore speech lost to stroke.The current project focuses on understanding how the brain links what we hear with how we speak, even when changes are subtle and not consciously identifiable. The investigators take a novel approach to the study of transfer by manipulating the make-up of the speech stream in subtle but systematic ways. This method allows clear predictions about the expected changes to production if it is implicitly influenced by perception. Preliminary data suggest this is the case: creating a subtle accent by manipulating the pitch of a voice induces robust changes in how speakers produce the very same dimension. This influence goes beyond immediate imitation of heard speech (for example, repeating a just-heard word). Rather, it implies a more fundamental change to the speaker’s production system that likely involves a form of incremental learning through small, but persistent, neuroplastic changes to the brain. The current project will systematically investigate when and how transfer occurs in order to reveal the responsible mechanisms.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.