Links Between Production and Perception in Speech

言语产生和感知之间的联系

• 批准号: 7387332
• 负责人: Douglas H Whalen
• 金额: $ 62.7万
• 依托单位: HASKINS LABORATORIES, INC.
• 依托单位国家: 美国
• 财政年份: 1996
• 资助国家: 美国
• 起止时间: 1996-05-01 至 2011-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7387332
• 关键词: Accounting; Acoustics; American; Articulators; Autistic Disorder; Behavioral; Brain; Closure; Code; Communication; Computer Simulation; Development; Disease; Face; Feeling; Female; Fire - disasters; Gestures; Goals; Grant; Hearing; Human; Individual; Jaw; Joints; Language; Language Development; Language Disorders; Linguistics; Link; Lip structure; Maps; Measurement; Modeling; Modification; Monkeys; Neurons; Noise; Optics; Output; Parkinson Disease; Pattern; Perception; Phase; Phonetics; Process; Production; Range; Research; Research Personnel; Role; Scheme; Shapes; Signal Transduction; Source; Specific qualifier value; Speech; Speech Perception; Stimulus; System; Testing; Time; To specify; Ultrasonography; Variant; Visual; Voice; Work; base; male; research study; size; social; speech recognition; theories; tool

Project Summary: Our long-term goal is to understand how humans organize their brains and vocal tracts so that they can speak; only through understanding normal function can we see what happens with disorders. Although it is uncontroversial that most of the speech we hear is produced by a human vocal tract, it is less accepted that speech production and speech perception are intricately linked. Many theorists hold that the vocal tract's acoustic output is dealt with in a purely acoustic manner and that the link would be seen in modifications of the vocal tract shape to achieve particular acoustics. An alternative approach holds that speech consists of gestures (the coordinated activity of articulators), such as the jaw and the lips, achieving a phonetic goal, such as lip closure. The gestural model has allowed an insightful interpretation of many speech production phenomena, and the models have begun to have testable predictions for perceptual theories as well. The proposed experiments expand on this research, showing how perception of gestures is possible in automatic speech recognition, how the consequences of articulation¿acoustic, visual and even haptic¿are used by perceivers, and how accommodations are made for differences between speakers. This theoretical outlook has been fruitfully applied to problems in language acquisition, language change, and certain language disabilities. The advances from the proposed research should allow even broader applications. The goal is to show how acoustic parameters that cohere because of their origin in articulation are used by listeners. This will be accomplished by acoustical modeling of natural productions, perception of natural speech under modified circumstances (e.g., impaired by noise or enhanced by feeling the articulators saying what is being heard), and measurement of speech with ultrasound and optical markers. These measurements provide a basis for input to our configurable articulatory synthesizer, which can match the size and acoustic output of individual speakers. Stimuli generated from this synthesizer can test hypotheses about what is important in the production patterns we see. The results of these experiments will show more clearly than ever the tight link between production and perception of speech. Relevance: Speech is the primary means most humans use to communicate and maintain social relationships, but it is vulnerable to a range of disorders. We have to understand how it is that speech works normally so we can know what to do when things go wrong. Research along the lines in the present project has already contributed to other grants dealing with such disorders as Parkinson's disease and autism.

项目概述：我们的长期目标是了解人类如何组织大脑和发声 只有通过理解正常的功能，我们才能看到 紊乱虽然我们听到的大部分语音都是由人类发出的，这是毫无争议的。 然而，人们很少接受言语产生和言语感知是错综复杂的联系。许多理论家 我认为声道的声音输出是以纯粹的声学方式处理的，而且这种联系将是 在声道形状的修改中看到，以实现特定的声学效果。另一种方法是 语言是由手势（发音器官的协调活动）组成的，比如下巴和嘴唇， 实现语音目标，例如嘴唇闭合。手势模型可以对 许多语音产生现象，模型已经开始有可测试的预测， 知觉理论也是。拟议的实验扩展了这项研究，显示了感知 手势是可能在自动语音识别，如何发音的后果<$声学，视觉 甚至触觉也被感知者所使用，以及如何适应 扬声器.这一理论观点已被卓有成效地应用于语言习得、语言习得和语言习得等问题。 变化，以及某些语言障碍。从拟议的研究进展应该允许甚至 更广泛的应用。目的是为了说明声学参数是如何因为它们的起源而相互关联的， 发音是由听众使用的。这将通过自然产物的声学建模来实现， 在修改的环境下对自然语音的感知（例如，因噪音而受损或因感觉而增强 发音器官说的是听到的话），以及用超声波和光学测量语言 标记。这些测量为我们可配置的发音合成器的输入提供了基础， 可以匹配单个扬声器的大小和声学输出。从该合成器产生的刺激可以 测试我们所看到的生产模式中什么是重要的假设。这些实验的结果 将比以往任何时候都更清楚地显示出言语的产生和感知之间的紧密联系。 相关性：演讲是大多数人用来交流和维持社会关系的主要手段。 但它容易受到一系列疾病的影响。我们必须了解语言是如何运作的 这样我们就能知道出问题时该怎么做沿着本项目的路线进行研究 已经为其他治疗帕金森病和孤独症等疾病的赠款做出了贡献。