权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

A virtual vocal tract for speech output using non-invasive brain-computer interface

使用非侵入性脑机接口进行语音输出的虚拟声道

基本信息

批准号：
10433983
负责人：
Jonathan S Brumberg
金额：
$ 36.34万
依托单位：
UNIVERSITY OF KANSAS LAWRENCE
依托单位国家：
美国
项目类别：
财政年份：
2018
资助国家：
美国
起止时间：
2018-07-16 至 2024-06-30
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/10433983
关键词：
Address Adult Age Amyotrophic Lateral Sclerosis Area Articulators Auditory Auditory Evoked Potentials Auditory area Brain Brain Stem Infarctions Brain region Child Communication Complement Development Devices Disease Dysarthria Electroencephalography Electromyography Event-Related Potentials Foundations Functional disorder Future Generations Goals Health Human Imagery Impairment Individual Intervention Knowledge Language Learning Locked-In Syndrome Modality Motor Motor Skills Movement Muscle Nervous System Trauma Neurodegenerative Disorders Neurologic Neurosciences Output Paralysed Participant Patients Pattern Performance Peripheral Peripheral Nervous System Population Process Production Quality of life Rehabilitation therapy Research Self-Help Devices Signal Transduction Social Interaction Speech Speech Acoustics Speech Development Speech Intelligibility Speech Sound Speech Synthesizers Study models System Techniques Technology Therapeutic Time Training Update Validation base brain computer interface clinically relevant design experimental study improved innovation motor control motor deficit motor disorder motor impairment motor learning neural prosthesis neurophysiology relating to nervous system response restoration sex sound speech synthesis spelling theories transmission process virtual virtual vocal tract visual feedback vocalization

项目摘要

Brain-computer interfaces (BCIs) have the potential to aid the restoration and rehabilitation of movement and communication for individuals with profound neuromotor impairments, including loss of speech. The current therapeutic paradigm for communication BCIs focuses on typing or spelling interfaces, which satisfy an immediate need for those who are not able to use other assistive technology for communication. Many users of BCI; however, desire an additional option to restore fluent vocal production beyond the capabilities of current BCI spellers. An alternative, complementary approach to communication BCIs envisions their potential as a replacement for the human vocal tract. The scientific foundation for a brain-controlled virtual vocal tract has been building in recent years from neuroscience studies of speech production, development of silent speech devices, and improvements to speech synthesizer technology. Our recent study proved the feasibility of a BCI-controlled speech synthesizer, though it was limited to the production of vowel sounds. There is now sufficient evidence and technology to bridge the gap between these past approaches toward a more complete BCI device that can continuously produce both vowels and consonants. The production of both types of phonemes is critical for building consonant-vowel pairs (e.g., syllables), words, and sentences through practice in a process similar speech development in young children. Importantly, the use of a replacement virtual vocal tract BCI depends on one's ability to learn new speech motor skills, which is not immediately clear for individuals with severe neuromotor impairments with dysarthria or anarthria. The goal of this study is to determine whether individuals with neuromotor impairments can learn new speech motor skills using a brain-controlled virtual vocal tract despite severe speech motor dysfunction. To address this goal, nine adults with severe speech intelligibility deficits due to progressive (e.g., amyotrophic lateral sclerosis) and non-progressive (e.g., brainstem stroke) neuromotor dysfunction, as well as 18 age and sex- matched control participants, will be trained to operate a virtual vocal tract BCI. The aims of the proposed study are: (Aim 1) to determine whether participants are able to learn new speech motor skills for accurate production of speech movements (including syllables) using a BCI virtual vocal tract, and (Aim 2) to use the N100 event-related potential suppression response to determine whether the functional network of brain regions needed for speech motor control is still intact and active, particularly for participants with neuromotor impairments. The results of this research will challenge and update current theories of speech motor control in individuals with neuromotor impairments and improve on the design and implementation of BCIs for controlling speech synthesizers in real- time. Both goals advance the long-term goal of a neural prosthesis for restoration of speech capable of providing continuous auditory output for individuals with severe speech impairment. This long-term goal has specific clinical relevance to individuals with severe neuromotor disorders and / or paralysis (e.g., locked-in syndrome) and has the potential to improve patients' quality of life and allow them to better engage in social interactions.

脑机接口（BCI）有可能帮助恢复和康复运动，为患有严重神经运动障碍的人提供沟通，包括语言障碍。当前交流脑机接口的治疗范例集中在打字或拼写界面上，这满足了即时的需求。为那些无法使用其他辅助技术进行交流的人提供帮助。BCI的许多用户;然而，希望有一个额外的选择，以恢复流畅的声乐生产超出了目前的BCI拼写的能力。一个一种替代性的、补充性的沟通方法，BCI设想它们有可能取代人类声道大脑控制的虚拟声道的科学基础最近已经建立起来从语言产生的神经科学研究，无声语言设备的开发和改进，语音合成技术。我们最近的研究证明了BCI控制的语音合成器的可行性，尽管它仅限于元音的产生。现在有足够的证据和技术这些过去的方法之间的差距朝着更完整的BCI设备，元音和辅音这两种类型的音素的产生对于构建辅音-元音是至关重要的对（例如，音节），单词和句子，通过实践在一个过程中类似的语音发展，在年轻的孩子重要的是，使用替代虚拟声道BCI取决于一个人学习新语言的能力运动技能，这对于患有构音障碍的严重神经运动障碍的个体来说并不立即清楚或者是无关节症。这项研究的目的是确定神经运动障碍的个体是否能够学习新的言语运动技能，使用大脑控制的虚拟声道，尽管严重的言语运动功能障碍。为了实现这一目标，9名患有严重言语清晰度缺陷的成年人由于进行性（例如，肌萎缩侧索硬化）和非进行性（例如，脑干中风）神经运动功能障碍，以及18岁和性别- 匹配的对照参与者将被训练以操作虚拟声道BCI。拟议研究的目的（目的1）确定参与者是否能够学习新的言语运动技能，以准确地产生使用BCI虚拟声道的语音运动（包括音节），以及（目的2）使用N100事件相关的潜在的抑制反应，以确定是否需要语音的大脑区域的功能网络，运动控制仍然完整和活跃，特别是对于有神经运动损伤的参与者。的结果这项研究将挑战和更新目前的理论，言语运动控制的个人与神经运动缺陷和改进的设计和实现的BCI控制语音合成器在真实的- 时间这两个目标都推进了神经修复术的长期目标，为严重言语障碍的个体提供连续的听觉输出。这一长期目标具有特定的临床意义。与患有严重神经运动障碍和/或瘫痪的个体的相关性（例如，闭锁综合征），提高患者生活质量并使他们更好地参与社会互动的潜力。