A virtual vocal tract for speech output using non-invasive brain-computer interface

使用非侵入性脑机接口进行语音输出的虚拟声道

• 批准号: 10203911
• 负责人: Jonathan S Brumberg
• 金额: $ 36.47万
• 依托单位: UNIVERSITY OF KANSAS LAWRENCE
• 依托单位国家: 美国
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-07-16 至 2023-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10203911
• 关键词: Address; Adult; Age; Amyotrophic Lateral Sclerosis; Area; Articulators; Auditory; Auditory Evoked Potentials; Auditory area; Brain; Brain Stem Infarctions; Brain region; Child; Communication; Complement; Development; Devices; Disease; Dysarthria; Electroencephalography; Electromyography; Event-Related Potentials; Foundations; Functional disorder; Future; Generations; Goals; Health; Human; Imagery; Impairment; Individual; Intervention; Knowledge; Language; Learning; Locked-In Syndrome; Modality; Motor; Motor Skills; Movement; Muscle; Nervous System Trauma; Neurodegenerative Disorders; Neurologic; Neurosciences; Output; Paralysed; Participant; Patients; Pattern; Performance; Peripheral; Peripheral Nervous System; Population; Process; Production; Quality of life; Rehabilitation therapy; Research; Self-Help Devices; Signal Transduction; Social Interaction; Speech; Speech Acoustics; Speech Development; Speech Intelligibility; Speech Sound; Speech Synthesizers; Study models; System; Techniques; Technology; Therapeutic; Time; Training; Update; Validation; base; brain computer interface; clinically relevant; design; experimental study; improved; innovation; motor control; motor deficit; motor disorder; motor impairment; motor learning; neural prosthesis; neurophysiology; relating to nervous system; response; restoration; sex; sound; speech synthesis; spelling; theories; transmission process; virtual; virtual vocal tract; visual feedback; vocalization

Brain-computer interfaces (BCIs) have the potential to aid the restoration and rehabilitation of movement and communication for individuals with profound neuromotor impairments, including loss of speech. The current therapeutic paradigm for communication BCIs focuses on typing or spelling interfaces, which satisfy an immediate need for those who are not able to use other assistive technology for communication. Many users of BCI; however, desire an additional option to restore fluent vocal production beyond the capabilities of current BCI spellers. An alternative, complementary approach to communication BCIs envisions their potential as a replacement for the human vocal tract. The scientific foundation for a brain-controlled virtual vocal tract has been building in recent years from neuroscience studies of speech production, development of silent speech devices, and improvements to speech synthesizer technology. Our recent study proved the feasibility of a BCI-controlled speech synthesizer, though it was limited to the production of vowel sounds. There is now sufficient evidence and technology to bridge the gap between these past approaches toward a more complete BCI device that can continuously produce both vowels and consonants. The production of both types of phonemes is critical for building consonant-vowel pairs (e.g., syllables), words, and sentences through practice in a process similar speech development in young children. Importantly, the use of a replacement virtual vocal tract BCI depends on one's ability to learn new speech motor skills, which is not immediately clear for individuals with severe neuromotor impairments with dysarthria or anarthria. The goal of this study is to determine whether individuals with neuromotor impairments can learn new speech motor skills using a brain-controlled virtual vocal tract despite severe speech motor dysfunction. To address this goal, nine adults with severe speech intelligibility deficits due to progressive (e.g., amyotrophic lateral sclerosis) and non-progressive (e.g., brainstem stroke) neuromotor dysfunction, as well as 18 age and sex- matched control participants, will be trained to operate a virtual vocal tract BCI. The aims of the proposed study are: (Aim 1) to determine whether participants are able to learn new speech motor skills for accurate production of speech movements (including syllables) using a BCI virtual vocal tract, and (Aim 2) to use the N100 event-related potential suppression response to determine whether the functional network of brain regions needed for speech motor control is still intact and active, particularly for participants with neuromotor impairments. The results of this research will challenge and update current theories of speech motor control in individuals with neuromotor impairments and improve on the design and implementation of BCIs for controlling speech synthesizers in real- time. Both goals advance the long-term goal of a neural prosthesis for restoration of speech capable of providing continuous auditory output for individuals with severe speech impairment. This long-term goal has specific clinical relevance to individuals with severe neuromotor disorders and / or paralysis (e.g., locked-in syndrome) and has the potential to improve patients' quality of life and allow them to better engage in social interactions.

脑机接口(BCI)有可能帮助恢复和康复运动和 为患有严重神经运动障碍(包括语言丧失)的个人提供沟通服务。海流 交流BCI的治疗模式侧重于打字或拼写界面，这些界面满足即时 对于那些不能使用其他辅助技术进行交流的人来说是有必要的。许多BCI用户；然而， 希望有一个额外的选择来恢复流利的声音制作，超出当前BCI拼写人员的能力。一个 替代的、互补的通信BCI方法展望了它们作为 人类的声道。大脑控制的虚拟声道的科学基础是最近建立起来的 多年的神经科学研究，包括语音产生、无声语音设备的开发和改进 涉及到语音合成器技术。我们最近的研究证明了BCI控制的语音合成器的可行性， 尽管它仅限于产生元音。现在有足够的证据和技术来弥合 这些过去的方法之间的差距，朝着更完整的BCI设备，可以连续地产生 元音和辅音都有。这两种类型的音素的产生对于构建辅音-元音是至关重要的 通过练习成对(例如，音节)、单词和句子，在一个类似于青少年言语发展的过程中 孩子们。重要的是，使用替换的虚拟声道BCI取决于一个人学习新语音的能力 运动技能，对于患有严重构音障碍的神经运动障碍的人来说，这一点尚不清楚 或者是失语症。这项研究的目标是确定神经运动障碍的个体是否可以学习 使用大脑控制的虚拟声道的新语音运动技能，尽管存在严重的语音运动功能障碍。 为了解决这一目标，9名由于进行性(例如，肌营养不良)而患有严重语言清晰度缺陷的成年人 侧索硬化症)和非进行性(如脑干中风)神经运动障碍，以及18岁和性别- 匹配的对照组参与者将接受操作虚拟声道BCI的培训。拟议研究的目的 是：(目标1)确定参与者是否能够学习新的言语运动技能，以准确地产生 使用BCI虚拟声道的语音运动(包括音节)，以及(目标2)使用N100事件相关 潜在抑制反应以确定语言是否需要大脑区域的功能网络 运动控制仍然是完整和活跃的，特别是对于有神经运动障碍的参与者。结果是 这项研究将挑战和更新现有的神经运动个体的言语运动控制理论。 用于实时语音合成器控制的BCI设计和实现的缺陷和改进 时间到了。这两个目标都推进了神经假体的长期目标，以恢复能够提供 为有严重言语障碍的个人提供连续的听觉输出。这一长期目标具有特定的临床意义。 与患有严重神经运动障碍和/或瘫痪(例如，闭锁综合征)的个人有关，并有 有可能提高患者的生活质量，让他们更好地参与社会互动。