A virtual vocal tract for speech output using non-invasive brain-computer interface

脑机接口（BCI）有可能帮助恢复和康复运动， 为患有严重神经运动障碍的人提供沟通，包括语言障碍。当前 交流脑机接口的治疗范例集中在打字或拼写界面上，这满足了即时的需求。 为那些无法使用其他辅助技术进行交流的人提供帮助。BCI的许多用户;然而， 希望有一个额外的选择，以恢复流畅的声乐生产超出了目前的BCI拼写的能力。一个 一种替代性的、补充性的沟通方法，BCI设想它们有可能取代 人类声道大脑控制的虚拟声道的科学基础最近已经建立起来 从语言产生的神经科学研究，无声语言设备的开发和改进， 语音合成技术。我们最近的研究证明了BCI控制的语音合成器的可行性， 尽管它仅限于元音的产生。现在有足够的证据和技术 这些过去的方法之间的差距朝着更完整的BCI设备， 元音和辅音这两种类型的音素的产生对于构建辅音-元音是至关重要的 对（例如，音节），单词和句子，通过实践在一个过程中类似的语音发展，在年轻的 孩子重要的是，使用替代虚拟声道BCI取决于一个人学习新语言的能力 运动技能，这对于患有构音障碍的严重神经运动障碍的个体来说并不立即清楚 或者是无关节症。这项研究的目的是确定神经运动障碍的个体是否能够学习 新的言语运动技能，使用大脑控制的虚拟声道，尽管严重的言语运动功能障碍。 为了实现这一目标，9名患有严重言语清晰度缺陷的成年人由于进行性（例如，肌萎缩 侧索硬化）和非进行性（例如，脑干中风）神经运动功能障碍，以及18岁和性别- 匹配的对照参与者将被训练以操作虚拟声道BCI。拟议研究的目的 （目的1）确定参与者是否能够学习新的言语运动技能，以准确地产生 使用BCI虚拟声道的语音运动（包括音节），以及（目的2）使用N100事件相关的 潜在的抑制反应，以确定是否需要语音的大脑区域的功能网络， 运动控制仍然完整和活跃，特别是对于有神经运动损伤的参与者。的结果 这项研究将挑战和更新目前的理论，言语运动控制的个人与神经运动 缺陷和改进的设计和实现的BCI控制语音合成器在真实的- 时间这两个目标都推进了神经修复术的长期目标， 为严重言语障碍的个体提供连续的听觉输出。这一长期目标具有特定的临床意义。 与患有严重神经运动障碍和/或瘫痪的个体的相关性（例如，闭锁综合征）， 提高患者生活质量并使他们更好地参与社会互动的潜力。

Brain-computer interfaces (BCIs) have the potential to aid the restoration and rehabilitation of movement and communication for individuals with profound neuromotor impairments, including loss of speech. The current therapeutic paradigm for communication BCIs focuses on typing or spelling interfaces, which satisfy an immediate need for those who are not able to use other assistive technology for communication. Many users of BCI; however, desire an additional option to restore fluent vocal production beyond the capabilities of current BCI spellers. An alternative, complementary approach to communication BCIs envisions their potential as a replacement for the human vocal tract. The scientific foundation for a brain-controlled virtual vocal tract has been building in recent years from neuroscience studies of speech production, development of silent speech devices, and improvements to speech synthesizer technology. Our recent study proved the feasibility of a BCI-controlled speech synthesizer, though it was limited to the production of vowel sounds. There is now sufficient evidence and technology to bridge the gap between these past approaches toward a more complete BCI device that can continuously produce both vowels and consonants. The production of both types of phonemes is critical for building consonant-vowel pairs (e.g., syllables), words, and sentences through practice in a process similar speech development in young children. Importantly, the use of a replacement virtual vocal tract BCI depends on one's ability to learn new speech motor skills, which is not immediately clear for individuals with severe neuromotor impairments with dysarthria or anarthria. The goal of this study is to determine whether individuals with neuromotor impairments can learn new speech motor skills using a brain-controlled virtual vocal tract despite severe speech motor dysfunction. To address this goal, nine adults with severe speech intelligibility deficits due to progressive (e.g., amyotrophic lateral sclerosis) and non-progressive (e.g., brainstem stroke) neuromotor dysfunction, as well as 18 age and sex- matched control participants, will be trained to operate a virtual vocal tract BCI. The aims of the proposed study are: (Aim 1) to determine whether participants are able to learn new speech motor skills for accurate production of speech movements (including syllables) using a BCI virtual vocal tract, and (Aim 2) to use the N100 event-related potential suppression response to determine whether the functional network of brain regions needed for speech motor control is still intact and active, particularly for participants with neuromotor impairments. The results of this research will challenge and update current theories of speech motor control in individuals with neuromotor impairments and improve on the design and implementation of BCIs for controlling speech synthesizers in real- time. Both goals advance the long-term goal of a neural prosthesis for restoration of speech capable of providing continuous auditory output for individuals with severe speech impairment. This long-term goal has specific clinical relevance to individuals with severe neuromotor disorders and / or paralysis (e.g., locked-in syndrome) and has the potential to improve patients' quality of life and allow them to better engage in social interactions.