CRCNS: Avian Model for Neural Activity Driven Speech Prostheses

理解人类发声交流的物理、计算和理论基础， 对于改善对声音、言语和语言疾病和障碍的理解至关重要，以及 提高其诊断、治疗和预防水平。迎接这一挑战需要了解 发声运动控制的神经和感觉运动机制。我们的项目将直接研究神经 和感觉运动机制参与产生复杂的、自然的、发声的交流 信号。我们的成果将直接增强用于通信的脑机接口技术，并将 加快个人假体和其他辅助技术的开发 因受伤或疾病而导致的沟通障碍。我们将开发一种声带假体，可以直接翻译成 皮质感觉运动区和发声运动控制区的神经信号转化为发声通讯信号 实时输出。在成功使用非人类灵长类动物作为脑机接口的基础上 一般运动控制，假肢将在鸣禽身上开发，其声学丰富，学识渊博 发声与人类说话有许多共同之处。因为鸣鸟的发声装置是 在功能和解剖学上与人类喉部相似，控制喉部的皮质区域非常紧密 类似于人类大脑的言语运动控制区，鸣禽为 建议进行的研究。除了将我们的工作应用于人类的声音和言语之外， 声带假体将使在鸣禽模型中进行的与语音相关的新研究能够揭示 声乐学习和发声的基本机制。在项目的第一阶段，我们收集了一个 同时记录神经活动和发声的大数据集。在第二阶段，我们将申请 机器学习和人工智能技术，以开发将神经记录映射到 声音输出，并使我们能够直接从神经数据估计预期的发声。在第三阶段，我们 将开发计算基础设施来实时运行这些算法，预测预期发音 从神经活动，因为动物正在积极地产生这些发声。在第四阶段，我们将测试 用我们的假肢输出代替鸟自己的发声来提高假肢的有效性 系统。这些技术的成功将为在人体上测试这些技术并将其翻译成多个 辅助设备。除了我们的研究目标外，该项目还将吸引研究生、本科生和 高中生通过开发新颖的教育模块向学生介绍 脑机接口和跨越工程学和基础科学的多学科研究。 相关性(请参阅说明)： 开发发声假体将直接增强用于通信的脑机接口技术 并加快实现假肢和其他辅助技术用于有 因受伤或疾病而导致的沟通障碍。神经和感觉运动学的基础知识 获得的发声运动控制机制将影响对多种声音、语音和 语言疾病和语言障碍。开发的技术将使未来对声乐的新研究成为可能 生产和发展。

Understanding the physical, computational, and theoretical bases of human vocal communication, speech, is crucial to improved comprehension of voice, speech and language diseases and disorders, and improving their diagnosis, treatment and prevention. Meeting this challenge requires knowledge of the neural and sensorimotor mechanisms of vocal motor control. Our project will directly investigate the neural and sensorimotor mechanisms involved in the production of complex, natural, vocal communication signals. Our results will directly enhance brain-computer interface technology for communication and will accelerate the development of prostheses and other assistive technologies for individuals with communications deficits due to injury or disease. We will develop a vocal prosthetic that directly translates neural signals in cortical sensorimotor and vocal-motor control regions into vocal communication signals output in real-time. Building on success using non-human primates for brain computer interfaces for general motor control, the prosthetic will be developed in songbirds, whose acoustically rich, learned vocalizations share many features with human speech. Because the songbird vocal apparatus is functipnally and anatomically similar to the human larynx, and the cortical regions that control it are closely analogous to speech motor-control areas of the human brain, songbirds offer an ideal model for the proposed studies. Beyond the application of our work to human voice and speech, development of the vocal prosthetic will enable novel speech-relevant studies in the songbird model that can reveal fundamental mechanisms of vocal learning and production. In the first stage of the project, we collect a large data set of simultaneously recorded neural activity and vocalizations. In stage two, we will apply machine learning and artificial intelligence techniques to develop algorithms that map neural recordings to vocal output and enable us to estimate intended vocalizations directly from neural data. In stage three, we will develop computing infrastructure to run these algorithms in real-time, predicting intended vocalizations from neural activity as the animal is actively producing these vocalizations. In stage four, we will test the effectiveness of the prosthetic by substituting the bird's own vocalization with the output from our prosthetic system. Success will set the stage for testing of these technologies in humans and translation to multiple assistive devices. In addition to our research goals, the project will engage graduate, undergraduate, and high school students through the development of novel educational modules that introduce students to brain machine interface and multidisciplinary studies that span engineering and the basic sciences. RELEVANCE (See instructions): Developing a vocal prosthesis will directly enhance brain-computer interface technology for communication and accelerate the realization of prostheses and other assistive technologies for individuals with communications deficits due to injury or disease. The basic knowledge of the neural and sensorimotor mechanisms of vocal motor control acquired will impact understanding of multiple voice, speech, and language diseases and disorders. The techniques developed will enabling novel future studies of vocal production and development.