An accurate and rapidly calibrating speech neuroprosthesis.
An accurate and rapidly calibrating speech neuroprosthesis.
复制标题
准确且快速校准的言语神经假体。
DOI：
10.1101/2023.12.26.23300110
复制
发表时间：
2024
期刊：
影响因子：
--
通讯作者：
H
中科院分区：
文献类型：
--
作者：
Card,NicholasS;Wairagkar,Maitreyee;Iacobacci,Carrina;Hou,Xianda;Singer-Clark,Tyler;Willett,FrancisR;Kunz,ErinM;Fan,Chaofei;Nia,MaryamVahdati;Deo,DarrelR;Srinivasan,Aparna;Choi,EunYoung;Glasser,MatthewF;Hochberg,LeighR;H
脑机接口可以通过将试图说话的大脑皮层活动转化为电脑屏幕上的文本，从而帮助瘫痪患者进行交流。大量的训练要求和有限的准确性限制了脑机接口的通信。方法一例45岁男性肌萎缩性侧索硬化症（ALS）合并四肢麻痹和严重构音障碍患者，在发病5年后在其左腹中央前回植入4个微电极阵列；这些阵列记录了256个皮质内电极的神经活动。我们报告了解码他的皮质神经活动的结果，当他试图在提示和非结构化的对话环境中说话。解码后的单词被显示在屏幕上，然后使用文字转语音软件发出声音，这种软件的设计听起来像他在als前的声音。结果在使用第一天（术后25天），神经假体的准确率达到99.6%，词汇量为50个单词。神经假体的校准需要在参与者试图说话时进行30分钟的皮层记录，然后进行后续处理。第二天，经过1.4个小时的系统训练，神经假体使用12.5万单词的词汇量达到了90.2%的准确率。通过进一步的训练数据，神经假体在手术植入后的8.4个月内保持了97.5%的准确率，参与者使用它以每分钟约32个单词的速度进行自定节奏的对话，累计超过248小时。结论在ALS合并严重构音障碍患者中，皮质内言语神经假体经过简短的训练后达到了恢复会话交流的水平。（由卫生事务助理国防部长办公室和其他机构资助；BrainGate2 ClinicalTrials.gov编号，NCT00912041。）
BackgroundBrain–computer interfaces can enable communication for people with paralysis by transforming cortical activity associated with attempted speech into text on a computer screen. Communication with brain–computer interfaces has been restricted by extensive training requirements and limited accuracy.MethodsA 45-year-old man with amyotrophic lateral sclerosis (ALS) with tetraparesis and severe dysarthria underwent surgical implantation of four microelectrode arrays into his left ventral precentral gyrus 5 years after the onset of the illness; these arrays recorded neural activity from 256 intracortical electrodes. We report the results of decoding his cortical neural activity as he attempted to speak in both prompted and unstructured conversational contexts. Decoded words were displayed on a screen and then vocalized with the use of text-to-speech software designed to sound like his pre-ALS voice.ResultsOn the first day of use (25 days after surgery), the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. Calibration of the neuroprosthesis required 30 minutes of cortical recordings while the participant attempted to speak, followed by subsequent processing. On the second day, after 1.4 additional hours of system training, the neuroprosthesis achieved 90.2% accuracy using a 125,000-word vocabulary. With further training data, the neuroprosthesis sustained 97.5% accuracy over a period of 8.4 months after surgical implantation, and the participant used it to communicate in self-paced conversations at a rate of approximately 32 words per minute for more than 248 cumulative hours.ConclusionsIn a person with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore conversational communication after brief training. (Funded by the Office of the Assistant Secretary of Defense for Health Affairs and others; BrainGate2 ClinicalTrials.gov number, NCT00912041.)