Brain-Computer Interfaces for Speech Communication.
Brain-Computer Interfaces for Speech Communication.
复制标题
DOI：
10.1016/j.specom.2010.01.001
复制
发表时间：
2010-04-01
影响因子：
3.2
通讯作者：
Guenther, Frank H.
中科院分区：
文献类型：
--
作者：
Brumberg, Jonathan S.;Nieto-Castanon, Alfonso;Kennedy, Philip R.;Guenther, Frank H.
本文简要回顾了目前的无声语音正常人和残疾人的方法。利用声道运动的肌电图（EMG）记录的当前技术对于身体健康的个体是有用的，但是对于不能对言语发音器进行精确的自愿控制的四肢瘫痪个体是失败的。利用来自其他身体部位的EMG的替代方法（例如，手、手臂或面部肌肉）或脑电图（EEG）可以向严重瘫痪的用户提供有能力的无声通信，尽管当前的界面相对于正常的会话速率非常慢，并且需要持续关注提供视觉反馈和/或提示的计算机屏幕。我们提出了一种新的方法，通过大脑皮层内微电极脑计算机接口（BCI）预测预期的语音信息直接从参与语音产生的神经元的活动的无声语音的问题。预测的语音合成和声学反馈给用户的延迟在50毫秒。我们证明，在BCI中使用的神经营养电极能够提供有用的神经记录超过4年，一个必要的属性BCI，需要保持活力的用户的寿命。其他设计考虑因素包括神经解码技术，该技术基于先前的研究，涉及用于计算机光标或机器人手臂控制的BCI，通过从猴子和人类的运动皮层信号预测预期的运动运动学。一项对具有瞬时声反馈的连续语音产生的研究的初步结果表明，BCI用户能够在记录会话内和记录会话之间改善对人工语音合成器的控制。这一初步试验的成功验证了皮质内微电极为基础的方法提供一个语音假体，可以允许更快的通信速率的潜力。
This paper briefly reviews current silent speech methodologies for normal and disabled individuals. Current techniques utilizing electromyographic (EMG) recordings of vocal tract movements are useful for physically healthy individuals but fail for tetraplegic individuals who do not have accurate voluntary control over the speech articulators. Alternative methods utilizing EMG from other body parts (e.g., hand, arm, or facial muscles) or electroencephalography (EEG) can provide capable silent communication to severely paralyzed users, though current interfaces are extremely slow relative to normal conversation rates and require constant attention to a computer screen that provides visual feedback and/or cueing. We present a novel approach to the problem of silent speech via an intracortical microelectrode brain computer interface (BCI) to predict intended speech information directly from the activity of neurons involved in speech production. The predicted speech is synthesized and acoustically fed back to the user with a delay under 50 ms. We demonstrate that the Neurotrophic Electrode used in the BCI is capable of providing useful neural recordings for over 4 years, a necessary property for BCIs that need to remain viable over the lifespan of the user. Other design considerations include neural decoding techniques based on previous research involving BCIs for computer cursor or robotic arm control via prediction of intended movement kinematics from motor cortical signals in monkeys and humans. Initial results from a study of continuous speech production with instantaneous acoustic feedback show the BCI user was able to improve his control over an artificial speech synthesizer both within and across recording sessions. The success of this initial trial validates the potential of the intracortical microelectrode-based approach for providing a speech prosthesis that can allow much more rapid communication rates.
登录
查看更多内容
影响因子：
3
作者：
Bartels, Jess;Andreasen, Dinal;Kennedy, Philip
通讯作者：
Kennedy, Philip
DOI：
10.1109/86.847808
发表时间：
2000-06-01
期刊：
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING
影响因子：
--
作者：
Donchin, E;Spencer, KM;Wijesinghe, R
通讯作者：
Wijesinghe, R
DOI：
10.1109/tnsre.2003.814439
发表时间：
2003-06-01
影响因子：
4.9
作者：
Birbaumer, N;Hinterberger, T;Neumann, N
通讯作者：
Neumann, N
影响因子：
4.6
作者：
Cheng, M;Gao, XR;Xu, DF
通讯作者：
Xu, DF
影响因子：
4.7
作者：
Hinterberger, T;Kübler, A;Birbaumer, N
通讯作者：
Birbaumer, N