The nested hierarchy of overt, mouthed, and imagined speech activity evident in intracranial recordings
The nested hierarchy of overt, mouthed, and imagined speech activity evident in intracranial recordings
复制标题
DOI：
10.1016/j.neuroimage.2023.119913
复制
发表时间：
2022-08
期刊：
影响因子：
5.7
通讯作者：
P. Z. Soroush;Christian Herff;S. Riès;J. Shih;T. Schultz;D. Krusienski
中科院分区：
文献类型：
--
作者：
P. Z. Soroush;Christian Herff;S. Riès;J. Shih;T. Schultz;D. Krusienski
最近的研究表明，可以直接通过脑电生理活动的颅内测量来解码和合成声学语音的各个方面。为了继续为有言语障碍的人开发实用的言语神经假体，需要更好地理解和建模想象的言语过程。本研究使用参与者的颅内大脑记录，这些参与者执行了一项言语任务，并进行了由公开、口头和想象的言语模式组成的试验，代表了不同程度的行为输出下降。使用空间、频谱和时间大脑活动特征构建语音活动检测模型，并对三个程度的行为输出的特征和模型性能进行表征和比较。结果表明存在层次结构，其中较低行为输出模式的相关通道形成来自较高行为输出模式的相关通道的嵌套子集。这为实现相对于更完善的公开语音解码模型开发更有效的想象语音解码模型这一难以捉摸的目标提供了重要的见解。
Recent studies have demonstrated that it is possible to decode and synthesize various aspects of acoustic speech directly from intracranial measurements of electrophysiological brain activity. In order to continue progressing toward the development of a practical speech neuroprosthesis for the individuals with speech impairments, better understanding and modeling of imagined speech processes are required. The present study uses intracranial brain recordings from participants that performed a speaking task with trials consisting of overt, mouthed, and imagined speech modes, representing various degrees of decreasing behavioral output. Speech activity detection models are constructed using spatial, spectral, and temporal brain activity features, and the features and model performances are characterized and compared across the three degrees of behavioral output. The results indicate the existence of a hierarchy in which the relevant channels for the lower behavioral output modes form nested subsets of the relevant channels from the higher behavioral output modes. This provides important insights for the elusive goal of developing more effective imagined speech decoding models with respect to the better-established overt speech decoding counterparts.