Real-time detection and discrimination of visual perception using electrocorticographic signals.
Real-time detection and discrimination of visual perception using electrocorticographic signals.
复制标题
DOI：
10.1088/1741-2552/aaa9f6
复制
发表时间：
2018-06
影响因子：
4
通讯作者：
Kamada K
中科院分区：
文献类型：
--
作者：
Kapeller C;Ogawa H;Schalk G;Kunii N;Coon WG;Scharinger J;Guger C;Kamada K
多项神经影像学研究表明，腹侧颞叶皮层包含处理视觉刺激的专门区域。这项研究调查了向四名人类参与者呈现的不同类型和颜色的视觉刺激的皮质电图 (ECoG) 反应的空间和时间动态，并演示了一个实时解码器，可以检测和区分对未经训练的自然图像的反应。记录参与者的 ECoG 信号，同时向他们展示七种视觉刺激的彩色和灰度版本（面部、物体、身体、线条图、数字、汉字和平假名字符的图像），从而产生 14 个辨别类别（实验 I）。此外，实时系统对通过监视器呈现的人脸、汉字和黑屏（实验 II）或自然场景（即实验者的脸、人脸和汉字的自然图像以及镜子）（实验 III）的 ECoG 响应进行异步分类。所有实验中的结果测量包括基于宽带 γ 活动的跨类型区分表现。实验 I 在区分七种类型时（没有分色），展示了 72.9% 的离线分类准确率。进一步区分灰色与彩色图像的准确度达到 67.1%。区分所有颜色和类型（14 个类别）的准确度为 52.1%。在实验 II 和 III 中，实时解码器正确检测到对面部、汉字和黑色计算机刺激的响应为 73.7%，对呈现的自然场景的响应为 74.8%。使用宽带 γ 活动可以检测和区分七种不同的类型及其颜色信息（灰色或颜色）。组合时空信息的辨别性能最大化。刺激颜色信息的辨别为人类与颜色相关的群体水平皮质宽带 γ 反应提供了第一个基于 ECoG 的证据。刺激类别可以通过其 ECoG 响应在刺激发生 500 毫秒内实时检测。
Several neuroimaging studies have demonstrated that the ventral temporal cortex contains specialized regions that process visual stimuli. This study investigated the spatial and temporal dynamics of electrocorticographic (ECoG) responses to different types and colors of visual stimulation that were presented to four human participants, and demonstrated a real-time decoder that detects and discriminates responses to untrained natural images. ECoG signals from the participants were recorded while they were shown colored and greyscale versions of seven types of visual stimuli (images of faces, objects, bodies, line drawings, digits, and kanji and hiragana characters), resulting in 14 classes for discrimination (experiment I). Additionally, a real-time system asynchronously classified ECoG responses to faces, kanji and black screens presented via a monitor (experiment II), or to natural scenes (i.e., the face of an experimenter, natural images of faces and kanji, and a mirror) (experiment III). Outcome measures in all experiments included the discrimination performance across types based on broadband γ activity. Experiment I demonstrated an offline classification accuracy of 72.9% when discriminating among the seven types (without color separation). Further discrimination of grey versus colored images reached an accuracy of 67.1%. Discriminating all colors and types (14 classes) yielded an accuracy of 52.1%. In experiment II and III, the real-time decoder correctly detected 73.7% responses to face, kanji and black computer stimuli and 74.8% responses to presented natural scenes. Seven different types and their color information (either grey or color) could be detected and discriminated using broadband γ activity. Discrimination performance maximized for combined spatial-temporal information. The discrimination of stimulus color information provided the first ECoG-based evidence for color-related population-level cortical broadband γ responses in humans. Stimulus categories can be detected by their ECoG responses in real time within 500 ms with respect to stimulus onset.
登录
查看更多内容
影响因子：
5.7
作者：
Coon WG;Gunduz A;Brunner P;Ritaccio AL;Pesaran B;Schalk G
通讯作者：
Schalk G
影响因子：
3.2
作者：
Chang EF;Edwards E;Nagarajan SS;Fogelson N;Dalal SS;Canolty RT;Kirsch HE;Barbaro NM;Knight RT
通讯作者：
Knight RT
影响因子：
3.7
作者：
Engell, Andrew D.;McCarthy, Gregory
通讯作者：
McCarthy, Gregory
影响因子：
5.7
作者：
Engell, Andrew D.;Huettel, Scott;McCarthy, Gregory
通讯作者：
McCarthy, Gregory
影响因子：
2.9
作者：
Engell, Andrew D.;McCarthy, Gregory
通讯作者：
McCarthy, Gregory