Effects of Temporal Congruity Between Auditory and Visual Stimuli Using Rapid Audio-Visual Serial Presentation
Effects of Temporal Congruity Between Auditory and Visual Stimuli Using Rapid Audio-Visual Serial Presentation
复制标题
使用快速视听串行呈现对听觉和视觉刺激之间的时间一致性的影响
DOI：
10.1109/tbme.2015.2511539
复制
发表时间：
2016-10
影响因子：
4.6
通讯作者：
Ming Dong
中科院分区：
文献类型：
--
作者：
An Xingwei;Tang Jiabei;Liu Shuang;He Feng;Qi Hongzhi;Wan Baikun;Ming Dong
目的：结合视觉和听觉刺激对事件相关电位（ERP）拼写者的影响近年来受到越来越多的关注。这些研究很少注意到视觉和听觉的转移引起的ERP成分和系统效率的差异。本研究旨在研究听觉和视觉刺激的时间一致性对双模脑机接口（BCI）拼写的影响。方法：设计5种视听觉组合范式，分别具有不同的视听觉延迟（-33 ~ +100 ms）。11名参与者参加了这项研究。erp分别根据视觉和听觉刺激的开始获得和排列。通过统计分析不同条件下Fz、Cz和PO7通道的erp与视觉对齐和音频对齐的erp。在视觉对齐erp的基础上，分析分类精度，寻求视觉到听觉延迟的影响。结果：ERP的潜伏期主要取决于视觉刺激的开始。听觉刺激的开始主要影响早期成分的准确性，而视觉刺激的开始主要影响后期成分的准确性。而后者在总体分类中起主导作用。意义：本研究对进一步研究获得更好的解释并最终确定优化双峰BCI应用的方法具有重要意义。
Goal: Combining visual and auditory stimuli in event-related potential (ERP)-based spellers gained more attention in recent years. Few of these studies notice the difference of ERP components and system efficiency caused by the shifting of visual and auditory onset. Here, we aim to study the effect of temporal congruity of auditory and visual stimuli onset on bimodal brain-computer interface (BCI) speller. Methods: We designed five visual and auditory combined paradigms with different visual-to-auditory delays (-33 to +100 ms). Eleven participants attended in this study. ERPs were acquired and aligned according to visual and auditory stimuli onset, respectively. ERPs of Fz, Cz, and PO7 channels were studied through the statistical analysis of different conditions both from visual-aligned ERPs and audio-aligned ERPs. Based on the visual-aligned ERPs, classification accuracy was also analyzed to seek the effects of visual-to-auditory delays. Results: The latencies of ERP components depended mainly on the visual stimuli onset. Auditory stimuli onsets influenced mainly on early component accuracies, whereas visual stimuli onset determined later component accuracies. The latter, however, played a dominate role in overall classification. Significance: This study is important for further studies to achieve better explanations and ultimately determine the way to optimize the bimodal BCI application.
登录
查看更多内容
听着，你在写！使用动态的听觉BCI加速在线拼写。
影响因子：
4.3
作者：
Schreuder M;Rost T;Tangermann M
通讯作者：
Tangermann M
DOI：
--
发表时间：
2012-01
期刊：
--
影响因子：
--
作者：
J. Wolpaw;E. Wolpaw
通讯作者：
J. Wolpaw;E. Wolpaw
DOI：
10.1109/iembs.2008.4649364
发表时间：
2008-10
期刊：
2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
影响因子：
--
作者：
R. Fazel-Rezai;Kamyar Abhari
通讯作者：
R. Fazel-Rezai;Kamyar Abhari
影响因子：
3.7
作者：
An X;Höhne J;Ming D;Blankertz B
通讯作者：
Blankertz B
影响因子：
4
作者：
M. Thurlings;A. Brouwer;Jan B. F. van Erp;B. Blankertz;P. Werkhoven
通讯作者：
M. Thurlings;A. Brouwer;Jan B. F. van Erp;B. Blankertz;P. Werkhoven