Exploring combinations of auditory and visual stimuli for gaze-independent brain-computer interfaces.
Exploring combinations of auditory and visual stimuli for gaze-independent brain-computer interfaces.
复制标题
DOI：
10.1371/journal.pone.0111070
复制
发表时间：
2014
期刊：
影响因子：
3.7
通讯作者：
Blankertz B
中科院分区：
文献类型：
--
作者：
An X;Höhne J;Ming D;Blankertz B
对于为眼动系统严重受损的用户设计的脑机接口(BCI)系统，向用户呈现刺激的适当模式是至关重要的。为了探讨在非注视相关事件相关电位(ERP)拼写中是否可以利用多感觉整合，以提高脑-机接口(BCI)性能，我们设计了一个视听拼写。我们研究了通过在非凝视拼写中结合视觉和听觉刺激来增强刺激呈现的可能性。本研究以N- = 15名健康使用者为被试，提出了两种不同的组合方式：同时冗余流(Combated-Speller)和交织独立流(Parly-Speller)。以单峰刺激作为对照条件。分析了每种情况下的工作量、ERP组件、分类准确率和拼写速度。在不牺牲拼写成绩的情况下，组合拼写器表现出比单一模式范式更低的工作量。此外，组合拼写者的辨别信息的潜伏期更短，波幅更低，辨别信息的时间和空间分布发生了移位。这些结果是重要的，并为未来的研究寻找这些差异的原因提供了启发。对于更具创新性和要求更高的平行拼写，其中听觉和视觉领域相互独立，得到了概念证明：15个用户可以在线拼写，平均准确率为87.7%(机会水平为3%)，竞争平均速度为每分钟1.65个符号。其每个码元仅需要一个选择周期的事实使其成为快速通信信道的良好候选者。它为真正的多感官刺激范式带来了新的见解。本文设计了两种感觉模式结合的新方法，这对基于ERP的脑-机接口范式的发展具有重要意义。
For Brain-Computer Interface (BCI) systems that are designed for users with severe impairments of the oculomotor system, an appropriate mode of presenting stimuli to the user is crucial. To investigate whether multi-sensory integration can be exploited in the gaze-independent event-related potentials (ERP) speller and to enhance BCI performance, we designed a visual-auditory speller. We investigate the possibility to enhance stimulus presentation by combining visual and auditory stimuli within gaze-independent spellers. In this study with N = 15 healthy users, two different ways of combining the two sensory modalities are proposed: simultaneous redundant streams (Combined-Speller) and interleaved independent streams (Parallel-Speller). Unimodal stimuli were applied as control conditions. The workload, ERP components, classification accuracy and resulting spelling speed were analyzed for each condition. The Combined-speller showed a lower workload than uni-modal paradigms, without the sacrifice of spelling performance. Besides, shorter latencies, lower amplitudes, as well as a shift of the temporal and spatial distribution of discriminative information were observed for Combined-speller. These results are important and are inspirations for future studies to search the reason for these differences. For the more innovative and demanding Parallel-Speller, where the auditory and visual domains are independent from each other, a proof of concept was obtained: fifteen users could spell online with a mean accuracy of 87.7% (chance level <3%) showing a competitive average speed of 1.65 symbols per minute. The fact that it requires only one selection period per symbol makes it a good candidate for a fast communication channel. It brings a new insight into the true multisensory stimuli paradigms. Novel approaches for combining two sensory modalities were designed here, which are valuable for the development of ERP-based BCI paradigms.
登录
查看更多内容
听着，你在写！使用动态的听觉BCI加速在线拼写。
影响因子：
4.3
作者：
Schreuder M;Rost T;Tangermann M
通讯作者：
Tangermann M
影响因子：
19.9
作者：
Talsma, Durk;Senkowski, Daniel;Soto-Faraco, Salvador;Woldorff, Marty G.
通讯作者：
Woldorff, Marty G.
影响因子：
3.7
作者：
Schreuder M;Blankertz B;Tangermann M
通讯作者：
Tangermann M
DOI：
10.1111/j.1749-6632.2008.04122.x
发表时间：
2009-01-01
期刊：
DISORDERS OF CONSCIOUSNESS
影响因子：
--
作者：
Kuebler, Andrea;Furdea, Adrian;Kotchoubey, Boris
通讯作者：
Kotchoubey, Boris
影响因子：
4
作者：
Brunner P;Joshi S;Briskin S;Wolpaw JR;Bischof H;Schalk G
通讯作者：
Schalk G