An online SSVEP-BCI system in an optical see-through augmented reality environment
An online SSVEP-BCI system in an optical see-through augmented reality environment
复制标题
光学透视增强现实环境中的在线 SSVEP-BCI 系统
DOI：
10.1088/1741-2552/ab4dc6
复制
发表时间：
2020-02-01
影响因子：
4
通讯作者：
Ming, Dong
中科院分区：
文献类型：
--
作者：
Ke, Yufeng;Liu, Pengxiao;Ming, Dong
目标。本研究旨在设计和评估光学透视(OST)增强现实(AR)环境中基于视觉诱发电位(SSVEP)的高速在线稳态脑机接口(BCI)。接近。在可穿戴的OST-AR耳机中设计了八级BCI，使用户可以通过OST头盔显示器在同一视场中看到BCI和设备的用户界面。对AR-BCI的准确率、信息传输率(ITRs)和SSVEP信号特征进行了评估，并与在离线和在线线索引导任务中使用笔记本电脑实现的基于计算机屏幕的BCI进行了比较。然后，在在线机械臂控制任务中对AR-BCI的性能进行了评估。主要结果。在使用AR-BCI执行线索引导任务期间获得的离线结果显示，根据基于扩展典型相关分析的目标识别方法，最大平均ITR为65.50+/-9.86比特min(-1)。在线线索引导任务获得的平均ITR为65.03+/-11.40 bit min(-1)。在线机械臂控制任务实现了平均ITR为45.57+/-7.40位min(-1)。与基于屏幕的BCI相比，AR环境的一些局限性影响了BCI的性能和SSVEP信号的质量。意义重大。结果表明，通过结合AR和BCI，有可能提供一种高性能的脑控交互方法。这项研究可以为在OST-AR环境中开发更多可穿戴的BCI提供方法学指导，并将鼓励更多涉及BCI和AR技术的有趣应用。
Objective. This study aimed to design and evaluate a high-speed online steady-state visually evoked potential (SSVEP)-based brain-computer interface (BCI) in an optical see-through (OST) augmented reality (AR) environment. Approach. An eight-class BCI was designed in an OST-AR headset which is wearable and allows users to see the user interface of the BCI and the device to be controlled in the same view field via the OST head-mounted display. The accuracies, information transfer rates (ITRs), and SSVEP signal characteristics of the AR-BCI were evaluated and compared with a computer screen-based BCI implemented with a laptop in offline and online cue-guided tasks. Then, the performance of the AR-BCI was evaluated in an online robotic arm control task. Main results. The offline results obtained during the cue-guided task performed with the AR-BCI showed maximum averaged ITRs of 65.50 +/- 9.86 bits min(-1) according to the extended canonical correlation analysis-based target identification method. The online cue-guided task achieved averaged ITRs of 65.03 +/- 11.40 bits min(-1). The online robotic arm control task achieved averaged ITRs of 45.57 +/- 7.40 bits min(-1). Compared with the screen-based BCI, some limitations of the AR environment impaired BCI performance and the quality of SSVEP signals. Significance. The results showed the potential for providing a high-performance brain-control interaction method by combining AR and BCI. This study could provide methodological guidelines for developing more wearable BCIs in OST-AR environments and will also encourage more interesting applications involving BCIs and AR techniques.