A Wearable Multi-Modal Bio-Sensing System Towards Real-World Applications
A Wearable Multi-Modal Bio-Sensing System Towards Real-World Applications
复制标题
DOI：
10.1109/tbme.2018.2868759
复制
发表时间：
2019-04
影响因子：
4.6
通讯作者：
.. Siddharth-Siddharth-123964367;Aashish N. Patel;T. Jung;T. Sejnowski
中科院分区：
文献类型：
--
作者：
.. Siddharth-Siddharth-123964367;Aashish N. Patel;T. Jung;T. Sejnowski
多模态生物传感最近已被用作情感计算、自闭症、临床疾病和虚拟现实等领域的有效研究工具。然而，现有的生物传感系统都不支持在良好控制的实验室环境之外以可穿戴方式进行多模态测量和研究级测量。本文试图通过开发一种可穿戴多模态生物传感系统来弥补这一差距，该系统能够收集、同步、记录和传输来自多个生物传感器的数据：PPG、EEG、眼睛注视耳机、身体动作捕捉、GSR等，同时还提供包括视觉刺激标记在内的任务调制功能。这项研究描述了我们系统的各个组件的开发和集成。我们通过将测量值与标准研究级生物传感器获得的测量值进行比较来评估所开发的传感器。我们首先评估耳机的不同传感器模式，即基于耳垂的 PPG 模块，在心跳计算期间具有针对 ECG 的运动噪声消除功能。我们还将我们的屏蔽干式脑电图传感器测量的稳态视觉诱发电位与市售干式脑电图传感器获得的电位进行了比较。我们还研究了头部运动对可穿戴眼睛注视系统的准确性和精度的影响。此外，我们还开展了两项实际任务来演示使用多种传感器模式探索生物传感中以前无法回答的问题的应用。具体来说，利用生物传感，我们展示了哪种策略最适合玩“威利在哪里？”视觉搜索游戏，脑电图的变化对应于该游戏中的真假目标注视，并通过生物传感方式预测输/平/赢状态，同时了解其在“石头剪刀布”游戏中的局限性。
Multi-modal bio-sensing has recently been used as effective research tools in affective computing, autism, clinical disorders, and virtual reality among other areas. However, none of the existing bio-sensing systems support multi-modality in a wearable manner outside well-controlled laboratory environments with research-grade measurements. This paper attempts to bridge this gap by developing a wearable multi-modal bio-sensing system capable of collecting, synchronizing, recording, and transmitting data from multiple bio-sensors: PPG, EEG, eye-gaze headset, body motion capture, GSR, etc., while also providing task modulation features including visual-stimulus tagging. This study describes the development and integration of various components of our system. We evaluate the developed sensors by comparing their measurements to those obtained by a standard research-grade bio-sensors. We first evaluate different sensor modalities of our headset, namely, earlobe-based PPG module with motion-noise canceling for ECG during heart-beat calculation. We also compare the steady-state visually evoked potentials measured by our shielded dry EEG sensors with the potentials obtained by commercially available dry EEG sensors. We also investigate the effect of head movements on the accuracy and precision of our wearable eye-gaze system. Furthermore, we carry out two practical tasks to demonstrate the applications of using multiple sensor modalities for exploring previously unanswerable questions in bio-sensing. Specifically, utilizing bio-sensing, we show which strategy works best for playing “Where is Waldo?” visual-search game, changes in EEG corresponding to true vs. false target fixations in this game, and predicting the loss/draw/win states through bio-sensing modalities while learning their limitations in a “Rock-Paper-Scissors” game.