HCC: Collaborative Research: Continuous Control Brain-Computer Interfaces for Creative Expression

HCC：协作研究：持续控制脑机接口以实现创意表达

• 批准号: 0705679
• 负责人: Melody Jackson
• 金额: $ 29.16万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-08-01 至 2010-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0705679&HistoricalAwards=false
• 关键词: HCC; Collaborative; Research; Continuous; Control

Severe motor disabilities, including locked-in syndrome and paralysis, impact the quality of life for millions of people worldwide. The PIs' prior work in brain-computer interfaces based on functional near-infrared (fNIR) imaging has shown great promise for restoring communication and environmental control to people with such disabilities. Currently, typical control interfaces for these systems are simple discrete selection paradigms, which have proven to be effective but limited in information throughput rates. Innovative control interfaces based on continuous control paradigms, which dynamically map brain signal levels to control signals, have not been adequately studied for fNIR imaging. Depending upon the extent to which brain signals can be effectively mapped to continuous control, adding this feature to existing discrete control could significantly increase the range of tasks that can be performed by users of an fNIR-based direct brain interface (e.g., positional selection or 2-D drawing). In this work, the PIs will explore innovative direct brain-computer interfaces for continuous control and use them to develop applications for creative expression. For people with severe motor disabilities, creative expression can provide an emotional outlet as well as mental exercise to improve quality of life. The tasks inherent in creating visual art, such as drawing, coloring, and texturing, cannot be accomplished with discrete controls. Therefore, visual art provides an ideal experimental platform to study fNIR-based continuous control interfaces. It also provides an engaging and motivating platform for training that will improve users' abilities to control a direct brain interface. To these ends, the PIs will study non-traditional control interfaces for continuous and discrete selection such as wheels, dials, and gauges, to determine to what extent fNIR signals can be mapped to continuous control. The PIs will explore continuous methods for selection and control of art media such as brushes, colors, textures, and shapes, and investigate to what extent continuous brain signals can be translated into visual art gestures (drawing, shading, coloring). The advice of a professional, internationally-known artist who has ALS will guide the user requirements of the control interfaces. Quantitative and qualitative user performance data will be collected, and will among other things be used to compare learning effects with a visual art paradigm against traditional, discrete selection exercises to determine if training time and performance can be improved. Project outcomes will add to the body of knowledge for assistive technology and human-computer interfaces.Broader Impacts: Methods for translating cortical oxygenation signals into continuous control signals for user interfaces will have mainstream applications for assistive technologies by essentially "smoothing" noisy input signals. Such developments could be applied for use by those with reduced motor coordination, including the elderly, young children, and those with motor diseases such as Parkinson's disease. Mainstream users may benefit from a hands-free interface, and neural control could provide added dimensions to the creative process.

严重的运动障碍，包括闭锁综合症和瘫痪，影响着全世界数百万人的生活质量。PI在基于功能性近红外(FNIR)成像的脑机接口方面的先前工作已经显示出在恢复此类残疾人的通信和环境控制方面的巨大希望。目前，这些系统的典型控制接口是简单的离散选择范例，已被证明是有效的，但在信息吞吐速率方面受到限制。基于连续控制范例的创新控制界面，动态地将大脑信号水平映射到控制信号，尚未被充分研究用于fnIR成像。根据大脑信号可以有效映射到连续控制的程度，将这一功能添加到现有的离散控制可能会显著增加基于fnir的直接大脑接口(例如，位置选择或2-D绘图)用户可以执行的任务范围。在这项工作中，PI将探索创新的直接脑机接口，以实现持续控制，并利用它们开发创造性表达的应用程序。对于严重运动障碍的人来说，创造性的表达可以提供一种情绪发泄的方式，也可以提供精神锻炼，以提高生活质量。创建视觉艺术所固有的任务，如绘制、着色和纹理，不能使用离散控件来完成。因此，视觉艺术为研究基于模糊神经网络的连续控制界面提供了一个理想的实验平台。它还提供了一个引人入胜和激励人心的培训平台，将提高用户控制直接大脑接口的能力。为此，PI将研究用于连续和离散选择的非传统控制接口，如车轮、刻度盘和量规，以确定FNIR信号可以映射到连续控制的程度。PI将探索选择和控制画笔、颜色、纹理和形状等艺术媒介的持续方法，并调查连续的大脑信号在多大程度上可以转化为视觉艺术手势(绘画、着色、着色)。患有肌萎缩侧索硬化症的专业国际知名艺术家的建议将指导用户对控制界面的要求。将收集定量和定性的用户表现数据，除其他外，将用于比较视觉艺术范例的学习效果与传统的离散选择练习，以确定是否可以改善培训时间和表现。项目成果将增加辅助技术和人机界面的知识体系。广泛的影响：将皮质氧合信号转换为用户界面的连续控制信号的方法将通过本质上“平滑”噪声输入信号而在辅助技术中得到主流应用。这种发展可以应用于那些运动协调性降低的人，包括老年人、幼儿和患有运动疾病(如帕金森氏病)的人。主流用户可能会从免提界面中受益，神经控制可以为创作过程提供额外的维度。