CHS: Small: Optimizing Human-Machine Performance via Neurofeedback and Adaptive Autonomy

CHS：小型：通过神经反馈和自适应自主优化人机性能

• 批准号: 1816363
• 负责人: Paul Sajda
• 金额: $ 49.88万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2022-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1816363&HistoricalAwards=false
• 关键词: CHS; Small; Optimizing; Human; Machine

Our society is being fundamentally transformed by increased interaction between humans and autonomous artificial intelligence (AI) systems. However, the addition of autonomy to our lives will not be successful unless we understand how smart machines and humans should best interact and communicate. Human-machine communication today is almost entirely linguistic, using spoken language for systems such as Siri or Alexa, or typed text for chatbots. However, humans communicate extremely efficiently with each other byu sing much more than just words; for example by being sensitive to facial expression, gestures, gait, and intonation. In fact, great teams, whether sports teams or military combat teams, are excellent at predicting teammates behavior and state of mind. In this project, the investigators consider both basic science and technology questions with respect to how to communicate that cognitive and physiological state of a human that is co-operating with an autonomous AI. The project has very broad implications since it addresses fundamental questions related to the interactions between humans and smart machines.The project investigates the hypothesis that adaptive autonomy together with coordinated neurofeedback can be employed in the same system to optimize human-machine performance. Investigators will develop a framework and investigate the hypothesis within the context of boundary avoidance tasks, or BAT, which is a class of tasks in which task critical boundaries surround the optimal operating point of the control system. These tasks are particularly interesting when considering human control because they typically result in a positive feedback loop that systematically increases the arousal state of the human subject, resulting in increasingly poor task performance and ultimate task failure, consistent with the Yerkes-Dodson law. Our framework uses a brain-computer interface (BCI) to both engage autonomy as well as being a source for neurofeedback that can shift human subjects to their performance 'sweet-spot'. This project will advance the science and technology development of how human-machine systems can be optimally integrated, specifically when both 1) the machine has access to ongoing changes in human cognitive and physiological state during performance of the task and 2) the human is made aware of their own state via appropriate neurofeedback.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

我们的社会正在从根本上改变人类与自主人工智能（AI）系统之间的互动。然而，除非我们理解智能机器和人类应该如何最好地互动和沟通，否则将自主权添加到我们的生活中不会成功。今天的人机通信几乎完全是语言的，使用Siri或Alexa等系统的口语，或聊天机器人的输入文本。 然而，人类之间的交流非常有效，不仅仅是通过语言，例如通过对面部表情，手势，步态和语调的敏感。事实上，伟大的团队，无论是运动队还是军事战斗队，都擅长预测队友的行为和精神状态。在这个项目中，研究人员考虑了基本的科学和技术问题，即如何传达与自主AI合作的人类的认知和生理状态。该项目具有非常广泛的意义，因为它解决了与人类和智能机器之间的相互作用有关的基本问题。该项目研究了一种假设，即自适应自主性与协调的神经反馈可以在同一系统中使用，以优化人机性能。研究人员将开发一个框架，并在边界回避任务（BAT）的背景下研究假设，BAT是一类任务，其中任务关键边界围绕控制系统的最佳操作点。当考虑人类控制时，这些任务特别有趣，因为它们通常会导致系统地增加人类受试者的唤醒状态的正反馈回路，导致越来越差的任务表现和最终的任务失败，这与Yerkes-Dodson定律一致。我们的框架使用脑机接口（BCI）来实现自主性，并成为神经反馈的来源，可以将人类受试者转移到他们的表现“甜蜜点”。该项目将推动人机系统如何最佳整合的科学和技术发展，特别是当1）机器在执行任务期间可以访问人类认知和生理状态的持续变化，以及2）该奖项反映了NSF的法定使命，并被认为是值得通过使用基金会的学术价值和更广泛的影响审查标准。

项目成果

Investigating Evoked EEG Responses to Targets Presented in Virtual Reality

研究对虚拟现实中呈现的目标的诱发脑电图反应

• DOI: 10.1109/embc.2019.8856761
• 发表时间: 2019
• 期刊: 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC
• 作者: Lapborisuth, Pawan;Faller, Josef;Koss, Jonathan;Waytowich, Nicholas R.;Touryan, Jonathan;Sajda, Paul
• 通讯作者: Sajda, Paul

Integrating neural and ocular attention reorienting signals in virtual reality

• DOI: 10.1088/1741-2552/ac4593
• 发表时间: 2021-12
• 期刊: Journal of Neural Engineering
• 影响因子: 4
• 作者: Pawan Lapborisuth;Sharath C. Koorathota;Qi Wang;P. Sajda