HCC: Assessing Cognitive Function from Interactive Agent Behavior

HCC：从交互代理行为评估认知功能

• 批准号: 0713690
• 负责人: Deniz Erdogmus
• 金额: --
• 依托单位: Oregon Health & Science University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-10-01 至 2009-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0713690&HistoricalAwards=false
• 关键词: HCC; Assessing; Cognitive; Function; Interactive

This is a project to develop new methods for scientifically studying and assessing human cognitive function. It will employ sophisticated statistical multimodal data analysis techniques that will fuse contextual, behavioral, and neural information simultaneously obtained from human beings in the process of completing complex batteries of cognitive tasks. The tasks will be presented in the form of customized computer games that are designed to exhibit the crucial aspects of established cognitive assessment tests and at the same time provide a motivating and engaging environment for the subject's interactions with the game and computer agents. The tasks will involve exploiting our existing capabilities of monitoring and controlling certain enjoyable and challenging computer games that involve various combinations of cognitive tasks ranging from working memory and attention to executive functions. Multimodal information fusion will be accomplished by utilizing Bayesian inference techniques and information theoretic data analysis and dimensionality reduction methods. The work to be carried out under this grant aims to develop sophisticated pattern analysis techniques for the purpose of analyzing the fine-grain behaviors of elderly when they are engaged in complex cognitive tasks in the form of computer games. Expected significant scientific findings from the proposed research are two-fold: (1) improved statistical signal processing and pattern recognition algorithms for EEG processing, (2) an enhanced understanding of the interplay of multiple cognitive processes and their neural signatures in EEG during the execution of complex tasks. The approach is innovative in terms of three aspects: (1) an advanced adaptive interaction protocol that modifies the task parameters to maintain maximal sensitivity to cognitive state changes will be employed, (2) novel information theoretic techniques will be developed and utilized for the extraction of maximally discriminative features from EEG measurements for cognitive state estimation and neural activity visualization, (3) the developed closed-loop system will be utilized to study the human-agent interaction in complex cognitive tasks resulting in mathematical models of micro-behavior in realistic evolving environments as opposed to traditional stationary repetitive experimental paradigms. The successful completion of the work will open the way to further collaborative activities in brain interface design, closed-loop collaborative augmented cognition human-agent interfaces for improved performance, and early diagnosis of cognitive decline in elderly. An interdisciplinary research environment will engage the participating graduate students in a multidisciplinary educational setting and will help them develop skills to perform collaborative interdisciplinary research.

这是一个开发科学研究和评估人类认知功能的新方法的项目。它将采用复杂的统计多模态数据分析技术，融合上下文、行为和神经信息，同时从人类完成复杂的认知任务的过程中获得。这些任务将以定制的电脑游戏的形式呈现，旨在展示已建立的认知评估测试的关键方面，同时为受试者与游戏和计算机代理的互动提供一个激励和吸引人的环境。这些任务将涉及利用我们现有的监控和控制某些有趣和具有挑战性的电脑游戏的能力，这些游戏涉及从工作记忆和注意力到执行功能的各种认知任务组合。多模态信息融合将利用贝叶斯推理技术、信息论数据分析和降维方法来实现。这项资助的目的是发展复杂的模式分析技术，以分析长者在电脑游戏中进行复杂认知任务时的细微行为。本研究预计将取得两方面的重大科学成果：(1)改进脑电图处理的统计信号处理和模式识别算法；(2)增强对复杂任务执行过程中脑电图中多个认知过程及其神经特征的相互作用的理解。该方法的创新性体现在三个方面：(1)将采用一种先进的自适应交互协议，修改任务参数以保持对认知状态变化的最大敏感性；(2)将开发新的信息理论技术，并将其用于从脑电图测量中提取最大判别特征，用于认知状态估计和神经活动可视化；(3)开发的闭环系统将用于研究复杂认知任务中的人与智能体相互作用，从而建立现实进化环境中微观行为的数学模型，而不是传统的固定重复实验范式。这项工作的成功完成将为进一步开展脑接口设计、闭环协同增强认知人机界面以提高性能、早期诊断老年人认知能力下降等方面的协作活动开辟道路。跨学科的研究环境将使参与的研究生参与到多学科的教育环境中，并将帮助他们发展进行跨学科合作研究的技能。