EAGER: Toward a General Framework for Optimal Experimentation in Computational Cognition

EAGER：建立计算认知优化实验的通用框架

• 批准号: 1834323
• 负责人: Woojae Kim
• 金额: $ 29.98万
• 依托单位: Howard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-15 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1834323&HistoricalAwards=false
• 关键词: EAGER; Toward; General; Framework; Optimal

Cognitive science aims to gain detailed insight into the underlying mechanisms of cognitive tasks. To achieve this, researchers change factors affecting a task in an experiment and observe responses. One way to learn from such an experiment is to build and test a computational model of stimulus-response relationships. However, the level of detail with which a model describes a task requires as much detail in supporting data. As observations from experiments are often expensive (e.g., child subject), this is a rather significant barrier. The method of optimal experiments can be a solution. It can optimize the selection of stimuli to maximize inference from responses. Nonetheless, the difficulty in applying the method to each new experiment has been a stumbling block. This project proposes to lay the foundation for a general framework for optimal experiments. The goal is to make it applicable to a wide range of modeling problems in cognitive science. This will help cognitive scientists to develop quantitative accounts of cognitive tasks effectively. Further, the method has the potential to accelerate scientific discovery broadly in social and behavioral research.Conducting cognitive science experiments guided by optimal interaction with subjects toward a clear, quantified inference goal is a powerful idea. Such a method is particularly enticing for behavioral experiments in which the amount of noise in response is so great as to require many repeated measurements. Despite its groundbreaking potential for cognitive modeling research, the method of optimal experimentation is out of reach for most researchers in the field. The formidable task of implementing it for each unique experimental paradigm has been an obstacle to the realization of the methodology's promising power. The project focuses on establishing the technical feasibility of optimal experiments in arbitrary cognitive modeling contexts. The proposed research will define the need for the methodology in the field clearly, identify suitable computational strategies, and test alternative algorithms in simulation studies. The performance of algorithms under consideration will be evaluated on a testbed of modeling paradigms whose successful treatment would transfer to a wide range of similar problems. The project aims to create a tangible blueprint for a general-purpose methodology for optimal experimentation in computational cognition.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

认知科学旨在详细了解认知任务的潜在机制。为了实现这一目标，研究人员在实验中改变影响任务的因素并观察反应。从此类实验中学习的一种方法是建立并测试刺激-反应关系的计算模型。然而，模型描述任务的详细程度需要支持数据的详细程度。由于实验观察通常很昂贵（例如儿童受试者），因此这是一个相当重要的障碍。最优实验方法可以作为解决方案。它可以优化刺激的选择，以最大限度地从响应中进行推断。尽管如此，将该方法应用于每个新实验的困难一直是一个绊脚石。该项目旨在为优化实验的总体框架奠定基础。目标是使其适用于认知科学中的广泛建模问题。这将有助于认知科学家有效地开发认知任务的定量描述。此外，该方法有可能广泛加速社会和行为研究中的科学发现。在与受试者的最佳互动的指导下进行认知科学实验，以实现清晰、量化的推理目标，这是一个强大的想法。这种方法对于行为实验特别有吸引力，在行为实验中，响应的噪声量很大，需要多次重复测量。尽管其在认知建模研究方面具有突破性的潜力，但最佳实验方法对于该领域的大多数研究人员来说是遥不可及的。为每个独特的实验范式实施它的艰巨任务一直是实现该方法的有希望的力量的障碍。该项目的重点是在任意认知建模环境中建立最佳实验的技术可行性。拟议的研究将明确定义该领域对该方法的需求，确定合适的计算策略，并在模拟研究中测试替代算法。正在考虑的算法的性能将在建模范例的测试平台上进行评估，其成功的处理将转移到广泛的类似问题。该项目旨在为计算认知最佳实验的通用方法创建一个切实的蓝图。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。