Acquiring cognitive maps: how brains learn hidden structure

获取认知图:大脑如何学习隐藏结构

基本信息

  • 批准号:
    10739622
  • 负责人:
  • 金额:
    $ 14.52万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
  • 财政年份:
    2023
  • 资助国家:
    美国
  • 起止时间:
    2023-06-01 至 2027-05-31
  • 项目状态:
    未结题

项目摘要

Project Summary: Animals perform goal-directed behaviors in complex environments, without the need for extensive experience, by harnessing an internal model of the world. These internal models, or cognitive maps, are central to model-based decision making. Importantly, understanding the neural circuitry of model-based decisions holds promise for improving treatments of neuropsychiatric disorders in which decision-making goes awry. An outstanding question in reinforcement learning (RL) is how cognitive maps are learned from experience, and what neural substrates support them. The orbitofrontal cortex (OFC) has been implicated in representing cognitive maps, and this project proposes to characterize the emergence of a cognitive map in rodent OFC during a value-based decision making task. This project asks three core questions: 1) How does a model-based RL agent learn a cognitive map using purely model-free RL methods? Here recent advances in meta-RL in state-of- the-art recurrent neural network (RNN) models will be trained with model-free RL, in which the emergence of a cognitive map can be fully characterized. 2) How does the OFC represent cognitive maps? Here partially trained rats will be implanted with Neuropixels probes, and neural recordings will capture emerging representations of cognitive maps in population-level OFC activity as rats learn the task structure. 3) Can poor learning of cognitive maps be bolstered with structured behavioral training? An attractive therapeutic approach for improving decision making strategies is through behavioral training alone, and here an RNN model of rodents will be used to characterize modes of poor learning and develop prescriptive training, and will then be employed in rats to uniquely addresses specific learning deficits. This proposed project employs both experimental and computational techniques as part a comprehensive career development plan toward becoming an independent investigator. Specific experimental training for electrophysi- ological recordings from behaving animals complements computational training on modeling neural activity with deep neural networks. The career development plan also includes structured opportunities for collaborating with experimentalists. It incorporates a breadth of science communication experiences through research conferences and public talks within the local training institution. Importantly, the career development plan incorporates targeted preparation for independent investigator applications, including chalk-talk opportunities, workshops to develop unique research questions, and exposure to the faculty search process. The Constantinople, Savin, and Glim- cher labs at New York University’s Center for Neural Science are a training environment uniquely positioned to deliver this interdisciplinary training: their cutting-edge research into decision-making, animal behavior, reinforce- ment learning, and systems neuroscience make it an ideal institution and set of labs to develop a health-related career studying decision-making strategies in neuroscience.
项目概述:动物在复杂的环境中执行目标导向的行为,而不需要 丰富的经验,通过利用世界的内部模型。这些内部模型,或者说认知地图, 是基于模型的决策的核心。重要的是,理解基于模型的神经回路 决策为改善神经精神疾病的治疗提供了希望, 歪了强化学习(RL)中的一个突出问题是如何从经验中学习认知地图, 以及支持它们的神经基质。眶额皮质(OFC)参与了 认知地图,该项目提出的特点出现认知地图在啮齿动物眶额皮层期间, 基于价值的决策任务。该项目提出了三个核心问题:1)基于模型的RL如何 智能体使用纯无模型强化学习方法学习认知地图?在这里,最新的进展,元RL在国家的- 最先进的递归神经网络(RNN)模型将使用无模型RL进行训练,其中 认知地图可以充分表征。2)眶额皮层是如何表现认知地图的?在这里部分训练 老鼠将被植入神经像素探针,神经记录将捕捉新兴的表征, 的认知地图在人口水平的OFC活动作为大鼠学习的任务结构。3)学习能力差 认知地图可以用结构化的行为训练来支撑吗?一种有吸引力的治疗方法, 决策策略仅通过行为训练,这里将使用啮齿动物的RNN模型 描述学习不良的模式,并制定规定性的训练,然后将在大鼠中使用, 独特地解决了特定的学习缺陷。 该项目采用实验和计算技术作为综合职业生涯的一部分 成为独立调查员的发展计划。电生理学的具体实验培训- 行为动物的生理记录补充了神经活动建模的计算训练, 深层神经网络。职业发展计划还包括与以下机构合作的结构化机会: 实验主义者它通过研究会议整合了广泛的科学传播经验 以及在当地培训机构进行公开讲座。重要的是,职业发展计划纳入了有针对性的 准备独立调查员的申请,包括粉笔谈话机会, 独特的研究问题,并暴露于教师搜索过程。君士坦丁堡、萨文和格里姆 纽约大学神经科学中心的雪儿实验室是一个独特的培训环境, 提供这种跨学科的培训:他们对决策,动物行为的前沿研究,加强- 它是一个理想的机构和一套实验室,以开发与健康相关的 研究神经科学中的决策策略。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

David Hocker其他文献

David Hocker的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

相似海外基金

RII Track-4:NSF: From the Ground Up to the Air Above Coastal Dunes: How Groundwater and Evaporation Affect the Mechanism of Wind Erosion
RII Track-4:NSF:从地面到沿海沙丘上方的空气:地下水和蒸发如何影响风蚀机制
  • 批准号:
    2327346
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Standard Grant
BRC-BIO: Establishing Astrangia poculata as a study system to understand how multi-partner symbiotic interactions affect pathogen response in cnidarians
BRC-BIO:建立 Astrangia poculata 作为研究系统,以了解多伙伴共生相互作用如何影响刺胞动物的病原体反应
  • 批准号:
    2312555
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Standard Grant
How Does Particle Material Properties Insoluble and Partially Soluble Affect Sensory Perception Of Fat based Products
不溶性和部分可溶的颗粒材料特性如何影响脂肪基产品的感官知觉
  • 批准号:
    BB/Z514391/1
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Training Grant
Graduating in Austerity: Do Welfare Cuts Affect the Career Path of University Students?
紧缩毕业:福利削减会影响大学生的职业道路吗?
  • 批准号:
    ES/Z502595/1
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Fellowship
感性個人差指標 Affect-X の構築とビスポークAIサービスの基盤確立
建立个人敏感度指数 Affect-X 并为定制人工智能服务奠定基础
  • 批准号:
    23K24936
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Insecure lives and the policy disconnect: How multiple insecurities affect Levelling Up and what joined-up policy can do to help
不安全的生活和政策脱节:多种不安全因素如何影响升级以及联合政策可以提供哪些帮助
  • 批准号:
    ES/Z000149/1
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Research Grant
How does metal binding affect the function of proteins targeted by a devastating pathogen of cereal crops?
金属结合如何影响谷类作物毁灭性病原体靶向的蛋白质的功能?
  • 批准号:
    2901648
  • 财政年份:
    2024
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Studentship
ERI: Developing a Trust-supporting Design Framework with Affect for Human-AI Collaboration
ERI:开发一个支持信任的设计框架,影响人类与人工智能的协作
  • 批准号:
    2301846
  • 财政年份:
    2023
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Standard Grant
Investigating how double-negative T cells affect anti-leukemic and GvHD-inducing activities of conventional T cells
研究双阴性 T 细胞如何影响传统 T 细胞的抗白血病和 GvHD 诱导活性
  • 批准号:
    488039
  • 财政年份:
    2023
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Operating Grants
How motor impairments due to neurodegenerative diseases affect masticatory movements
神经退行性疾病引起的运动障碍如何影响咀嚼运动
  • 批准号:
    23K16076
  • 财政年份:
    2023
  • 资助金额:
    $ 14.52万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了