Computational foundations of active visual sensing

主动视觉传感的计算基础

基本信息

  • 批准号:
    10431247
  • 负责人:
  • 金额:
    $ 478.14万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
  • 财政年份:
    2022
  • 资助国家:
    美国
  • 起止时间:
    2022-03-15 至 2025-02-28
  • 项目状态:
    未结题

项目摘要

Abstract Vision is an active process: we move our head and eyes to explore the sensory world. This is particularly important in situations where a stationary view provides limited information, such as when looking for an object that is occluded or obscured, which is common in complex natural scenes. However, our understanding of active vision is limited due to experimental and theoretical challenges, including the difficulty of studying vision in freely moving animals and the lack of formal theoretical frameworks that integrate visual representations with actions. In this team project, we will combine expertise in visual neuroscience, behavior, machine learning, and theory, to determine the behavioral, neural, and computational underpinnings of active sensing. Our approach is based on a new theoretical framework of Bounded Rational Control (BRC), and a behavioral task in which mice perform an object recognition task in the presence of occlusion and image corruptions. To enable active sensing, stimuli in the task are rendered real-time in augmented reality based on the animal's viewpoint. In our first aim, we will develop models of active sensing based on constrained visual representations in BRC. In the second aim, we measure behavioral performance (both correct/incorrect responses and full-body movements) during the task, and in the third aim we will measure neural activity across visual cortical areas during the task. For both Aims 2 and 3, we will fit our models to the corresponding behavioral and neural data, and then perform causal tests of our models by presenting novel stimuli predicted to elicit specific responses from the model. Together, these aims will provide a foundational understanding of active vision in the mouse that will support a subsequent U19 proposal taking advantage of genetic tools to investigate the underlying local and long-range neural circuits.
摘要 视觉是一个主动的过程:我们移动我们的头和眼睛来探索感官世界。这是特别 在静止的观察者提供有限信息的情况下,例如在寻找物体时, 这在复杂的自然场景中很常见。然而,我们对积极的理解 视觉是有限的,由于实验和理论的挑战,包括自由研究视觉的困难, 移动的动物和缺乏正式的理论框架,整合视觉表现与行动。 在这个团队项目中,我们将联合收割机结合视觉神经科学,行为,机器学习和理论方面的专业知识, 以确定主动感知的行为、神经和计算基础。我们的做法是根据 在有限理性控制(BRC)的一个新的理论框架,和一个行为任务,小鼠执行 在存在遮挡和图像损坏的情况下的对象识别任务。为了启用主动感知,刺激 基于动物的视角在增强现实中实时呈现。在我们的第一个目标,我们将 基于BRC中的受限视觉表示,开发主动感知模型。第二个目标,我们 测量任务期间的行为表现(正确/不正确的反应和全身运动), 在第三个目标中,我们将测量任务期间视觉皮层区域的神经活动。两个目标 2和3,我们将我们的模型拟合到相应的行为和神经数据,然后进行因果检验 我们的模型,通过提出新的刺激,预测引起特定的反应,从模型。所有这些 目标将提供对鼠标主动视觉的基本理解,这将支持随后的U19 建议利用遗传工具来研究潜在的本地和远程神经回路。

项目成果

期刊论文数量(1)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Asymmetric distribution of color-opponent response types across mouse visual cortex supports superior color vision in the sky.
小鼠视觉皮层颜色对抗反应类型的不对称分布支持卓越的天空色觉。
  • DOI:
    10.1101/2023.06.01.543054
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Franke,Katrin;Cai,Chenchen;Ponder,Kayla;Fu,Jiakun;Sokoloski,Sacha;Berens,Philipp;Tolias,AndreasS
  • 通讯作者:
    Tolias,AndreasS
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Mackenzie Weygandt Mathis其他文献

Decoding the brain: From neural representations to mechanistic models
解读大脑:从神经表征到机理模型
  • DOI:
    10.1016/j.cell.2024.08.051
  • 发表时间:
    2024-10-17
  • 期刊:
  • 影响因子:
    42.500
  • 作者:
    Mackenzie Weygandt Mathis;Adriana Perez Rotondo;Edward F. Chang;Andreas S. Tolias;Alexander Mathis
  • 通讯作者:
    Alexander Mathis

Mackenzie Weygandt Mathis的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

相似海外基金

Wireless CMOS device for observing real-time brain activity and animal behavior
用于观察实时大脑活动和动物行为的无线 CMOS 设备
  • 批准号:
    23K06786
  • 财政年份:
    2023
  • 资助金额:
    $ 478.14万
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
Animal, Behavior and Tissue Core
动物、行为和组织核心
  • 批准号:
    10496282
  • 财政年份:
    2023
  • 资助金额:
    $ 478.14万
  • 项目类别:
Landscapes of fear in the Anthropocene: Linking predation risk and human disturbance to animal behavior and ecological outcomes
人类世的恐惧景观:将捕食风险和人类干扰与动物行为和生态结果联系起来
  • 批准号:
    RGPIN-2022-03096
  • 财政年份:
    2022
  • 资助金额:
    $ 478.14万
  • 项目类别:
    Discovery Grants Program - Individual
The role of biological interactions in the evolution of animal behavior
生物相互作用在动物行为进化中的作用
  • 批准号:
    RGPIN-2019-06689
  • 财政年份:
    2022
  • 资助金额:
    $ 478.14万
  • 项目类别:
    Discovery Grants Program - Individual
Development of Semi-Supervised Learning Method using Compressed Video for Real-Time Animal Behavior Analysis
使用压缩视频进行实时动物行为分析的半监督学习方法的开发
  • 批准号:
    22H03637
  • 财政年份:
    2022
  • 资助金额:
    $ 478.14万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Landscapes of fear in the Anthropocene: Linking predation risk and human disturbance to animal behavior and ecological outcomes
人类世的恐惧景观:将捕食风险和人类干扰与动物行为和生态结果联系起来
  • 批准号:
    DGECR-2022-00323
  • 财政年份:
    2022
  • 资助金额:
    $ 478.14万
  • 项目类别:
    Discovery Launch Supplement
Neural and molecular mechanisms of microbe-sensing in the control of animal behavior - Resubmission - 1
微生物传感控制动物行为的神经和分子机制 - 重新提交 - 1
  • 批准号:
    10315486
  • 财政年份:
    2021
  • 资助金额:
    $ 478.14万
  • 项目类别:
Neural and molecular mechanisms of microbe-sensing in the control of animal behavior - Resubmission - 1
微生物传感控制动物行为的神经和分子机制 - 重新提交 - 1
  • 批准号:
    10412977
  • 财政年份:
    2021
  • 资助金额:
    $ 478.14万
  • 项目类别:
REU Site: Animal Behavior in Context
REU 网站:背景下的动物行为
  • 批准号:
    2050311
  • 财政年份:
    2021
  • 资助金额:
    $ 478.14万
  • 项目类别:
    Standard Grant
Molecular recording to predict cell fate decisions and animal behavior
分子记录预测细胞命运决定和动物行为
  • 批准号:
    10260139
  • 财政年份:
    2021
  • 资助金额:
    $ 478.14万
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了