The role of inferior temporal cortex in core visual object recognition
The role of inferior temporal cortex in core visual object recognition
批准号:
9131854
负责人:
James J DiCarlo
金额:
$39.0万
依托单位国家:
美国
项目类别:
财政年份:
2004
资助国家:
美国
项目状态:
已结题
起止时间:
2004-04-01 至 2018-09-29
关键词:
AccountingBedsBehaviorBehavioralBrainBrain regionCommunitiesConfusionDataDiscriminationFamilyFoundationsGoalsGrantHumanImageImplantIndividualInferiorInterventionLearningMapsMeasuresMethodsModelingMonkeysNeuronsPatternPersonal SatisfactionPopulationProcessRoleSamplingShapesStreamSumTemporal LobeTestingUncertaintyVisualVisual CortexWeightWorkbaseimaging modalityinsightneural modelneural patterningobject recognitionoptogeneticsrelating to nervous systemrepairedresearch studyresponsetool
中文摘要
我们的目标是了解大脑是如何完成视觉对象识别的。根据本条例获得的证据
格兰特和其他实验室的研究表明,每个视觉图像都是沿着腹侧视觉皮质过程进行处理的--
ING在其顶层-注入了一种新的神经活动模式。
Veys关于对象身份的明确信息,即使在面对实质性的视图不确定性(“不变性”)时也是如此。
IT群体的表征被认为是物体识别的因果关系。但准确地说
IT人口如何解释看似fiNite数量的对象歧视?何谓
IT所传达的行为批判性“特征”?多少?如何描述它们呢?
在这里,我们的目标是构建和测试映像到IT到行为的模型,这些模型在整个
核心视觉对象识别行为领域。大量的前期工作表明,我们应该从测试开始-
设计和开发IT 100.1f型号系列:该系列中的所有型号都表示IT传达的~100、形象-
在约1毫米尺度上采样的其活动中可计算的“特征”。我们如何测试和开发这样的模型?
首先,这个模型族预测,我们可以建立和提供一个单一的、低维(<;100)欧几里得EM-
预测所有基本和下级目标辨别任务的空间(目标1)。第二,模式
家庭预测,我们可以发现IT活动的特定方面(称为IT“功能”),
当加权和求和时,准确地预测每个图像的行为对象混淆(目标2a)。第三,
模型家庭预测,对单个毫米尺度的IT皮质部分的暂时抑制将产生
跨所有基本级和下级对象任务的可靠、可预测的行为中断模式
(目标3)。第四,模型家族假设信息技术神经调节功能在空间尺度上的差异较小
大于~1 mm与核心对象歧视行为无关-我们将用这两个记录来测试这一预测-
ING(目标2a)和神经扰动(目标3)实验。最后,模范家庭激励了我们的目标(Aim
2b)使用图像可计算函数和人来表征约100个IT特征的完整集合
形容词。
虽然大量的初步数据支持这些预测和目标,但还没有一个完整的模型
建造或测试。如果这些目标实现,这项工作将通过展示预先的
简要说明核心对象识别是如何在IT皮质级别进行因果解释的,并提供了一个模型
这将准确地预测任何图像处理或直接IT神经干预将如何改变
核心对象识别行为。
英文摘要
Our goal is to understand how the brain accomplishes visual object recognition. Evidence obtained under this
grant and from other labs suggests that each visual image is processed along the ventral visual cortical process-
ing stream into a new pattern of neural activity at its top level -- the inferior temporal cortex (IT) -- that con-
veys explicit information about object identity, even in the face of substantial view uncertainty (“invariance”).
That IT population representation is thought to be causally responsible for object recognition. But precisely
how does the IT population account for a seemingly infinite number of object discriminations? What are
the behaviorally critical “features” conveyed by IT? How many? How can they be described?
Here we aim to build and test image-to-IT-to-behavior models that are predictively accurate over the entire
domain of core visual object recognition behavior. Substantial prior work argues that we should start by test-
ing and developing the IT 100.1f model family: all models in that family state that IT conveys ~100, image-
computable “features” in its activity sampled at ~1 mm scale. How can we test and develop such models?
First, this model family predicts that we can build and provide a single, low dimensional (<100) Euclidean em-
bedding space to predict all basic and subordinate level object discrimination tasks (Aim 1). Second, the model
family predicts that we can discover the particular aspects of IT activity (called IT “features”) as those that,
when weighted and summed, exactly predict behavioral object confusion of every image (Aim 2a). Third, the
model family predicts that temporary suppression of individual, mm-scale portions of IT cortex will produce
reliable, predictable patterns of behavioral disruption across all basic-level and subordinate level object tasks
(Aim 3). Fourth, the model family posits that differences in IT neural tuning functions at spatial scales less
than ~1 mm are irrelevant for core object discrimination behavior — a prediction we will test with both record-
ing (Aim 2a) and neural perturbation (Aim 3) experiments. Finally, the model family motivates our goal (Aim
2b) of characterizing the complete set of ~100 IT features with image-computable functions and with human
shape adjectives.
While substantial preliminary data support these predictions and goals, a complete model has not yet been
built or tested. If these aims are accomplished, this work would transform our understanding by showing pre-
cisely how core object recognition is causally accounted for at the level of IT cortex, and by providing a model
that would accurately predict how any image manipulation or direct IT neural intervention would alter any
core object recognition behavior.
期刊论文(26)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
DOI:
10.1038/s41593-019-0392-5
发表时间:
2019-06
期刊:
Nature neuroscience
影响因子:
25
作者:
[Kar K, Kubilius J, Schmidt K, Issa EB, DiCarlo JJ]
通讯作者:
DiCarlo JJ
DOI:
10.7554/elife.60830
发表时间:
2021-06-11
期刊:
eLife
影响因子:
7.7
作者:
[Jia X, Hong H, DiCarlo JJ]
通讯作者:
DiCarlo JJ
DOI:
10.1371/journal.pcbi.1003963
发表时间:
2014-12
期刊:
PLoS computational biology
影响因子:
4.3
作者:
[Cadieu CF, Hong H, Yamins DL, Pinto N, Ardila D, Solomon EA, Majaj NJ, DiCarlo JJ]
通讯作者:
DiCarlo JJ
DOI:
10.1523/jneurosci.6125-11.2012
发表时间:
2012-07-25
期刊:
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子:
--
作者:
[Rust NC, DiCarlo JJ]
通讯作者:
DiCarlo JJ
DOI:
10.1371/journal.pcbi.1000579
发表时间:
2009-11
期刊:
PLoS computational biology
影响因子:
4.3
作者:
[Pinto N, Doukhan D, DiCarlo JJ, Cox DD]
通讯作者:
Cox DD
共 11 条
Computationally Enabled Integrative Neuroscience
-
批准号:10237871
-
项目类别:
-
资助金额:$23.36万
-
财政年份:2019
-
负责人:James J DiCarlo
-
依托单位:
Computationally Enabled Integrative Neuroscience
-
批准号:10449137
-
项目类别:
-
资助金额:$25.93万
-
财政年份:2019
-
负责人:James J DiCarlo
-
依托单位:
Post-natal development of high-level visual representation in primates
-
批准号:9316254
-
项目类别:
-
资助金额:$19.34万
-
财政年份:2017
-
负责人:James J DiCarlo
-
依托单位:
Time delimited neural silencing to dissect the basis of visual object perception
-
批准号:8427417
-
项目类别:
-
资助金额:$21.16万
-
财政年份:2013
-
负责人:James J DiCarlo
-
依托单位:
Time delimited neural silencing to dissect the basis of visual object perception
-
批准号:8609040
-
项目类别:
-
资助金额:$19.11万
-
财政年份:2013
-
负责人:James J DiCarlo
-
依托单位:
Construction of invariant shape selectivity in the ventral visual stream
-
批准号:8204991
-
项目类别:
-
资助金额:$39.03万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Visual object processing in the inferotemporal cortex
-
批准号:7198019
-
项目类别:
-
资助金额:$30.42万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Construction of invariant shape selectivity in the ventral visual stream
-
批准号:8415897
-
项目类别:
-
资助金额:$37.04万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Construction of invariant shape selectivity in the ventral visual stream
-
批准号:7780515
-
项目类别:
-
资助金额:$40.73万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Visual object processing in the inferotemporal cortex
-
批准号:7404431
-
项目类别:
-
资助金额:$29.9万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Construction of invariant shape selectivity in the ventral visual stream
-
批准号:7995177
-
项目类别:
-
资助金额:$39.07万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Visual object processing in the inferotemporal cortex
-
批准号:7905292
-
项目类别:
-
资助金额:$7.43万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Visual object processing in the inferotemporal cortex
-
批准号:7032925
-
项目类别:
-
资助金额:$30.88万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Visual object processing in the inferotemporal cortex
-
批准号:6876488
-
项目类别:
-
资助金额:$32.0万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Visual object processing in the inferotemporal cortex
-
批准号:6778021
-
项目类别:
-
资助金额:$31.64万
-
财政年份:2004
-
负责人:James J DiCarlo
-
依托单位:
Core-Vision Processes
-
批准号:8735150
-
项目类别:
-
资助金额:$57.69万
-
财政年份:1997
-
负责人:James J DiCarlo
-
依托单位:
CORE - Vision Processies
-
批准号:7642358
-
项目类别:
-
资助金额:$65.18万
-
财政年份:1997
-
负责人:James J DiCarlo
-
依托单位:
Machine Shop
-
批准号:10428503
-
项目类别:
-
资助金额:$21.99万
-
财政年份:1997
-
负责人:James J DiCarlo
-
依托单位:
CORE - Vision Processies
-
批准号:8288199
-
项目类别:
-
资助金额:$69.15万
-
财政年份:1997
-
负责人:James J DiCarlo
-
依托单位:
Core-Vision Processes
-
批准号:8906858
-
项目类别:
-
资助金额:$57.69万
-
财政年份:1997
-
负责人:James J DiCarlo
-
依托单位:
海外基金