Early Emergence of Solid Shape Coding in Natural and Deep Network Vision.
Early Emergence of Solid Shape Coding in Natural and Deep Network Vision.
复制标题
在自然和深层网络视觉中固体编码的早期出现。
DOI：
10.1016/j.cub.2020.09.076
复制
发表时间：
2021-01-11
期刊：
影响因子：
--
通讯作者：
Nielsen KJ
中科院分区：
文献类型：
--
作者：
Srinath R;Emonds A;Wang Q;Lempel AA;Dunn-Weiss E;Connor CE;Nielsen KJ
区域V4是腹侧视觉途径中的第一个特定对象处理阶段，就像区域MT是背途径中的第一个运动特异性处理阶段一样。近50年来，鉴于其在2D视觉图像的转换中的早期位置，V4中对象形状的编码一直是根据扁平图案处理的。然而，在这里，在清醒的猴子记录实验中，我们发现，V4神经元中大约一半是通过阴影，镜面，反射，反射，折射或图像中的差异线索传达的对实心，3D形状深度的反应。使用2光子功能显微镜，我们发现将平面和固体偏爱的神经元隔离为跨区域V4表面的单独模块。这些发现应影响早期形状处理理论和模型，这些理论和模型集中在2D模式处理上。实际上，我们对标准视觉深网Alexnet中早期对象处理的分析表明，敏感性对平面和固体形状的分布相似。在第3层中，固体形状的早期处理与扁平形状平行，可以代表计算优势由灵长类动物的大脑进化和深层网络训练发现。
仅在视觉对象途径的最后阶段证明了固体形状的大脑表示。在这里，Srinath等。证明固体形状编码实际上在早期区域V4中出现。视觉深网络中的类似发现表明，将平面图像快速转换为3D现实是视力的有效一般策略。
Area V4 is the first object-specific processing stage in the ventral visual pathway, just as area MT is the first motion-specific processing stage in the dorsal pathway. For almost 50 years, coding of object shape in V4 has been studied and conceived in terms of flat pattern processing, given its early position in the transformation of 2D visual images. Here, however, in awake monkey recording experiments, we found that roughly half of V4 neurons are more tuned and responsive to solid, 3D shape-in-depth, as conveyed by shading, specularity, reflection, refraction, or disparity cues in images. Using 2-photon functional microscopy, we found that flat- and solid-preferring neurons were segregated into separate modules across the surface of area V4. These findings should impact early shape processing theories and models, which have focused on 2D pattern processing. In fact, our analyses of early object processing in AlexNet, a standard visual deep network, revealed a similar distribution of sensitivities to flat and solid shape in layer 3. Early processing of solid shape, in parallel with flat shape, could represent a computational advantage discovered by both primate brain evolution and deep network training. Brain representation of solid shape has been demonstrated only in final stages of the visual object pathway. Here, Srinath et al. show that solid shape coding actually emerges in early-stage area V4. Similar findings in visual deep networks suggest that rapid conversion of flat images to 3D reality is an effective general strategy for vision.
登录
查看更多内容
DOI：
10.1073/pnas.89.24.11905
发表时间：
1992-12-15
影响因子：
11.1
作者：
BARTFELD, E;GRINVALD, A
通讯作者：
GRINVALD, A
影响因子：
64.8
作者：
BLASDEL, GG;SALAMA, G
通讯作者：
SALAMA, G
影响因子：
5.3
作者：
El-Shamayleh, Yasmine;Pasupathy, Anitha
通讯作者：
Pasupathy, Anitha
影响因子：
56.9
作者：
Bashivan, Pouya;Kar, Kohitij;DiCarlo, James J.
通讯作者：
DiCarlo, James J.
影响因子：
3.7
作者：
Felleman, Daniel J.;Van Essen, David C.
通讯作者：
Van Essen, David C.