Binocular vision supports the development of scene segmentation capabilities: Evidence from a deep learning model.
Binocular vision supports the development of scene segmentation capabilities: Evidence from a deep learning model.
复制标题
DOI：
10.1167/jov.21.7.13
复制
发表时间：
2021-07-06
影响因子：
1.8
通讯作者：
Graham B
中科院分区：
文献类型：
--
作者：
Goutcher R;Barrington C;Hibbard PB;Graham B
深度学习技术的应用在解决机器视觉中的许多关键问题方面取得了实质性进展，包括场景分割和深度估计的基本问题。在这里，我们报告了一种新的深度神经网络模型，能够从一对双目图像中同时进行场景分割和深度估计。通过操纵安排的双目图像对，提出了标准的左右图像对，相同的图像对或交换的左右图像的模型，我们表明，性能水平取决于适当的双目图像安排的存在。当图像交换时，分割和深度估计性能都会受损。然而，对于相同的图像对，尽管没有双目视差信息，分割性能水平被保持。至关重要的是，这些性能水平超过了同等的、单眼训练的分割模型。这些结果提供的证据表明，双目图像差异支持深度和分割信息的直接恢复，以及增强学习的单眼分割信号。这一发现表明，双眼视觉可能在视觉发育中发挥重要作用。更好地理解这一作用可能会对发展性获得性知觉障碍的研究和治疗产生影响。
The application of deep learning techniques has led to substantial progress in solving a number of critical problems in machine vision, including fundamental problems of scene segmentation and depth estimation. Here, we report a novel deep neural network model, capable of simultaneous scene segmentation and depth estimation from a pair of binocular images. By manipulating the arrangement of binocular image pairs, presenting the model with standard left-right image pairs, identical image pairs or swapped left-right images, we show that performance levels depend on the presence of appropriate binocular image arrangements. Segmentation and depth estimation performance are both impaired when images are swapped. Segmentation performance levels are maintained, however, for identical image pairs, despite the absence of binocular disparity information. Critically, these performance levels exceed those found for an equivalent, monocularly trained, segmentation model. These results provide evidence that binocular image differences support both the direct recovery of depth and segmentation information, and the enhanced learning of monocular segmentation signals. This finding suggests that binocular vision may play an important role in visual development. Better understanding of this role may hold implications for the study and treatment of developmentally acquired perceptual impairments.
登录
查看更多内容
DOI：
10.3758/bf03214282
发表时间：
1981-01-01
期刊：
PERCEPTION & PSYCHOPHYSICS
影响因子：
--
作者：
BLAKE, R;SLOANE, M;FOX, R
通讯作者：
FOX, R
影响因子：
19.5
作者：
Birchfield, S;Tomasi, C
通讯作者：
Tomasi, C
影响因子：
1.8
作者：
Fowlkes, Charless C.;Martin, David R.;Malik, Jitendra
通讯作者：
Malik, Jitendra
影响因子：
1.8
作者：
Basgoze, Zeynep;White, David N.;Cooper, Emily A.
通讯作者：
Cooper, Emily A.
影响因子：
1.9
作者：
Valsecchi M;Caziot B;Backus BT;Gegenfurtner KR
通讯作者：
Gegenfurtner KR