Viewing Geometry and Stereoscopic Vision

PI：班克斯，马丁拟议的研究将调查我们通过双目视觉进行三维观察的方法。本文将围绕两个问题展开研究：1)人类视觉系统如何解决双目视觉中的匹配问题；2)视觉系统如何根据双目深度线索来表示表面形状和方向。我们仍然不完全理解这个问题是如何解决的。匹配问题简单地说就是：对于左眼中的每个图像点，视觉系统必须在另一只眼睛中找到合适的点来匹配它。对于N个可能的点，理论上可能匹配的数量是N4，因此如果N较大，则匹配过程可能在计算上变得无法管理。视觉系统可以通过使用所谓的极线约束来大量减少可能的匹配数量。对于一只眼睛中的图像点，其匹配必须位于另一只眼睛中对应的核线上。通过使用核线约束，匹配问题可以归结为一维搜索问题。然而，当眼睛的位置改变时(例如，从远注视到近注视)，视网膜上相应的核线的位置和方向就会改变。因此，为了实现极线约束，视觉系统必须考虑眼睛的位置。我们已经开发了一个实验程序，它将允许我们确定视觉系统是否使用核线约束，如果是，系统使用什么信号来计算眼睛移动时核线应该如何移动。我们还将检查视觉系统中表示表面形状的方法。表面形状的一个重要线索是到达两只眼睛的水平差异的模式，但这些差异本身不能产生对形状的真实估计。还必须使用其他信号，如垂直差异或眼睛位置信号。我们在之前的授权期中已经证明，即使在视网膜视差完全不变的情况下，眼睛会聚光度的变化也会导致感知形状的显著变化。我们还知道，长时间观察曲面会导致随后观察到的平面在相反方向上看起来是弯曲的。像这样的后效被称为“视差后效”，因为所提供的解释仅涉及视差编码。在拟议的研究中，我们将检查曲率后效。通过独立处理眼睛位置信号和视网膜视差，我们可以确定后遗症是由视差编码机制(这是主流理论)之间的适应引起的，还是由更高级别的形状编码机制的适应引起的。初步测量表明，后一种假设是对数据的更好预测。我们还将确定涉及的各种信号(例如，眼睛肌肉信号和垂直差异)在不同观看条件下是如何加权的。拟议的工作将使我们更好地理解双目视觉的这些方面，并因此可能对双目显微镜、头盔和头盔显示器以及其他逼真显示器等视觉辅助设备的改进提供见解。

PI: Banks, MartinThe proposed research will investigate the means by which we see 3-dimensionally via binocular vision. The research will focus on two issues: 1) how the human visual system solves the "matching problem" in binocular vision and 2) how the visual system represents surface shape and orientation from binocular depth cues.The matching problem in binocular vision has been actively researched for decades. We still do not fully understand how the problem is solved. The matching problem is simply stated in the following way: For every image point in the left eye, the visual system must find the appropriate point in the other eye to match with it. With N possible points, the number of theoretically possible matches is N4 so with large N the matching process can become computationally unmanageable. The visual system can massively reduce the number of possible matches by using what is termed the epipolar constraint. For an image point in one eye, its match must lie on the corresponding epipolar line in the other eye. By using the epipolar constraint, the matching problem can be reduced to a one-dimensional search. However, when the eyes' positions change (e.g., fixating from far to near), the positions and orientations of corresponding epipolar lines change on the retina. Thus, to implement the epipolar constraint, the visual system must take the eyes' positions into account. We have developed an experimental procedure that will allow us to determine whether the visual system uses the epipolar constraint and, if so, what signals the system uses in order to calculate how epipolar lines ought to move when the eyes move.We will also examine the means by which surface shape is represented in the visual system. An important cue to surface shape is the pattern of horizontal disparities arriving at the two eyes, but those disparities by themselves cannot yield a veridical estimate of shape. Other signals such as vertical disparities or eye-position signals must be used as well. We have shown in the previous grant period that changes in the eyes' vergence can cause a compelling change in perceived shape even when the retinal disparities are completely constant. We also know that prolonged viewing of a curved surface causes a subsequently viewed flat surface to appear curved in the opposite direction. Aftereffects like this have been called "disparity aftereffects" because the explanations offered refer to disparity encoding alone. In the proposed research, we will examine the curvature aftereffect. By manipulating eye-position signals and retinal disparities independently, we can determine whether the aftereffect is caused by adaptation among disparity-encoding mechanisms (which is the prevailing theory) or whether it is caused by adaptation in higher-level, shape-encoding mechanisms. Preliminary measurements suggest that the latter hypothesis is a better predictor of the data. We will also determine how the various signals involved (e.g., eye-muscle signals and vertical disparities) are weighted under different viewing conditions.The proposed work will yield a better understanding of these aspects of binocular vision and, consequently, may yield insights into improvements in visual aids such as binocular microscopes, head- and helmet-mounted displays, and other realistic displays.