3D shape recovery from images viewed by multiple video cameras

拟议的研究“从多摄像机观看的图像中恢复3D形状”将尝试在多摄像机观看的额外图像的帮助下估计二维图像中所有像素的三维坐标。包含在多个2D视图中的物体和场景的3D建模是概念目标。这项研究超越了静止图像的范畴，研究的是由4个（或5个）摄像机组成的多摄像头连接到个人电脑上观看的视频图像。实时多摄像头视觉系统连续生成并显示密集的立体视差图，显示多摄像头观察到的场景中每个点的距离。该系统还能够显示从任意视点观看的虚拟现实图像，与真实摄像机的位置分开。建立的多视点几何数学理论广泛应用于极面（对眼立体）构型以及平行视点轴构型。潜在的应用包括(1)机器人应用，如多摄像头视觉系统持续向自动导航机器人提供距离信息以避免碰撞，(2)能够检测3D运动的视频监控，以指示视频物体是靠近还是远离摄像头，以及(3)合成3D立体视图，以便在配备视差屏障的立体3D LCD（液晶显示器）上投影。这将为立体视频、视频游戏和电视设定新的标准。

The proposed research "3D Shape Recovery from Images Viewed by Multiple Cameras" will attempt to estimate the 3 dimensional coordinates of all pixels in a 2 dimensional image with the help of additional images viewed from multiple cameras. 3D modeling of objects and scenes contained in multiple 2D views is the conceptual objective. This research goes beyond still images and works on video images viewed by a multi-camera assembly of 4 (or 5) video cameras interfaced to a personal computer. The real time multi-camera vision system continuously produces and displays a dense stereo disparity map that shows the distance to every point of the observed scene by the multiple cameras. The system is also capable of displaying a virtual reality image viewed from an arbitrary viewpoint separate from the positions of real cameras. Established mathematical theories of multiple view geometry are extensively applied to the epipolar (cross-eye stereo) configuration as well as to the parallel view axis configuration. Potential applications include (1) robotic applications, such that the multi-camera vision system continuously provides distance information to a self-navigating robot for collision avoidance, (2) video surveillance capable of detecting 3D motions to indicate whether a video object is moving closer to or away from the cameras, and (3) synthesis of 3D stereo views for projection on stereoscopic 3D LCD (Liquid Crystal Display) equipped with the parallax barrier, which will set a new standard for stereoscopic video, video games and TV.