3D shape recovery from images viewed by multiple video cameras

从多个摄像机查看的图像中恢复 3D 形状

• 批准号: 4460-2007
• 负责人: Takaya, Kunio
• 金额: $ 1.09万
• 依托单位: University of Saskatchewan
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2009
• 资助国家: 加拿大
• 起止时间: 2009-01-01 至 2010-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=419900
• 关键词: 3D; shape; recovery; images; viewed

The proposed research "3D Shape Recovery from Images Viewed by Multiple Cameras" will attempt to estimate the 3 dimensional coordinates of all pixels in a 2 dimensional image with the help of additional images viewed from multiple cameras. 3D modeling of objects and scenes contained in multiple 2D views is the conceptual objective. This research goes beyond still images and works on video images viewed by a multi-camera assembly of 4 (or 5) video cameras interfaced to a personal computer. The real time multi-camera vision system continuously produces and displays a dense stereo disparity map that shows the distance to every point of the observed scene by the multiple cameras. The system is also capable of displaying a virtual reality image viewed from an arbitrary viewpoint separate from the positions of real cameras. Established mathematical theories of multiple view geometry are extensively applied to the epipolar (cross-eye stereo) configuration as well as to the parallel view axis configuration. Potential applications include (1) robotic applications, such that the multi-camera vision system continuously provides distance information to a self-navigating robot for collision avoidance, (2) video surveillance capable of detecting 3D motions to indicate whether a video object is moving closer to or away from the cameras, and (3) synthesis of 3D stereo views for projection on stereoscopic 3D LCD (Liquid Crystal Display) equipped with the parallax barrier, which will set a new standard for stereoscopic video, video games and TV.

拟议的研究“从多个摄像机观看的图像中恢复3D形状”将试图在多个摄像机观看的其他图像的帮助下估计二维图像中所有像素的三维坐标。 包含在多个2D视图中的对象和场景的3D建模是概念目标。 这项研究超越了静态图像，并对视频图像进行了研究，这些图像是由4台（或5台）摄像机连接到个人电脑上的多摄像机组件观看的。 真实的多摄像机视觉系统连续地产生并显示密集的立体视差图，该立体视差图显示多个摄像机到所观察场景的每个点的距离。 该系统还能够显示从与真实的相机的位置分离的任意视点观看的虚拟现实图像。 建立的多视图几何的数学理论被广泛地应用于对极（交叉眼立体）配置以及平行视图轴配置。 潜在的应用包括（1）机器人应用，使得多摄像机视觉系统连续地向自导航机器人提供距离信息以避免碰撞，（2）能够检测3D运动以指示视频对象是靠近还是远离摄像机移动的视频监视，以及（3）用于在配备有视差屏障的立体3D LCD（液晶显示器）上投影的3D立体视图的合成，这将为立体视频、视频游戏和TV设定新的标准。