Development of 3D image Display System with Motion Parallax

我们开发了一个三维图像显示系统，它可以呈现具有逼真运动视差的真实的场景。该系统由传感系统和显示系统组成。在传感系统中，通过使用相机矩阵观察场景，并生成3D场景表示。在显示系统中，跟随观察者的位置，通过使用从感测系统提供并呈现在屏幕上的3D场景表示来生成具有适当视角的图像。我们取得了以下重大成果.遮挡可检测立体声：我们开发了一个使用摄像机矩阵的立体视觉系统，实现了基于像素的密集深度信息的对应搜索和尖锐物体边界的可靠遮挡检测.具有运动视差的显示：提出了一种适用于固定屏幕显示系统的视点选择算法和一种能够科普任意视点的图像生成算法.人脸图像生成：我们已经开发出一种新的方法来生成人脸图像从任意方向，只用两个图像。4.三维场景重建：一些重要的算法，从图像的三维重建已经开发出来。

We have developed a 3D image display system which can present real scenes with realistic motion parallax. The system consists of sensing and display systems. In the sensing system, the scene is observed by using a camera matrix, and a 3D scene representation is generated. In the display system, following the position of the observer, the image with proper view is generated by using the 3D scene representation supplied from the sensing system and presented on a screen. We have achieved significant results as follows.1. Occlusion detectable stereo : We have developed a stereo using a camera matrix which realizes the pixel-based correspondence search for dense depth information and the reliable occlusion detection for sharp object boundaries.2. Display with motion parallax : We proposed a novel algorithm for the view selection suitable for a fixed screen display system and an image generation algorithm which can cope with an arbitrary viewing position of the observer.3. Face image generation : We have developed a new method to generate face images from arbitrary orientations by using only two images.4.3D scene reconstruction : Some important algorithms for 3D reconstruction from images have been developed.