Development of Real-time Omnidirectional Stereo Imaging Systems

实时全向立体成像系统的开发

• 批准号: 09555127
• 负责人: YOKOYA Naokazu
• 金额: $ 5.06万
• 依托单位: Nara Institute of Science and Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 1997
• 资助国家: 日本
• 起止时间: 1997 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09555127/
• 关键词: Omnidirectional Image Sensor; Omnidirectional Image; Cylindrical Panoramic Image; Telepresence; Virtual Reality; Computer Vision; Real-time Systems; Immersive Visual Environment

We have obtained the following research results in this project.1.Development of Omnidirectional Stereo Imaging Sensors.We have developed two types of omnidirectional stereo imaging sensors. The first one is based on using a composite mirror of two hyperboloidal mirrors and a standard video camera. It has been concluded that this sensor suffers from low resolution of images and thus requires high-resolution video cameras for practical applications. The second from sensor is developed for overcoming the low-resolution problem in the first sensor. It consists of symmetrically aligned two components, each of which is constructed of a hexagonal pyramidal mirror and six video cameras.2.Real-time Generation of Perspective and Panoramic Images from an Omnidirectional ImagePerspective and panoramic images can be computed from an omnidirectional image because our sensor components satisfy the single viewpoint constraint. In order to execute the geometric transformation from omnidirectional imag … More es to perspective and/or cylindrical panoramic images in real time, we have developed a novel algorithm which integrates coordinate transformation by software and image warping by hardware. The proposed algorithm is used for realizing two types of telepresence systems ; one uses a head-mounted display (HMD) and the other is based on a large cylindrical screen and projectors.3.Efficient Coding of Dynamic Omnidirectional and Panoramic ImagesWe have developed a method for estimating structure and motion from omnidirectional image sequences as well as a method for generating novel views from a sequence of omnidirectional images obtained from a moving omnidirectional sensor.4.Acquisition of 3D Information from Omnidirectional Stereo ImagesOmnidirectional images obtained by our sensors have vertical disparities. In order to generate standard binocular stereo images with horizontal disparities, a correlation-based stereo matching algorithm is applied to omnidirectional stereo images. This may be referred to as omnidirectional stereo. Less

本课题主要取得了以下研究成果：1.全方位立体成像传感器的研制本课题研制了两种全方位立体成像传感器。第一个是基于使用两个双曲面镜和一个标准的摄像机的复合镜。已经得出结论，该传感器的图像分辨率低，因此需要高分辨率的摄像机用于实际应用。第二种传感器是为了克服第一种传感器分辨率低的问题而研制的。它由两个对称排列的组件组成，每个组件由一个六角锥形反射镜和六个摄像机组成。2.从全向图像实时生成透视和全景图像由于我们的传感器组件满足单视点约束，因此可以从全向图像计算透视和全景图像。为了从全向图像中执行几何变换， ...更多信息 针对真实的透视和/或柱面全景图像，提出了一种新的基于软件的坐标变换和基于硬件的图像变形相结合的算法。所提出的算法用于实现两种类型的远程呈现系统;一种使用头戴式显示器（HMD），另一种是基于大圆柱屏幕和投影仪的。3.动态全向和全景图像的有效编码我们已经开发了一种方法，用于从全向图像序列中估计结构和运动，以及一种方法，用于从全向图像序列中生成新的视图。一个移动的全向传感器。4.从全向立体图像中获取3D信息由我们的传感器获得的全向图像具有垂直视差。为了生成具有水平视差的标准双目立体图像，将一种基于相关性的立体匹配算法应用于全向立体图像。这可以被称为全向立体声。少

项目成果

Ryutaro Miki: "A Real-time Video Surveillance and Monitoring System Using Multiple Omnidirectional Video Cameras"Proc. 4th Asian Conf. on Computer Vision. I. 528-534 (2000)

Ryutaro Miki：“使用多个全向摄像机的实时视频监视和监控系统”Proc。

Takahito Kawanishi: "Generation of High-resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I. 485-489 (1998)

Takahito Kawanishi：“使用六角金字塔镜通过全向成像传感器生成高分辨率立体全景图像”Proc。

山澤 一誠: "全方位画像からの視線追従型実時間画像生成によるテレプレゼンス" 電子情報通信学会論文誌(D-II). J81-D-II・5. 880-887 (1998)

Issei Yamazawa：“通过全向图像进行视线跟踪实时图像生成的远程呈现”电子、信息和通信工程师学会汇刊 (D-II) (J81-D-II・5)。 1998）

茶園 篤: "全方位ステレオ視による3次元情報の獲得"映像情報メディア学会誌. 51・10. 1745-1753 (1997)

Atsushi Chazono：“通过全方位立体观看获取 3D 信息”图像信息和电视工程师学会杂志 51・10 1745-1753（1997 年）。

Takahito Kawanishi: "Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I・. 485-489 (1998)

Takahito Kawanishi：“使用六角锥镜生成高分辨率立体全景图像”Proc. 14th IAPR Conf. I·485-489。