Development of Real-time Omnidirectional Stereo Imaging Systems

实时全向立体成像系统的开发

• 批准号: 09555127
• 负责人: YOKOYA Naokazu
• 金额: $ 5.06万
• 依托单位: Nara Institute of Science and Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 1997
• 资助国家: 日本
• 起止时间: 1997 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09555127/
• 关键词: Omnidirectional Image Sensor; Omnidirectional Image; Cylindrical Panoramic Image; Telepresence; Virtual Reality; Computer Vision; Real-time Systems; Immersive Visual Environment

We have obtained the following research results in this project.1.Development of Omnidirectional Stereo Imaging Sensors.We have developed two types of omnidirectional stereo imaging sensors. The first one is based on using a composite mirror of two hyperboloidal mirrors and a standard video camera. It has been concluded that this sensor suffers from low resolution of images and thus requires high-resolution video cameras for practical applications. The second from sensor is developed for overcoming the low-resolution problem in the first sensor. It consists of symmetrically aligned two components, each of which is constructed of a hexagonal pyramidal mirror and six video cameras.2.Real-time Generation of Perspective and Panoramic Images from an Omnidirectional ImagePerspective and panoramic images can be computed from an omnidirectional image because our sensor components satisfy the single viewpoint constraint. In order to execute the geometric transformation from omnidirectional imag … More es to perspective and/or cylindrical panoramic images in real time, we have developed a novel algorithm which integrates coordinate transformation by software and image warping by hardware. The proposed algorithm is used for realizing two types of telepresence systems ; one uses a head-mounted display (HMD) and the other is based on a large cylindrical screen and projectors.3.Efficient Coding of Dynamic Omnidirectional and Panoramic ImagesWe have developed a method for estimating structure and motion from omnidirectional image sequences as well as a method for generating novel views from a sequence of omnidirectional images obtained from a moving omnidirectional sensor.4.Acquisition of 3D Information from Omnidirectional Stereo ImagesOmnidirectional images obtained by our sensors have vertical disparities. In order to generate standard binocular stereo images with horizontal disparities, a correlation-based stereo matching algorithm is applied to omnidirectional stereo images. This may be referred to as omnidirectional stereo. Less

本课题取得了以下研究成果：1.全向立体成像传感器的研制。我们研制了两种全方向立体成像传感器。第一种是基于两个双曲面反射镜和一个标准摄像机组成的复合镜。结果表明，这种传感器存在图像分辨率低的问题，因此需要高分辨率的摄像机来满足实际应用。第二种传感器是为了克服第一种传感器分辨率低的问题而研制的。它由对称排列的两个组件组成，每个组件由一个六角棱锥镜和六个摄像机组成。2.从全向图像实时生成透视和全景图像由于传感器组件满足单视点约束，因此可以从全向图像计算透视和全景图像。为了实现全向图像…的几何变换为了更多地实时获取透视和/或柱面全景图像，我们开发了一种软件坐标变换和硬件图像扭曲相结合的新算法。提出的算法用于实现两种类型的临场感系统：一种是使用头盔显示器(HMD)，另一种是基于大柱面屏幕和投影仪的。3.动态全向和全景图像的有效编码我们发展了一种从全向图像序列估计结构和运动的方法，以及一种从移动的全向传感器获得的全向图像序列生成新视图的方法。4.从全向立体图像中获取3D信息传感器获得的全向图像具有垂直差异。为了生成具有水平视差的标准双目立体图像，将基于相关性的立体匹配算法应用于全向立体图像。这可以被称为全向立体声。较少

项目成果

Ryutaro Miki: "A Real-time Video Surveillance and Monitoring System Using Multiple Omnidirectional Video Cameras"Proc. 4th Asian Conf. on Computer Vision. I. 528-534 (2000)

Ryutaro Miki：“使用多个全向摄像机的实时视频监视和监控系统”Proc。

Takahito Kawanishi: "Generation of High-resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I. 485-489 (1998)

Takahito Kawanishi：“使用六角金字塔镜通过全向成像传感器生成高分辨率立体全景图像”Proc。

山澤 一誠: "全方位画像からの視線追従型実時間画像生成によるテレプレゼンス" 電子情報通信学会論文誌(D-II). J81-D-II・5. 880-887 (1998)

Issei Yamazawa：“通过全向图像进行视线跟踪实时图像生成的远程呈现”电子、信息和通信工程师学会汇刊 (D-II) (J81-D-II・5)。 1998）

茶園 篤: "全方位ステレオ視による3次元情報の獲得"映像情報メディア学会誌. 51・10. 1745-1753 (1997)

Atsushi Chazono：“通过全方位立体观看获取 3D 信息”图像信息和电视工程师学会杂志 51・10 1745-1753（1997 年）。

Takahito Kawanishi: "Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I・. 485-489 (1998)

Takahito Kawanishi：“使用六角锥镜生成高分辨率立体全景图像”Proc. 14th IAPR Conf. I·485-489。