Development of Real-time Omnidirectional Stereo Imaging Systems

实时全向立体成像系统的开发

• 批准号: 09555127
• 负责人: YOKOYA Naokazu
• 金额: $ 5.06万
• 依托单位: Nara Institute of Science and Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 1997
• 资助国家: 日本
• 起止时间: 1997 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09555127/
• 关键词: Omnidirectional Image Sensor; Omnidirectional Image; Cylindrical Panoramic Image; Telepresence; Virtual Reality; Computer Vision; Real-time Systems; Immersive Visual Environment

We have obtained the following research results in this project.1.Development of Omnidirectional Stereo Imaging Sensors.We have developed two types of omnidirectional stereo imaging sensors. The first one is based on using a composite mirror of two hyperboloidal mirrors and a standard video camera. It has been concluded that this sensor suffers from low resolution of images and thus requires high-resolution video cameras for practical applications. The second from sensor is developed for overcoming the low-resolution problem in the first sensor. It consists of symmetrically aligned two components, each of which is constructed of a hexagonal pyramidal mirror and six video cameras.2.Real-time Generation of Perspective and Panoramic Images from an Omnidirectional ImagePerspective and panoramic images can be computed from an omnidirectional image because our sensor components satisfy the single viewpoint constraint. In order to execute the geometric transformation from omnidirectional imag … More es to perspective and/or cylindrical panoramic images in real time, we have developed a novel algorithm which integrates coordinate transformation by software and image warping by hardware. The proposed algorithm is used for realizing two types of telepresence systems ; one uses a head-mounted display (HMD) and the other is based on a large cylindrical screen and projectors.3.Efficient Coding of Dynamic Omnidirectional and Panoramic ImagesWe have developed a method for estimating structure and motion from omnidirectional image sequences as well as a method for generating novel views from a sequence of omnidirectional images obtained from a moving omnidirectional sensor.4.Acquisition of 3D Information from Omnidirectional Stereo ImagesOmnidirectional images obtained by our sensors have vertical disparities. In order to generate standard binocular stereo images with horizontal disparities, a correlation-based stereo matching algorithm is applied to omnidirectional stereo images. This may be referred to as omnidirectional stereo. Less

我们在该项目中获得了以下研究结果。1。全向立体成像传感器的开发。我们开发了两种类型的全向立体成像传感器。第一个是基于使用两个倍重镜的复合镜子和一个标准摄像机的复合镜。已经得出结论，该传感器的图像分辨率低，因此需要用于实际应用的高分辨率摄像机。开发了第二个传感器，以克服第一个传感器中的低分辨率问题。它由对称的两个组件组成，每个组件由六角形金字塔镜和六个摄像机构造。2。真实的时间生成的观点和全景图像来自全向映像和全景图像，并且可以从全面的图像中计算出全面的图像，因为我们的传感器组合满足了单个观点的约束。为了实时执行从全向图像的几何转换……更多到透视图和/或圆柱形全景图像，我们开发了一种新颖的算法，该算法通过软件和硬件循环整合坐标转换。所提出的算法用于实现两种类型的触觉系统。一种使用头部安装的显示（HMD），另一种是基于大型圆柱屏幕和投影仪。3。动态全向方向和全景图像的有效编码我们开发了一种方法，我们开发了一种方法，用于从全面的图像序列中估算结构和运动的方法，以及从omnirecretion omnirection omnecretion omnirection trecection omnirection trecection omnirection trecection omnirection trecection omnirection的方法中的方法。通过我们的传感器获得的全向立体图像图像具有垂直分布。为了生成具有水平分布的标准双目立体图像，将基于相关的立体声匹配算法应用于全向立体图像。这可以称为全向立体声。较少的

项目成果

Ryutaro Miki: "A Real-time Video Surveillance and Monitoring System Using Multiple Omnidirectional Video Cameras"Proc. 4th Asian Conf. on Computer Vision. I. 528-534 (2000)

Ryutaro Miki：“使用多个全向摄像机的实时视频监视和监控系统”Proc。

山澤 一誠: "全方位画像からの視線追従型実時間画像生成によるテレプレゼンス" 電子情報通信学会論文誌(D-II). J81-D-II・5. 880-887 (1998)

Issei Yamazawa：“通过全向图像进行视线跟踪实时图像生成的远程呈现”电子、信息和通信工程师学会汇刊 (D-II) (J81-D-II・5)。 1998）

Takahito Kawanishi: "Generation of High-resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I. 485-489 (1998)

Takahito Kawanishi：“使用六角金字塔镜通过全向成像传感器生成高分辨率立体全景图像”Proc。

Takahito Kawanishi: "Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I・. 485-489 (1998)

Takahito Kawanishi：“使用六角锥镜生成高分辨率立体全景图像”Proc. 14th IAPR Conf. I·485-489。

Ryutaro Miki: "A real-time video surveillance and monitoring system using multiple omnidirectional video cameras"Proc. 4th Asian Conf. on Computer Vision. I・. 528-534 (2000)

Ryutaro Miki：“使用多个全向摄像机的实时视频监视系统”Proc. 4th Asian Conf. 528-534 (2000)。