Fundamental Study for Creation of Ray-Based Image Engineering

本研究的目标是创造“基于射线的图像工程”。在基于光线的图像工程中，三维空间信息用光线来表示。所有组件，如视觉系统的捕获、处理和显示，都不被视为基于像素，而是基于光线。在显示方面，我们已经开发了3D显示，并成功地从光线空间数据生成了3D图像。现在，我们主要集中在光线捕获和处理技术上。对于捕获，我们开发了一种准确、高效的多摄像机阵列定位方法。我们还提出了一种通过校正多摄像机阵列捕获的图像来构建光线空间的方法，以及通过在光线空间上进行信号处理来生成模拟光学现象的特殊效果的场景分离和合成方法。光线空间数据压缩是通信所必需的，它是利用多视图图像之间的相似性来开发的。此外，我们还建立了光线空间与全息图之间的相互转换。基于光波及其传播的物理现象的全息图被认为是一种终极的三维图像显示方法。相互转换表明，光线空间可以描述全息图的等效信息。这一成果赋予了光线空间物理意义，也证明了光线空间是一种独立于捕捉和显示方法的三维空间信息的通用表示。

This research targets the creation of "ray-based image engineering". In the ray-based image engineering, 3D spatial information is represented by light rays. All components such as capturing, processing, and display of the visual system are treated not as pixel-based but ray-based. For displaying, we have developed 3D display and succeeded to create 3D images from ray-space data already. Now, we focus mainly on technologies for ray capturing and processing.For capturing, we developed an accurate, and efficient positioning method for a multi camera array. And we also developed a method to construct ray-space by correcting images capured by multi camera array.We developed methods for scene separation and synthesis, and the generation of special effect simulating optical phenomenon by signal processing on ray-space. Ray-space data compression, which is necessary for communication, was developed using similarities between multi-views images. Moreover, we developed mutual conversion between ray-space and hologram. The hologram based on physical phenomenon of light waves and their propagation is considered as an ultimate 3D image displaying method. The mutual conversion shows that ray-space can describe equivalent information for the hologram. This achievement gives physical meaning to ray-space as well as it proves that ray-space is a universal representation of 3D spatial information independent of capturing and displaying methods.