TransCAIP: A Live 3D TV System Using a Camera Array and an Integral Photography Display with Interactive Control of Viewing Parameters
TransCAIP: A Live 3D TV System Using a Camera Array and an Integral Photography Display with Interactive Control of Viewing Parameters
复制标题
DOI：
10.1109/tvcg.2009.30
复制
发表时间：
2009-09-01
影响因子：
5.2
通讯作者：
Naemura, Takeshi
中科院分区：
文献类型：
--
作者：
Taguchi, Yuichi;Koike, Takafumi;Naemura, Takeshi
本文所述的系统通过使用64个摄像机阵列和具有60个观看方向的整体摄影显示器来提供实时3D视觉体验。在摄像机阵列前的实时3D场景由全色、全视差自动立体显示器再现，并可交互控制观看参数。主要的技术挑战是将64个多相机图像的数据快速灵活地转换为整体摄影格式。基于基于图像的渲染技术，我们的转换方法首先渲染60个新的图像对应的显示器的观看方向，然后安排渲染的像素，以产生一个完整的摄影图像。为了在单个PC上进行实时处理，所有转换过程都在GPU上使用GPGPU技术实现。该转换方法还允许用户交互式地控制所显示的图像的观看参数，以利用期望的参数再现动态3D场景。通过改变诸如绘制相机的会聚点和绘制相机的视点之间的间隔之类的绘制参数，作为软件处理来执行该控制，而不重新配置硬件系统。
The system described in this paper provides a real-time 3D visual experience by using an array of 64 video cameras and an integral photography display with 60 viewing directions. The live 3D scene in front of the camera array is reproduced by the full-color, full-parallax autostereoscopic display with interactive control of viewing parameters. The main technical challenge is fast and flexible conversion of the data from the 64 multicamera images to the integral photography format. Based on image-based rendering techniques, our conversion method first renders 60 novel images corresponding to the viewing directions of the display, and then arranges the rendered pixels to produce an integral photography image. For real-time processing on a single PC, all the conversion processes are implemented on a GPU with GPGPU techniques. The conversion method also allows a user to interactively control viewing parameters of the displayed image for reproducing the dynamic 3D scene with desirable parameters. This control is performed as a software process, without reconfiguring the hardware system, by changing the rendering parameters such as the convergence point of the rendering cameras and the interval between the viewpoints of the rendering cameras.