Generation and transmission of 4D image space by intelligent capturing of large-scale space

在这个项目中，我们已经开发了一个3D视频显示系统，它的工作在一个非常大的规模的空间，如足球场，音乐厅等，我们提出了一种方法来描述一组平面的3D对象的形状，以有效地合成一个新的视图的对象。平面的最有效布局可以基于观察者的观看位置、多个相机和3D对象的相对位置来确定。我们描述了一种方法，用于控制LOD的3D表示，通过调整的方向，间隔和分辨率的飞机。3D模型的数据大小和处理时间可以大大减少。实验结果证明了该方法的有效性，并开发了一个实时三维视频系统，该系统能够从多个摄像机采集视频，重建三维模型，并真实的实时传输三维视频数据。我们表示一个目标对象与一个简化的3D模型组成的一个单一的平面和一个2D纹理从多个摄像机提取。这个3D模型非常简单，可以通过网络传输我们已经开发了一个原型系统，可以捕获多个视频，重建3D模型，通过网络传输模型，并在真实的时间显示3D视频。一个典型的足球场景的3D视频，包括十几个球员，以每秒26帧的速度处理。

In this project, we have developed a 3D video display system which works in a very large-scale space such as a soccer stadium, concert hall, etc. We propose a method for describing the shape of a 3D object with a set of planes in order to synthesize a novel view of the object effectively. The most effective layout of the planes can be determined based on the relative locations of an observer's viewing position, multiple cameras, and 3D objects. We describe a method for controlling the LOD of the 3D representation by adjusting the orientation, interval, and resolution of planes. The data size of the 3D model and the processing time can be reduced drastically. The effectiveness of the proposed method is demonstrated by experimental results.We also have developed a live 3D video system that can capture video from multiple cameras, reconstruct 3D models and transmit 3D video data in real time. We represent a target object with a simplified 3D model consisting of a single plane and a 2D texture extracted from multiple cameras. This 3D model is simple enough to be transmitted via a network We have developed a prototype system that can capture multiple videos, reconstruct 3D models, transmit the models via a network, and display 3D video in real time. A 3D video of a typical soccer scene that includes a dozen players was processed at 26 frames per second.