Generation and transmission of 4D image space by intelligent capturing of large-scale space

在这个项目中，我们开发了一个工作在足球场、音乐厅等超大规模空间中的3D视频显示系统。我们提出了一种用一组平面来描述3D对象的形状的方法，以便有效地合成对象的新视图。可以根据观察者的观察位置、多个摄像机和3D对象的相对位置来确定最有效的平面布局。我们描述了一种通过调整平面的方向、间隔和分辨率来控制3D表示的LOD的方法。可以大大减少3D模型的数据量和处理时间。通过实验验证了该方法的有效性，并开发了一套能够从多个摄像头采集视频、重建3D模型和实时传输3D视频数据的实时3D视频系统。我们用简化的3D模型来表示目标对象，该模型由单个平面和从多个摄像机提取的2D纹理组成。这个3D模型非常简单，可以通过网络传输。我们开发了一个原型系统，可以捕获多个视频，重建3D模型，通过网络传输模型，并实时显示3D视频。一个包含12名球员的典型足球场景的3D视频以每秒26帧的速度进行处理。

In this project, we have developed a 3D video display system which works in a very large-scale space such as a soccer stadium, concert hall, etc. We propose a method for describing the shape of a 3D object with a set of planes in order to synthesize a novel view of the object effectively. The most effective layout of the planes can be determined based on the relative locations of an observer's viewing position, multiple cameras, and 3D objects. We describe a method for controlling the LOD of the 3D representation by adjusting the orientation, interval, and resolution of planes. The data size of the 3D model and the processing time can be reduced drastically. The effectiveness of the proposed method is demonstrated by experimental results.We also have developed a live 3D video system that can capture video from multiple cameras, reconstruct 3D models and transmit 3D video data in real time. We represent a target object with a simplified 3D model consisting of a single plane and a 2D texture extracted from multiple cameras. This 3D model is simple enough to be transmitted via a network We have developed a prototype system that can capture multiple videos, reconstruct 3D models, transmit the models via a network, and display 3D video in real time. A 3D video of a typical soccer scene that includes a dozen players was processed at 26 frames per second.