Real-Action VR: Immersive Experience of Action-Cam Video Recordings

拟议项目的目标是开发科学基础，以实现通过自由移动的360度摄像机记录的真实世界风景的高质量和完全沉浸式体验。使用户外动作摄像头记录的例子，方法将被开发为全方位的场景重建与自由摄像机运动，视频增强和分辨率增强，有效的编码与场景表示的同时快速解码，完全沉浸式6自由度渲染，并在大型现实世界环境中的自然沉浸式导航，同时防止视觉诱导的运动病（cybersickness）。相关跨学科挑战的工作将有助于计算机图形学，计算机视觉，应用感知心理学和视频技术领域。

The goal of the proposed project is to develop the scientific basis to enable the high-quality and fully immersive experience of real-world scenery recorded by means of a freely moving 360-degree video camera. Using the example of outdoor action cam recordings, methods will be developed for all-round scene reconstruction with free camera movement, for video augmentation and resolution enhancement, for efficient coding with simultaneous fast decodability of the scene representation, for fully immersive 6-DoF rendering, and for natural immersive navigation in large real-world environments with simultaneous prevention of visually induced kinetosis (cybersickness). Work on the related interdisciplinary challenges will contribute to the fields of computer graphics, computer vision, applied perceptual psychology, and video technology.