Real-Action VR: Immersive Experience of Action-Cam Video Recordings

拟议项目的目标是开发科学基础，使通过自由移动的360度摄像机记录的真实世界风景能够获得高质量和完全身临其境的体验。使用室外动作摄像机记录的例子，将开发出用于自由摄像机移动的全方位场景重建、用于视频增强和分辨率增强、用于场景表示的高效编码和同时快速解码、用于完全沉浸式6-DOF渲染、用于在大型真实世界环境中的自然沉浸式导航并且同时预防视觉诱发的运动障碍(晕厥)的方法。有关跨学科挑战的工作将有助于计算机图形学、计算机视觉、应用感知心理学和视频技术领域。

The goal of the proposed project is to develop the scientific basis to enable the high-quality and fully immersive experience of real-world scenery recorded by means of a freely moving 360-degree video camera. Using the example of outdoor action cam recordings, methods will be developed for all-round scene reconstruction with free camera movement, for video augmentation and resolution enhancement, for efficient coding with simultaneous fast decodability of the scene representation, for fully immersive 6-DoF rendering, and for natural immersive navigation in large real-world environments with simultaneous prevention of visually induced kinetosis (cybersickness). Work on the related interdisciplinary challenges will contribute to the fields of computer graphics, computer vision, applied perceptual psychology, and video technology.