Immersive Digital Reality

受大众市场头戴式沉浸式显示器出现的推动，拟议中的项目将开创VR护目镜提供的完全沉浸感所需的技术，以体验真实世界的记录。为了实现这一目标，需要共同解决来自视频处理，计算机图形学，计算机视觉和应用视觉感知的一些跨学科，紧密相关的挑战：而不是从外部拍摄镜头，现在必须从场景内捕获和全方位数字建模；为了在显示过程中方便运动视差和立体视觉，必须实时创建记录场景的真实视图，以便任意观看位置和方向；为了优化全视场沉浸式显示的视觉体验，感知感知渲染算法必须同时适应我们的中央凹和周边视觉特征。这项为期五年的研究旨在开发一种方法，使人们能够完全沉浸在记录的真实世界中：拟议项目的总体目标是将真实世界引入沉浸式显示，为我们未来观看电影的方式奠定基础，将固定的视点、有限的视场屏幕抛在身后，获得完全沉浸式的集体体验。

Motivated by the advent of mass-market head-mounted immersive displays, the proposed project will pioneer the technology needed to experience recordings of the real world with the sense of full immersion as provided by VR goggles. To achieve this goal, a number of interdisciplinary, tightly interrelated challenges from video processing, computer graphics, computer vision, and applied visual perception need to be addressed collectively: Instead of filming a shot from the outside looking in, the action must now be captured and digitally modeled omni-directionally from within the scene; to facilitate motion parallax and stereoscopic vision during display, authentic views of the recorded scene must be created in real-time for arbitrary viewing position and direction; and to optimize the visual experience of full field-of-view immersive displays, perception-aware rendering algorithms must simultaneously accommodate the characteristics of our foveal and peripheral vision. This five-year research endeavor sets out to develop the means needed to experience the recorded real world in full immersion: The overall objective of the proposed project is to import the real world into immersive displays, laying the foundations for the way we may watch movies in the future by leaving fixed-viewpoint, limited field-of-view screens behind for a completely immersive, collective experience.