Immersive Digital Reality

受大众市场头戴式沉浸式显示器出现的推动，拟议项目将开创体验真实的世界记录所需的技术，并提供VR护目镜所提供的完全沉浸感。为了实现这一目标，视频处理、计算机图形学、计算机视觉和应用视觉感知等多个跨学科、紧密相关的挑战需要共同解决：现在必须从场景内全方位捕捉动作并进行数字建模，而不是从外部拍摄镜头;为了促进显示期间的运动视差和立体视觉，必须针对任意观看位置和方向实时地创建所记录场景的真实视图;并且为了优化全视场沉浸式显示器的视觉体验，感知感知渲染算法必须同时适应我们的中央凹和周边视觉的特性。这项为期五年的研究奋进旨在开发体验全沉浸式记录的真实的世界所需的方法：拟议项目的总体目标是将真实的世界导入沉浸式显示器，为我们未来观看电影的方式奠定基础，通过离开固定视点，有限的视野屏幕，获得完全沉浸式的集体体验。

Motivated by the advent of mass-market head-mounted immersive displays, the proposed project will pioneer the technology needed to experience recordings of the real world with the sense of full immersion as provided by VR goggles. To achieve this goal, a number of interdisciplinary, tightly interrelated challenges from video processing, computer graphics, computer vision, and applied visual perception need to be addressed collectively: Instead of filming a shot from the outside looking in, the action must now be captured and digitally modeled omni-directionally from within the scene; to facilitate motion parallax and stereoscopic vision during display, authentic views of the recorded scene must be created in real-time for arbitrary viewing position and direction; and to optimize the visual experience of full field-of-view immersive displays, perception-aware rendering algorithms must simultaneously accommodate the characteristics of our foveal and peripheral vision. This five-year research endeavor sets out to develop the means needed to experience the recorded real world in full immersion: The overall objective of the proposed project is to import the real world into immersive displays, laying the foundations for the way we may watch movies in the future by leaving fixed-viewpoint, limited field-of-view screens behind for a completely immersive, collective experience.