Augmented Studio -Controlled Light Modulation in Television Studios-

本项目研究在电视演播室中应用空间、时间、色度和亮度调制的数字光投影机以增强现场直播和录制的可能性和潜力。关键技术概念(参见第3.1节)应用同步投影仪和摄像机来显示广播/记录的视频流中可见(例如，照明和特效)或不可见(例如，用于获取场景深度和摄像机姿势的编码图案，或仅对主持人可见的动态方向信息)的信息。在整个项目中，必须解决几个面向工程和计算机科学的问题：必须开发用于同步显示和捕获设备的软、硬件框架。必须研究自动校准投影仪的新技术，以及在复杂和动态环境中显示图像内容的新技术(没有针对投影进行优化)。离线和在线场景获取和摄像机跟踪的方法必须进行评估、改进和适应提出的关键概念。将采用新的基于投影仪和基于视频的照明和增强技术。这种新颖的技术方法的结果可以为现代电视制片厂打开新的可能性。

This project investigates the possibilities and the potentials of applying spatial, temporal, chrominance and luminance modulated digital light projectors in television studios for enhanced live broadcasts and recordings. The key technical concept (see section 3.1) applies synchronized projectors and cameras to display information that are visible (e.g., illumination and special effects) or invisible (e.g., coded patterns for acquisition of scene depth and camera pose, or dynamic direction information visible only to the moderator) in the broadcasted/recorded video stream. Several engineering and computer science oriented problems have to be solved throughout the project: A soft- and hardware framework has to be developed for synchronizing display- and capturing devices. New techniques for automatic projector calibration, as well as for displaying image content in complex and dynamic environments (not optimized for projections) have to be researched. Methods for offline and online scene acquisition and camera tracking have to be evaluated, improved and adapted to the proposed key concept. New projector-based and video-based illumination and augmentation techniques will be implemented. The outcome of this novel technological approach can open new possibilities for modern television studios.