Dynamic seethroughs: Synthesizing hidden views of moving objects
Dynamic seethroughs: Synthesizing hidden views of moving objects
复制标题
动态透视：合成移动物体的隐藏视图
DOI：
--
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
T. Kanade
中科院分区：
文献类型：
--
作者：
P. Barnum;Yaser Sheikh;A. Datta;T. Kanade
本文提出了一种方法来创建通过视频中的遮挡表面看到移动对象的错觉。这种错觉是通过从观察被遮挡区域的摄像机传输信息来实现的。在用于3D场景的典型视图插值方法中，需要跨视图的某种形式的对应。对于被遮挡的区域，建立直接对应是不可能的，因为在其中一个视图中缺少信息。相反，我们使用2D投影不变量来捕获有关被遮挡对象（可能正在移动）的信息。由于不变量是不随视图变化的量，因此无需显式对应即可实现隐藏区域的视觉上引人注目的渲染。场景的分段平面模型允许整个渲染过程在没有任何3D重建的情况下进行，同时仍然产生视觉视差。由于2D不变量的简单性和鲁棒性，我们能够在真实的时间内转移静态背景和运动物体。一个完整的工作系统已经实现，运行在5 Hz的生活。该技术的应用包括能够在紧张的交叉路口查看汽车安全的角落，监控摄像头网络的并发可视化，以及患者/老人/儿童的监控系统。
This paper presents a method to create an illusion of seeing moving objects through occluding surfaces in a video. This illusion is achieved by transferring information from a camera viewing the occluded area. In typical view interpolation approaches for 3D scenes, some form of correspondence across views is required. For occluded areas, establishing direct correspondence is impossible as information is missing in one of the views. Instead, we use a 2D projective invariant to capture information about occluded objects (which may be moving). Since invariants are quantities that do not change across views, a visually compelling rendering of hidden areas is achieved without the need for explicit correspondences. A piece-wise planar model of the scene allows the entire rendering process to take place without any 3D reconstruction, while still producing visual parallax. Because of the simplicity and robustness of the 2D invariant, we are able to transfer both static backgrounds and moving objects in real time. A complete working system has been implemented that runs live at 5Hz. Applications for this technology include the ability to look through corners at tight intersections for automobile safety, concurrent visualization of a surveillance camera network, and monitoring systems for patients/elderly/children.