Video-Rate Z Keying: A New Method for Merging Images
Video-Rate Z Keying: A New Method for Merging Images
复制标题
视频速率 Z 键控：合并图像的新方法
DOI：
--
复制
发表时间：
1995
期刊：
影响因子：
--
通讯作者：
H. Kano
中科院分区：
文献类型：
--
作者：
T. Kanade;K. Oda;A. Yoshida;Masaya Tanaka;H. Kano
摘要：视频速率 z 键控是一种新的图像键控方法，用于实时合并真实图像和合成图像。在视觉媒体通信和显示中，通常需要将来自真实摄像机的视频信号和计算机图形生成的合成视频合并。用于此目的的标准技术是色度键控，例如在电视天气预报中使用该技术。然而，色度键控只是将现实世界的物体放在合成图像的前景中，并且不能处理真实物体和合成物体相互遮挡的情况。我们提出的 z 键方法以更灵活的方式融合现实和虚拟世界图像。 z 键使用深度图形式的逐像素深度信息作为开关。对于每个像素，z 键开关会比较两个图像的像素深度值，并路由更靠近相机的前景图像的颜色值以用于合并的输出图像。这种逐像素切换的结果是真实和虚拟对象可以根据它们的几何关系正确地相互遮挡。实现这种视频速率 z 键控的关键功能是真实场景的视频速率逐像素深度映射。我们开发了一种视频速率立体声机器，可以以视频速率生成 200 x 200 深度图像。通过该机器，已经演示了通过 z 键控实时将真实场景与合成场景合并；一个真人以 15 帧/秒的速率在合成房间中走动，并与房间中的虚拟对象保持正确的关系。
Abstract : Video-rate z keying is a new image keying method for merging real and synthetic images in real time. In visual media communication and display, it is often necessary to merge video signals from a real camera and a synthetic video produced by computer graphics. A standard technique for such a purpose is chroma keying which is used, for example, in TV weather reports. Chroma keying, however, simply puts real world objects in the foreground of the synthetic image, and cannot deal with situation where real and synthetic objects occlude each other. The z key method we present merges real and virtual world images in a more flexible way. The z key uses pixel-by-pixel depth information in the form of a depth map as a switch. For each pixel, the z key switch compares the pixel depth values of two images, and routes the color value of the foreground image that is nearer to the camera for the merged output image. The result of this pixel-by-pixel switching is that real and virtual objects can occlude each other correctly depending on their geometrical relationships. The critical capability for realizing such video-rate z keying is video-rate pixel-by-pixel depth mapping of a real scene. We have developed a video-rate stereo machine which can produce 200 x 200 depth images at video rate. With this machine, merging a real scene with a synthetic scene by means of z keying in real-time has been demonstrated; a real person walks around in a synthetic room with correct relationships with virtual objects in the room at the rate of 15 frames/sec.