Relic restoration using stereoscopic vision system with eye following function

在虚拟现实系统中，观看者的眼睛位置和视线是使由立体显示器生成的虚拟对象看起来像真实的对象所必需的。在使用平面显示器来基于双眼视差生成立体图像的情况下，需要相对于显示器的眼睛位置和视线信息。我们扩展了“两圆算法”，这是一个独特的摄像机标定方法，我们提出了，实现视觉方向估计方法，只使用虹膜轮廓，是独立的头部姿势。该研究在多个国际会议（ECCV'04 FG'04和ICPR'04）和在日本举行的一些会议（PRMU'0402，MIRU'04）上进行了报道。为了实现双目视差和运动视差的效果，必须根据观看者的眼睛相对于立体显示器的位置来生成立体图像。为了获得这些参数，必须执行立体显示器和用于估计眼睛位置的相机之间的校准。然而，由于相机用于获得关于观看者的眼睛的信息，因此显示器在一般情况下是不可观看的。为了解决这个问题，我们让用户注视显示器上显示的标记，并用他/她的手指指向它。我们使用立体相机来估计眼睛和指尖的3D位置。利用标记点、指尖和眼睛在同一直线上的特点，实现了立体摄像机与显示器之间的标定。基于这一思想，我们构建了一个具有眼睛跟随功能的立体显示系统，并将在MIRU 2006上进行报告。

In a VR system, the eye position and the visual line of the viewer are necessary to make virtual objects generated by a stereo display look like a real objects. In the case of using a planar display to generate stereo images based on binocular parallax, the eye position and the visual line information relative to the display are required. We extended the "two-circle algorithm", which is an unique method for camera calibration proposed by us, to realize a visual direction estimation method that only uses the iris contours and is independent to the head pose. This research was reported at several international conferences (ECCV'04 FG'04 and ICPR'04) and some conferences held in Japan (PRMU'0402, MIRU'04).In order to realize the effects of binocular parallax and motion parallax, the stereo images have to be generated according to the eye positions of the viewer relative to the stereo display. To obtain those parameters the calibration between the stereo display and the camera for estimating the eye positions have to be carried out. However, since the camera is used for obtain the information about the viewer's eyes ; the display is not viewable in general cases. To solve this problem, we let the user gaze the marker shown on the display and point it with his/her finger. We use a stereo camera to estimate the 3D positions of the eye and the finger tip. The calibration between the stereo camera and the display is carried out by making use of the fact that the maker, the finger tip and the eye are on the same line. We built a stereo display system with eye following function based on this idea which will be reported on MIRU2006.