Face and eye rectification in video conference using affine transform
Face and eye rectification in video conference using affine transform
复制标题
使用仿射变换进行视频会议中的面部和眼睛校正
DOI：
10.1109/icip.2005.1530441
复制
发表时间：
2005
期刊：
影响因子：
--
通讯作者：
B. Yip
中科院分区：
文献类型：
--
作者：
B. Yip
视频会议中缺乏目光接触会降低用户的体验。这个问题已经被发现和研究了很多年。有基于硬件的解决方案来解决眼睛注视问题。然而，这些专门的系统并不是普遍可用的。本文提出了一种在视频会议中仅利用一个摄像头对人脸和眼睛进行矫正的软件方法。在设置阶段，使用来自前视图和上视图的各五个帧，借助于面部检测和眼睛检测算法，计算视点和仿射变换矩阵。一旦设置完成，我们就用仿射变换来矫正面部，并基于眼睛模型使用图像扭曲来矫正眼睛。这是在接近真实的时间内完成的（每秒18帧，分辨率为320/spl倍/240）。结果不是真实的，但明显更好。
The lack of eye contact in video conference degrades the user's experience. This problem has been known and studied for many years. There are hardware-based solutions to the eye gazing problem. However, these specialized systems are not generally accessible. This paper suggests a software approach that rectifies the face and the eyes in video conference, only utilizing one camera. In the setup phase, the view point and the affine transform matrix are calculated, using five frames each from the front view and the above view, with the aids of face detection and eye detection algorithm. Once the setup is done, we rectify the face with affine transformation, and rectify the eyes using image warping, based on an eye model. This is done in near real time (18 frames per second, for the resolution of 320/spl times/240). The result is not genuine but is significantly better.