Face Recognition using Photometric Stereo

使用光度立体进行人脸识别

• 批准号: EP/E028659/1
• 负责人: Melvyn Smith
• 金额: $ 32.75万
• 依托单位: University of the West of England
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2007
• 资助国家: 英国
• 起止时间: 2007 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FE028659%2F1
• 关键词: Face; Recognition; using; Photometric; Stereo

We propose to construct a system for 3D face recognition. We propose to use photometric stereo for face reconstruction in order to by pass the problems of conventional stereo (that needs to solve the matching problem first), structured light (that does not supply colour information) and photometric stereo with spectrally distinct light sources (that relies on the assumption of uniformly coloured imaged objects). Photometric stereo (PS) can reproduce structural details and colour on a per pixel basis in a way that no other 3D system can. The proposed scheme will be appropriate for use in a controlled environment for authentication purposes, but also in a general environment e.g. the entrance of a public event. We shall use two routes: surface reconstruction from the data and direct extraction of facial characteristics from the PS set. In the first approach, once surface normal and albedo is recovered, images of the face may be synthetically rendered under arbitrary new pose and illumination conditions to allow novel viewing conditions. We also aim to use a new multi-scale facial feature matching approach in the recognition process, where facial features range from overall face and head shape to fine skin dermal topography, reflectance and texture. The latter may be thought of as a form of detailed surface bump map forming a unique skin-print or signature and represents a new approach. Hence both the 3D shape and 2D intensity data will be used in recognition or authentication tasks. We propose to use scalable methods for matching, so we can cope with large databases. 3D matching will be done with the newly proposed invaders algorithm which is FFT cross-correlation based, and more detailed matching will be done by using features and classifier combination. The novelty of our approach lies in the use of PS to extract 3D information, the use of detailed facial characteristics like moles, scratches, and skin texture, and in the design of the system so that it can operate while the person is moving, with minimum intrusion and maximum efficiency. We have two industrial collaborators who will contribute in system design, data gathering and exploitation and support from the Home Office. We shall evaluate our system following three possible scenaria: a face searched in the crowd (real time face recognition), a person has to be identified (off-line face recognition) and a person has to be checked against a claimed identity (face authentication). We shall install the first prototype system in the offices of one of our industrial partners in month 12, so that data can be collected. We envisage a door like structure with lights flashing in succession as a person walks through, while a camera is capturing images. We propose to investigate the optimal number of lights in terms of efficiency and accuracy of the reconstruction, and the option of using non-visible light to avoid problems with people sensitive to flashes. We shall also investigate the relationship between detail that has to be captured and the geometry of the construction.

我们建议建立一个三维人脸识别系统。我们建议使用光度立体的脸重建，以通过传统的立体（需要解决匹配问题的第一），结构光（不提供颜色信息）和光度立体与光谱不同的光源（依赖于均匀着色的成像对象的假设）的问题。光度立体（PS）可以在每个像素的基础上再现结构细节和颜色，这是其他3D系统无法做到的。所提出的方案将适用于在受控环境中用于认证目的，但也适用于一般环境，例如公共活动的入口。我们将使用两种途径：从数据的表面重建和从PS集的面部特征的直接提取。在第一种方法中，一旦恢复表面法线和反照率，就可以在任意新的姿势和照明条件下合成渲染面部图像，以实现新颖的观看条件。我们的目标还在于在识别过程中使用一种新的多尺度面部特征匹配方法，其中面部特征的范围从整体面部和头部形状到精细的皮肤真皮地形、反射率和纹理。后者可以被认为是一种详细的表面凹凸图形式，形成独特的皮肤印记或签名，并代表了一种新方法。因此，3D形状和2D强度数据都将用于识别或认证任务。我们建议使用可扩展的方法进行匹配，因此我们可以科普大型数据库。3D匹配将使用新提出的入侵者算法，这是FFT互相关的基础上，和更详细的匹配将使用特征和分类器组合。我们的方法的新奇在于使用PS来提取3D信息，使用详细的面部特征，如痣，划痕和皮肤纹理，以及系统的设计，以便它可以在人移动时操作，以最小的侵入和最大的效率。我们有两个工业合作者，他们将在系统设计、数据收集和开发以及内政部的支持方面做出贡献。我们将评估我们的系统以下三个可能的问题：在人群中搜索的人脸（真实的时间人脸识别），一个人必须被识别（离线人脸识别）和一个人必须对一个声称的身份进行检查（人脸认证）。我们将在12月在我们的一个工业合作伙伴的办公室安装第一个原型系统，以便收集数据。我们设想一个像门一样的结构，当一个人走过时，灯会连续闪烁，同时相机会捕捉图像。我们建议调查在重建的效率和准确性方面的最佳灯数，以及使用不可见光的选择，以避免人们对闪光敏感的问题。我们还将研究必须捕捉的细节与结构几何形状之间的关系。

项目成果

Using Photometric Stereo for Face Recognition

使用光度立体进行人脸识别

• 发表时间: 2011
• 期刊: International Journal of Bio-Science and Bio-Technology
• 作者: Atkinson G A

Real-time recovery of moving 3D faces for emerging applications

• DOI: 10.1016/j.compind.2013.03.011
• 发表时间: 2013-12
• 期刊: Comput. Ind.
• 作者: K. Emrith;L. Broadbent;Lyndon N. Smith;Melvyn L. Smith;J. Molleda

An improved photometric stereo through distance estimation and light vector optimization from diffused maxima region

• DOI: 10.1016/j.patrec.2013.09.005
• 发表时间: 2014-12
• 期刊: Pattern Recognit. Lett.
• 作者: Jahanzeb Ahmad;Jiuai Sun;Lyndon N. Smith;Melvyn L. Smith

Using GPU Acceleration for Real-time Detection of Facial Micro-movements

利用GPU加速实时检测面部微动

• 发表时间: 2011
• 作者: Emrith K

Using nasal curves matching for expression robust 3D nose recognition

• DOI: 10.1109/btas.2013.6712732
• 发表时间: 2013-09
• 期刊: 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS)
• 作者: Mehryar Emambakhsh;A. Evans;Melvyn L. Smith