Synthetic Generation of Face Videos with Plethysmograph Physiology
Synthetic Generation of Face Videos with Plethysmograph Physiology
复制标题
DOI：
10.1109/cvpr52688.2022.01993
复制
发表时间：
2022-06
期刊：
影响因子：
--
通讯作者：
Zhen Wang;Yunhao Ba;Pradyumna Chari;Oyku Deniz Bozkurt;Gianna Brown;Parth Patwa;Niranjan Vaddi
中科院分区：
文献类型：
--
作者：
Zhen Wang;Yunhao Ba;Pradyumna Chari;Oyku Deniz Bozkurt;Gianna Brown;Parth Patwa;Niranjan Vaddi
在远程医疗的推动下，远程光电容积描记术 (rPPG) 的进步开始为非接触式生理测量提供可行的途径。不幸的是，rPPG 的数据集有限，因为它们需要人脸视频与来自医疗级健康监测器的真实同步心率数据配对。同样令人不安的是，数据集不包含不同的人群，即当前真实的 rPPG 面部视频数据集在种族或肤色方面不平衡，导致不同人口群体的准确性差异。本文提出了一种基于可扩展的生物物理学习的方法，在给定任何参考图像和目标 rPPG 信号的情况下生成物理真实的合成 rPPG 视频，并表明它可以进一步改进最先进的生理测量并减少不同群体之间的偏差。我们还收集了同类中最大的 rPPG 数据集（UCLA-rPPG），其中包含不同的受试者肤色，希望这可以作为该领域不同肤色的基准数据集，并确保该技术的进步能够使所有人受益于医疗保健公平。该数据集可从 https://visual.ee.ucla.edu/rppg_avatars.htm/ 获取。
Accelerated by telemedicine, advances in Remote Photoplethysmography (rPPG) are beginning to offer a viable path toward non-contact physiological measurement. Unfortunately, the datasets for rPPG are limited as they require videos of the human face paired with ground-truth, synchronized heart rate data from a medical-grade health monitor. Also troubling is that the datasets are not inclusive of diverse populations, i.e., current real rPPG facial video datasets are imbalanced in terms of races or skin tones, leading to accuracy disparities on different demographic groups. This paper proposes a scalable biophysical learning based method to generate physio-realistic synthetic rPPG videos given any reference image and target rPPG signal and shows that it could further improve the state-of-the-art physiological measurement and reduce the bias among different groups. We also collect the largest rPPG dataset of its kind (UCLA-rPPG) with a diverse presence of subject skin tones, in the hope that this could serve as a benchmark dataset for different skin tones in this area and ensure that advances of the technique can benefit all people for healthcare equity. The dataset is available at https://visual.ee.ucla.edu/rppg_avatars.htm/.