SCH: Neonatal Facial Coding for Pain Recognition Monitoring System (PRAMS)

疼痛每年影响超过1500万住院婴儿。早期疼痛与大脑结构和功能发育异常有关，并导致不良后果，包括认知障碍、情感功能改变、精神病理学和整体疼痛敏感性。使用与基于大脑的疼痛证据相关的面部表情，护士只同意67-87%的婴儿疼痛的存在。因此，无法自我报告疼痛使婴儿容易受到疼痛治疗不足和过度的影响。研究人员创建并验证了一个初步的人工智能（AI）授权的疼痛分类模型，该模型基于新生儿疼痛视频数据集的面部动作。该模型在对小样本婴儿的分析中提供了94%的准确率，93%的精确率和95%的召回率。该模型不够强大，无法用于持续的疼痛评估，直到它可以用大量不同的婴儿样本完全开发出来。该项目正在被整合到研究人员提供的教育活动中，包括第一个基于联邦学习（FL）概念和算法的大规模开放式在线课程。这项研究计划的目标是推进创建一个自动化的疼痛识别AI授权监测系统（PRAMS），该系统以疼痛的生物学证据为基础，并由护士在环监督。一种新的混合FL方法正在通过使用不同的疼痛评估数据集进行测试，该数据集是从八个病人护理单位手术前后的200多名婴儿的时间序列面部动作视频，生理和临床数据中创建的;因此，模拟医院间的分布式学习。数学证明，这种新的混合FL方法具有有利的收敛特性，在凸学习问题正在提供建立在未来类似的收敛范围为非凸优化。该项目具有很大的潜力，可以在保护隐私的FL方法中推动跨异构数据集的机器学习算法的开发，该方法可以利用多站点数据的统计能力来学习即使是罕见情况下也有临床意义的特征。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估来支持。

Pain affects over 15 million hospitalized babies annually. Early-life pain is associated with abnormal structural and functional brain development and results in adverse consequences, including cognitive impairments, altered emotional functioning, psychopathologies, and global pain sensitivity. Using facial expressions associated with brain-based evidence of pain, nurses only agree to the presence of babies’ pain 67-87% of the time. Thus, the inability to self-report pain makes babies vulnerable to under- and over-treatment of pain. The investigators created and pediatric nurses validated, a preliminary artificial intelligence (AI)-empowered pain classification model based on facial actions from a video dataset of newborn pain. This model provides 94% accuracy, 93% precision, and 95% recall in analyses of a small sample of babies. This model is not robust enough to be deployed for continuous pain assessment until it can be fully developed with a large sample of diverse babies. This project is being integrated into educational activities offered by the investigators, including the first massive open online course based on federated learning (FL) concepts and algorithms. The goal of this program of research is to advance the creation of an automated Pain Recognition AI-empowered Monitoring System (PRAMS) grounded by biological evidence of pain and supervised by nurses-in-the loop. A novel hybrid FL approach is being tested by using a diverse pain assessment dataset that is being created from time-series facial action video, physiological and clinical data of more than 200 babies before and after surgery in eight patient care units; thus, simulating inter-hospital distributed learning. Mathematical proof that this novel hybrid FL approach has advantageous convergence characteristics in convex learning problems is being provided to establish in the future similar convergence bounds for non-convex optimization. This project has great potential to advance the development of machine learning algorithms across heterogeneous datasets in a privacy-preserving FL approach that could leverage the statistical power of multi-site data to learn clinically meaningful features of even rare conditions.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.