STTR Phase I: Camera-Based Multimodal AI for Health Monitoring

这项小企业技术转移（STTR）第一阶段项目的广泛影响将是减轻医疗保健成本和与国家日益增长的老龄化人口相关的挑战。该项目的成果将是建立一个能够全面、准确和更快地监测老年人的系统，这将1)改善老年人的生活质量和健康，2)解决未来护理短缺的问题，特别是在老年领域，3)降低医疗保健成本。拟议的技术可以影响需要持续、非侵入性健康监测的广泛公共卫生应用。这个小型企业技术转让（STTR）第一阶段项目应用实时计算机视觉和传感器融合处理，对与健康有关的活动进行实时连续监测和分析。此外，该项目通过分析老年人的群体行为和与物体的互动来确定他们是否遭受孤独，行为障碍或混乱状态，从而在现有解决方案之外迈出了重要的一步。本项目利用多种人工智能算法，最大限度地提高对人体微体运动的辨别能力，从而构建个性化行为理解和监控的训练框架。它还提出了一种创新的解决方案，利用计算机视觉的结果作为对热传感器的注意力反馈，以提高热处理对温度变化的准确性和鲁棒性。此外，该项目提供了一个基于边缘的一体化物联网解决方案，以保护公民的隐私，同时向负责人员提供实时持续的反馈。该系统在保护个人身份信息的同时提供了一种新颖的用户体验。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact of this Small Business Technology Transfer (STTR) Phase I project will be to mitigate healthcare costs and challenges associated with the nation's growing aging population. The outcome of this project will be a system that enables holistic, accurate, and faster monitoring of elderly people that will 1) improve quality of life and health of senior citizens, 2) address the future nursing shortage, particularly in the geriatric field, and 3) reduce healthcare costs. The proposed technology can impact a wide range of public health applications that require continuous, non-intrusive health monitoring.This Small Business Technology Transfer (STTR) Phase I project applies real-time computer vision and sensor fusion processing for real-time continuous monitoring and analysis of health-related activities. In addition, this project takes an essential step beyond current solutions by analyzing seniors' group behavior and interactions with objects to determine whether they suffer from loneliness, behavioral disorders, or confusion states. This project utilizes multiple artificial intelligence algorithms to maximize the discriminative power to understand human micro-body motions and thereby create a training framework for personalized behavioral understanding and monitoring. It also proposes an innovative solution to leverage the results of computer vision as attention feedback to thermal sensors to enhance the accuracy and robustness of thermal processing against temperature variations. Furthermore, the project offers an integrative edge-based Internet of Things solution to protect citizens' privacy while providing real-time continuous feedback to responsible personnel. The proposed system offers a novel user experience while protecting personally identifiable information.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.