CAREER: Scalable and Adaptable Cross-Domain Autonomous Health Assessment

职业：可扩展且适应性强的跨域自主健康评估

• 批准号: 1750936
• 负责人: Nirmalya Roy
• 金额: $ 55.03万
• 依托单位: University of Maryland Baltimore County
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-05-01 至 2025-04-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1750936&HistoricalAwards=false
• 关键词: CAREER; Scalable; Adaptable; Cross; Domain

The wide availability of commodity smart home sensor systems (Google Home, Amazon Echo, etc.) and internet-of-things (IoT) devices (Fitbit, Actigraph, etc.) is making it easier to continuously monitor individuals' health-related vital signals, activities, and behaviors to provide just-in-time health intervention to the aging population. This CAREER project seeks to design, implement, and evaluate heterogeneous sensor systems in smart homes that help ameliorate the progressive functional and behavioral health decline of older adults. The work specifically looks at cross-domain approaches that can accommodate variability in behavior, activity, and physiological health conditions across a large population and diverse set of smart home sensor systems. The inability to build scalable and adaptable activity and behavior monitoring models across domains such as multi-occupant homes with heterogeneous internet-of-things devices is a major impediment to adoption of smart home technologies for healthcare applications. The project develops novel deep transfer learning techniques, optimization-based heuristics, opportunistic sensing architecture, and spatiotemporal dynamical systems-based approaches to address the diversity, adaptability, and reliability of activity and behavior recognition models across different users and technologies, while leveraging a human-in-the-loop control for improving the performance of the sensor systems. These techniques will help automate activity and physiological health monitoring at scale, and thereby improve the design and study of adaptive interventions for elderly people, their families, and professional caregivers. In order to realize autonomous health assessment methodologies in practice, it is necessary to build an activity and behavior recognition system across multiple inhabitants and various connected consumer devices that can select, adapt, and cope with device and user heterogeneities, privacy characteristics, resource constraints and scarcity of labeled data. To address the above-mentioned problems, this research project contributes to new methodology in four ways. First, it is introducing deep transfer learning activity recognition model and multi-user multi-device optimization-based heuristics that automatically help adapt the inherent variations across different domains, including user/device-type/device-instance. Second, it is designing a spatio-temporal dynamical system approach based on fractal dynamics to mitigate the variability in various sensor signals, and capture the self-similarity of human physiological health markers and establish the parametric task performance dependency between functional and behavioral health measurements. Third, it posits an opportunistic sensing architecture and human-in-the loop activity model for real-time data sharing and annotation that help optimize the user interruption and system performance. Fourth, it is designing a distributed implementation of tailored-computational techniques in actual smart home deployments, and evaluating the effectiveness of sensor-based functional and behavioral models and algorithms for just-in-time health assessment in actual living environments. In addition to the targeted focus on education, an ongoing collaboration with the University of Maryland, School of Nursing is being leveraged for real deployment of smart home sensor systems and technologies at three retirement community centers and senior homes in the greater Baltimore area to compound the impact of proposed evidence-based research efforts.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

商用智能家居传感器系统(Google Home、Amazon Echo等)的广泛应用和物联网(IoT)设备(Fitbit、Actigraph等)使持续监测个人与健康相关的重要信号、活动和行为变得更容易，为老龄化人口提供及时的健康干预。这个职业项目旨在设计、实施和评估智能家居中的异类传感器系统，以帮助改善老年人渐进性的功能和行为健康下降。这项工作特别关注跨域方法，这些方法可以在大量人口和不同的智能家居传感器系统中适应行为、活动和生理健康状况的可变性。无法跨多个领域构建可扩展和可适应的活动和行为监控模型，例如具有异构物联网设备的多住户家庭，这是将智能家居技术应用于医疗保健应用的主要障碍。该项目开发了新的深度迁移学习技术、基于优化的启发式方法、机会感知体系结构和基于时空动态系统的方法，以解决跨不同用户和技术的活动和行为识别模型的多样性、适应性和可靠性，同时利用人在回路中的控制来提高传感器系统的性能。这些技术将有助于在规模上实现活动和生理健康监测的自动化，从而改进针对老年人、他们的家人和专业照顾者的适应性干预的设计和研究。为了在实践中实现自主的健康评估方法，有必要建立一个跨多个居民和各种连接的消费设备的活动和行为识别系统，该系统可以选择、适应和应对设备和用户的异构性、隐私特征、资源约束和标签数据的稀缺。为了解决上述问题，本研究项目在四个方面对新的方法论做出了贡献。首先，它引入了深度迁移学习活动识别模型和基于多用户多设备优化的启发式方法，有助于自动适应不同领域的内在差异，包括用户/设备类型/设备实例。其次，设计了一种基于分形动力学的时空动态系统方法，以缓解各种传感器信号的变异性，捕捉人体生理健康标记物的自相似性，并建立功能和行为健康测量之间的参数任务绩效依赖关系。第三，它提出了一种机会主义感知体系结构和人在环路活动模型，用于实时数据共享和注释，有助于优化用户中断和系统性能。第四，它正在设计在实际智能家居部署中定制计算技术的分布式实施，并评估基于传感器的功能和行为模型和算法在实际生活环境中进行实时健康评估的有效性。除了有针对性地关注教育之外，护理学院正在与马里兰大学进行合作，在大巴尔的摩地区的三个退休社区中心和养老院实际部署智能家居传感器系统和技术，以增加拟议的循证研究工作的影响。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

CamSense: A camera-based contact-less heart activity monitoring

• DOI: 10.1016/j.smhl.2021.100240
• 发表时间: 2021-11
• 期刊: Smart Health
• 作者: Zahid Hasan;S. R. Ramamurthy;Nirmalya Roy

AugToAct: scaling complex human activity recognition with few labels

• DOI: 10.1145/3360774.3360831
• 发表时间: 2019-11
• 期刊: Proceedings of the 16th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
• 作者: A. Faridee;Md Abdullah Al Hafiz Khan;Nilavra Pathak;Nirmalya Roy

CoDEm: Conditional Domain Embeddings for Scalable Human Activity Recognition

• DOI: 10.1109/smartcomp55677.2022.00017
• 发表时间: 2022-06
• 期刊: 2022 IEEE International Conference on Smart Computing (SMARTCOMP)
• 作者: A. Faridee;Avijoy Chakma;Zahid Hasan;Nirmalya Roy;Archan Misra

STranGAN: Adversarially-learnt Spatial Transformer for scalable human activity recognition

• DOI: 10.1016/j.smhl.2021.100226
• 发表时间: 2021-11
• 期刊: Smart Health
• 作者: A. Faridee;Avijoy Chakma;Archan Misra;Nirmalya Roy

LASO: Exploiting Locomotive and Acoustic Signatures over the Edge to Annotate IMU Data for Human Activity Recognition

• DOI: 10.1145/3382507.3418826
• 发表时间: 2020-10
• 期刊: Proceedings of the 2020 International Conference on Multimodal Interaction
• 作者: S. Chatterjee;Avijoy Chakma;A. Gangopadhyay;Nirmalya Roy;Bivas Mitra;Sandip Chakraborty