Collaborative Research: CISE-MSI: DP: CNS: Multi-Modal User-Centric Mobility Scooter Driving Safety Assessment System

机动滑板车是一种负担得起、广受欢迎的辅助行动技术，对于促进行动不便/残疾人士的社会参与，从而提高他们的生活质量至关重要。然而，机动车驾驶安全面临的挑战是显而易见的，机动车事故会造成严重伤害，甚至可能造成死亡。为了应对这一挑战，本项目构建了基于多源数据的机动车驾驶员驾驶安全评估系统。该系统可以在家中使用，也可以在临床环境中帮助医生和康复专家。这项工作产生了机动滑板车安全评估指标框架和系统，该框架和系统提供了新的可用、准确和可解释的技术，以推进基于深度学习的数据智能支持的目标人群的康复和远程医疗过程。跨学科项目团队与Casa Colina医院和医疗保健中心以及加州州立大学北岭成就中心合作，形成了计算机科学和运动学之间的协同作用，以及来自两个拉美裔服务机构的健康促进，即加州州立理工大学波莫纳分校和德克萨斯大学圣安东尼奥分校。这项工作向参与机构中代表性不足的少数民族学生介绍了现实世界中的研究问题，研究能力扩展的示范可以传播到其他为少数民族服务的机构。该项目包括以下研究内容：1)建立一个纵向机动滑板车驾驶数据集，该数据集收集自行动不便/残疾人群的各种疾病(如神经系统疾病、年龄相关疾病和功能障碍)；2)开发一个机动滑板车驾驶安全度量框架；3)设计稳健的多模式深度学习算法，用于准确的安全评估，使用多模式数据的姿态估计和时间序列分析；4)使用可定制的硬件和软件在用户的机动滑板车上实施拟议的驾驶安全评估系统，并对拟议的系统进行广泛的测试和评估。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Mobility scooters are an affordable and popular assistive mobility technology that is critical in facilitating the social participation of people with mobility challenges/disabilities, thereby improving their quality of life. However, the challenges of mobility scooter driving safety are evident, and mobility scooter accidents can cause serious injuries, with the potential consequence even being death.To tackle this challenge, this project builds a driving safety assessment system for mobility scooter drivers based on multi-sourced data. This system can be used at home or in clinical settings to assist doctors and rehabilitation experts. This work generates a mobility scooter safety assessment metrics framework and system that provides new usable, accurate and interpretable techniques to advance rehabilitation and tele-medicine processes for the target group of population, empowered by deep-learning-based data intelligence. The interdisciplinary project team forms synergy between Computer Science and Kinesiology and Health Promotion from two Hispanic Serving Institutions, i.e., California State Polytechnic University, Pomona and University of Texas San Antonio, in collaboration with Casa Colina Hospital and Centers for Healthcare and California State University Northridge Center of Achievement. This work introduces real-world research problems to underrepresented minority students in participating institutions, and the demonstration of research capacity expansion can be disseminated to other Minority Serving Institutions. This project consists of the following research thrusts: 1) Building a longitudinal mobility scooter driving dataset collected from the mobility-disabled/challenged population with various conditions (e.g., neurologic disorders, age-related diseases, and dysfunctions); 2) Developing a mobility scooter driving safety metrics framework; 3) Designing robust, multi-modal deep learning algorithms for accurate safety assessment, employing pose-estimation and time series analysis of multi-modal data; 4) Implementing the proposed driving safety assessment system on users’ mobility scooters using customizable hardware and software, and conducting extensive testing and evaluation of the proposed system.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.