AI at the edge: From movement models to neurological outcome

边缘人工智能：从运动模型到神经系统结果

• 批准号: 2739967
• 金额: --
• 依托单位: King's College London
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2022
• 资助国家: 英国
• 起止时间: 2022 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2739967
• 关键词: AI; edge; movement; models; neurological

Aims of the project:- To develop state-of-the-art models that extract human pose using AI from in-hospital video streams - To characterise the temporal component of human movement using recurrent and graph neural networks - Understand the causal relationships between movement models and brain imaging features - Jointly use movement models, imaging and neurological tests to diagnose and prognose neurological conditions Project Description:Human gait is a high-dimensional system optimised for accuracy, stability, speed or energy efficiency in healthy young adults. As the brain ages through chronic cerebral ischaemia and atrophy, properties of motion changes and eventually gait and balance are compromised resulting in a falls risk. Previous studies have been limited - relatively small number of gait patterns analysed, measurements in non-ecological environments like gait laboratories and dimensional minimisation due to computational limits. The MoCat (motion characterisation) team at the school of biomedical engineering has developed a low-cost portable motion capture system with on-board computing which enables real-world data capture and on-board computation at-scale of human motion, using modern machine learning approaches. The PhD candidate will work with the MoCat team and develop new state-of-the-art purpose-built AI algorithms to characterise the whole body motion and gait of patients with any cerebral small vessel disease recruited from clinical environments (the neurology and stroke units of KHP hospitals) to develop novel insights on the high-dimensional nature of gait and falls risk. Current general-purpose body-tracking models are optimised for high recall in a crowded setting, and have limited need for 3D body-pose prediction from single camera video. The algorithms developed in this project will introduce time-consistency and 3D body pose prediction from single camera views, stereoscopic matching of pose from multiple cameras, and human/human and human/room interaction. After a time-consistent vectorial representation of the human body is extracted, recurrent graph neural networks will be used to characterise and cluster movements, diagnose movement disorders, and predict deviations from normal (healthy) human movement. Lastly, we will use a substantial subset of the cohort (patients suffering from a transient ischaemic attack - TIA) which have medical imaging data (MRI/CT) to understand how brain lesions affect fibre connectivity and subsequently result in observed movement impairments, enabling the prediction of long term disease effects from imaging data.

该项目的目标：-开发最先进的模型，使用AI从医院视频流中提取人体姿势-使用递归和图形神经网络来模拟人体运动的时间分量-了解运动模型和大脑成像特征之间的因果关系-联合使用运动模型，成像和神经测试来诊断和诊断神经系统疾病项目描述：人类步态是一个高维系统，在健康的年轻人中，它针对准确性，稳定性，速度或能量效率进行了优化。随着大脑通过慢性脑缺血和萎缩而老化，运动特性改变，最终步态和平衡受到损害，导致福尔斯风险。以前的研究一直是有限的-相对较少的步态模式分析，在非生态环境中的测量，如步态实验室和尺寸最小化，由于计算的限制。生物医学工程学院的MoCat（运动表征）团队开发了一种低成本的便携式运动捕捉系统，该系统具有板载计算功能，可以使用现代机器学习方法在人体运动的范围内进行真实世界的数据捕捉和板载计算。博士候选人将与MoCat团队合作，开发新的最先进的专用AI算法，以评估从临床环境（KHP医院的神经病学和中风科）招募的任何脑小血管疾病患者的全身运动和步态，以开发关于步态和福尔斯风险的高维性质的新见解。当前的通用身体跟踪模型针对拥挤环境中的高召回率进行了优化，并且对来自单个摄像机视频的3D身体姿势预测的需求有限。在这个项目中开发的算法将引入时间一致性和3D身体姿势预测从单摄像机视图，立体匹配的姿势从多个摄像机，和人/人和人/房间的互动。在提取人体的时间一致性矢量表示后，递归图神经网络将用于对运动进行分类和聚类，诊断运动障碍，并预测与正常（健康）人体运动的偏差。最后，我们将使用具有医学成像数据（MRI/CT）的队列（患有短暂性脑缺血发作- TIA的患者）的大量子集来了解脑病变如何影响纤维连接并随后导致观察到的运动障碍，从而能够从成像数据预测长期疾病影响。