SCH: EAGER: RUI: Collaborative Research: A novel 3D image predictive model for osteoarthritis disease

SCH：EAGER：RUI：协作研究：骨关节炎疾病的新型 3D 图像预测模型

• 批准号: 1723420
• 负责人: Juan Shan
• 金额: $ 20.81万
• 依托单位: Pace University New York Campus
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-15 至 2022-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1723420&HistoricalAwards=false
• 关键词: SCH; EAGER; RUI; Collaborative; Research

Knee osteoarthritis (OA) affects 10% of older adults and is a major cause of work absence, early retirement and joint replacement. Knee OA is a disease characterized by deterioration of the cartilage in the knee. Using current technology, it is hard to predict how fast or how much deterioration will take place because cartilage loss is a slow and gradual process and can only be detected through medical images. This project will explore a novel 3D image model that can predict the accurate change of knee cartilage, to facilitate early detection and personal treatment for OA. If successful, the project could benefit 35 million people in the United States by reducing the high economic cost related to OA treatment, and improving the quality of life for these people. The PIs plan to disseminate the research to local medical communities and design a new course to involve undergraduate students into the research. The novel 3D image predictive model should have a wide variety of imaging applications. The goal of this project is to explore a novel 3D-information-fusion mechanism for medical imaging and a novel 3D image-to-image predictive model using deep neural networks as the core. The project will integrate cartilage information from MRI sequences. To handle size differences and perform image registration, a universal coordinate system will be defined to form a continuous and complete representation of the cartilage plane. Using the coordinate system, deep neural networks will be trained to learn the underlying correlation between the 3D cartilage maps. Unlike the traditional image-to-single-value prediction, the model will make image-to-image prediction; that is, from a current 3D cartilage map to a future 3D cartilage map, for different lengths of time (2, 4, 6, and 8 years respectively), leveraging a large imaging database. Finally, the team will construct the future 3D knee models from the cartilage maps to display the trajectory of cartilage change in a 3D view.

膝关节骨关节炎（OA）影响10%的老年人，是导致缺勤、提前退休和关节置换的主要原因。膝关节OA是一种以膝关节软骨退化为特征的疾病。使用目前的技术，很难预测恶化的速度或程度，因为软骨损失是一个缓慢而渐进的过程，只能通过医学图像来检测。本研究将探索一种新的三维图像模型，可以准确预测膝关节软骨的变化，以促进OA的早期发现和个性化治疗。如果成功，该项目可以通过降低与OA治疗相关的高昂经济成本并改善这些人的生活质量，使美国3500万人受益。PI计划将研究传播到当地医学界，并设计一个新的课程，让本科生参与研究。新的3D图像预测模型应该具有各种各样的成像应用。该项目的目标是探索一种新型的医学成像3D信息融合机制，以及一种以深度神经网络为核心的新型3D图像到图像预测模型。该项目将整合来自MRI序列的软骨信息。为了处理尺寸差异并执行图像配准，将定义通用坐标系以形成软骨平面的连续且完整的表示。使用坐标系，将训练深度神经网络来学习3D软骨图之间的潜在相关性。与传统的图像到单值预测不同，该模型将进行图像到图像预测;即，从当前的3D软骨图到未来的3D软骨图，持续不同的时间长度（分别为2年，4年，6年和8年），利用大型成像数据库。最后，该团队将根据软骨图构建未来的3D膝关节模型，以3D视图显示软骨变化的轨迹。

项目成果

Knee osteoarthritis severity level classification using whole knee cartilage damage Index and ANN

使用全膝软骨损伤指数和人工神经网络对膝骨关节炎严重程度进行分类

• DOI: 10.1145/3278576.3278585
• 发表时间: 2018
• 期刊: Systems and Engineering Technologies
• 作者: Du, Yaodong;Shan, Juan;Almajalid, Rania;Zhang, Ming
• 通讯作者: Zhang, Ming

FINGER JOINT SEGMENTATION USING MACHINE LEARNING AND MINIMIZED TRAINING SET

使用机器学习和最小化训练集进行手指关节分割

• DOI: 10.1016/j.joca.2022.02.118
• 发表时间: 2022
• 期刊: Osteoarthritis and Cartilage
• 影响因子: 7
• 作者: Wang, Y.;Zhang, M.;Cheung, T.;Guida, C.;Ren, R.;Shan, J.
• 通讯作者: Shan, J.

Automated Hand Osteoarthritis Classification Using Convolutional Neural Networks

使用卷积神经网络自动手部骨关节炎分类

• DOI: 10.1109/icmla52953.2021.00240
• 发表时间: 2021
• 期刊: IEEE 20th International Conference on Machine Learning and Applications
• 作者: Guida, Carmine;Zhang, Ming;Blackadar, Jordan;Yang, Zilong;Driban, Jeffrey B.;Duryea, Jeffrey;Schaefer, Lena;Eaton, Charles B.;McAlindon, Timothy;Shan, Juan
• 通讯作者: Shan, Juan

Automatic Hand Segmentation from Hand X-rays Using Minimized Training Samples and Machine Learning Models

使用最小化训练样本和机器学习模型根据手部 X 射线自动分割手部

• 发表时间: 2021
• 期刊: Arthritis rheumatology
• 作者: Yang, Z.;Shan, J.;Guida, C.;Blackadar, J.;Cheung, T;Driban, J;McAlindon, T;Zhang, M
• 通讯作者: Zhang, M

Bone Marrow Lesion Segmentation Using Synthetic Data and Deep Learning Models

使用合成数据和深度学习模型进行骨髓病变分割

• 发表时间: 2021
• 期刊: Arthritis rheumatology
• 作者: Michaely B.;Zhang M.;Shan, J.
• 通讯作者: Shan, J.