Interactive and Mixed-Reality Data Visualisations for Assessment of Musculoskeletal Conditions

数据收集方法的最新进展，如可穿戴传感器和基于智能手机的工具，使得收集详细和多样化的患者生成的数据集用于评估肌肉骨骼状况成为可能。这些方法产生的数据通常很复杂，临床医生很难解释和呈现给患者。标准的2D数据呈现方法通常不适合以一种吸引人或理解的方式显示此类数据。下一个挑战是找到一种以有意义的方式呈现这些数据的方法--帮助诊断、治疗和管理患者的状况。该项目将评估实现这一目标的混合现实的适宜性，并开发与其他临床数据交互的工具，如核磁共振扫描和X射线。混合现实的使用将为使用新的界面和可视化提供机会，例如查看和操作从MRI扫描生成的虚拟3D模型，探索数据集的3D图形表示，以及使用虚拟内容增强数据形而上学方法。混合现实也为患者和临床医生之间的合作提供了巨大的好处。希望这将使临床医生能够更好地向患者提供信息，并帮助围绕临床医生做出的决定建立相互理解和信任。该项目旨在研究混合现实数据可视化在临床环境中提供的机会和好处。它将探索混合现实应用是否能够：改善患者和临床医生之间的合作，提供与患者生成的和临床数据更具吸引力和洞察力的交互，通过改进对患者病情的理解、诊断和治疗，从更广泛的医疗角度提供重要价值，使用数据物理化创建引人入胜的数据探索和感知方法。拟议的项目将建立在与皇家国家风湿病医院和Bath SPARC(沐浴脊椎炎研究联盟)现有合作的基础上，为研究成果提供潜在的影响途径，包括部署和评估基于技术的工具的机会。该项目的方法论将包括：通过系统的文献综述，对临床环境中使用混合现实的最新技术和以前的研究进行评估。评估不同混合现实数据可视化方法对于临床环境中特定用例的适用性。临床医生和患者用于与患者数据交互的原型应用程序的设计和评估。该项目由EPSRC在医疗保健技术主题下资助，旨在解决该主题中的一些挑战：开发未来疗法：混合现实可用于帮助支持开发通过提供与患者和临床数据交互和接触的新方法，创新疗法。物理干预的前沿：通过使用混合现实来提供对患者数据的更多了解并支持患者与临床医生之间的对话，可以改善患者病情的康复和管理。优化治疗：混合现实数据可视化在提高肌肉骨骼疾病的诊断和治疗效率方面具有重要价值。

Recent advances in data collection methods such as wearable sensors and smartphone-based tools have enableddetailed and diverse sets of patient-generated data to be gathered for the assessment of musculoskeletal conditions.The data produced by these methods is often complex and difficult for clinicians to interpret and present to patients.Standard 2D data presentation methods are often not suitable for displaying such data in a way that is engaging orcomprehensible.The next challenge is finding a way of presenting this data in a meaningful way - assisting in the diagnosis, treatment,and management of patients' conditions. This project will assess the suitability of mixed reality for achieving this, andfor developing engaging tools for interacting with other clinical data such as MRI scans and X-rays. The use of mixedreality will provide opportunities to use novel interfaces and visualisations, such as viewing and manipulating virtual3D models generated from MRI scans, exploring 3D graphical representations of data sets, and augmenting dataphysicalization methods with virtual content.Mixed reality also offers great benefits for collaboration between patients and clinicians. It is hoped that this will allowclinicians to better inform patients and help build a mutual understanding and trust around decisions made byclinicians.This project aims to research the opportunities and benefits that mixed reality data visualisations can provide inclinical settings. It will explore whether mixed reality applications can:Improve collaboration between patients and clinicians,Provide more engaging and insightful interaction with patient-generated and clinical data,Offer significant value from a wider healthcare perspective through improved understanding, diagnosis, andtreatment of patients' conditions,Create engaging methods of data exploration and perception using data physicalization.The proposed project will build upon existing collaborati ons with the Royal National Hospital for Rheumatic Diseasesand BathSPARC (Bath Spondyloarthritis Research Consortium) to provide potential pathways to impact for theoutputs of the research, including opportunities to deploy and evaluate technology-based tools.The methodology for this project will consist of:An assessment of the current state of the art and previous research into using mixed reality in clinical settingsthrough a systematic literature review.An assessment of the suitability of different mixed reality data visualisation methods for specific use cases withinclinical settings.The design and evaluation of prototype applications to be used by clinicians and patients for interacting with patientdata.This project is funded by EPSRC under the healthcare technologies theme and will aim to address some of thechallenges presented in that theme:Developing Future Therapies: Mixed reality can be used to help support the development of novel therapies byproviding new ways of interacting and engaging with patient and clinical data.Frontiers of Physical Intervention: Rehabilitation and management of patients' conditions can be improved throughusing mixed reality to provide a greater understanding of patient data and to support conversation between patientsand clinicians.Optimising Treatment: Mixed reality data visualisations can have significant value in improving the efficacy ofdiagnosis and treatment of musculoskeletal conditions.