Development of novel visualization techniques for medical images using a holographic volumetric display

在过去的20年里，技术和医学影像的快速发展导致了临床对放射影像的需求的增加。诸如X射线计算机断层扫描(CT)和磁共振成像(MRI)等成像方式产生高保真的三维(3D)数据集。这些图像数据通常作为一系列切片显示在二维屏幕上，并且依赖于观看者的专业知识来进行解释。立体显示器的使用可能会带来显著的好处，因为这些显示器提供了大脑通常必须概念化的深度信息，从而减少了它的工作量。真正的体积显示器正在研究和开发中，但计算机生成的用于显示的数字模型可以用当前的技术生产出来。数字3D模型可以容易地从从医用扫描仪导出的扫描数据集创建。它们可以用来提高学生对解剖学的理解，帮助向患者解释诊断，也有助于手术计划和干预。随着科技日益融入生活，数字3D模型可以通过浏览器应用程序轻松访问。它们的空间数据使其成为立体显示和增强/虚拟现实(AR/VR)的良好选择，这两个领域目前都是蓬勃发展的领域。所有3D设备的工作原理都与眼睛观察现实的原理相似。身体通过我们的双目视觉感知深度。眼睛的间距意味着每只眼睛从不同的角度看待现实。这种产生的差异在大脑中被分析和计算，以创造深度。眼睛的肌肉会产生会聚的效果。立体电视通过多个镜头或偏振镜头通过不同角度的图像显示多幅图像，而VR/AR头盔显示器(HMD)为每只眼睛显示不同角度的图像，使大脑能够重建3D场景。增强现实是将虚拟图形叠加到真实场景上，创造出它们共存于同一空间的外观。而对于虚拟现实来说，整个场景完全是虚拟的，创造了一种更加身临其境的体验。该项目的合作伙伴Holoxica公司设计了一款网络应用程序“Holoxar”，可以在线查看3D数字模型。该公司专门从事全息摄影，特别是真体积显示。该项目的最初目标是在典型的临床环境中集成和评估Web应用程序，即与PACS数据库或与医疗扫描仪直接接口。应用软件应使用户能够轻松地操作和控制显示系统，并减少3D解释的认知工作量。将考虑视觉神经科学、心理学和学习因素来改进APP。这些好处将在教学、诊断、手术计划和干预的不同医疗情景中进行评估。该项目的次要目标是将所学到的知识转化为正在进行的真正的体积显示。

The rapid development of technology and medical imaging concurrently over the last 20 years has resulted in an increase in the clinical demand for radiological images. Imaging modalities such as X-ray Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) produce high-fidelity three-dimensional (3D) datasets. These image data are conventionally displayed on a two-dimensional screen as a series of slices and there is reliance on the expertise of the viewer for interpretation. The use of stereoscopic displays may offer significant benefit as these provides depth information that the brain usually has to conceptualise, thus reducing its workload. True volumetric displays are in research and development but the computer generated digital models for display can be produced with current technology. The digital 3D models can be readily created from scan datasets derived from medical scanners. They can be used to improve anatomical understanding for students, to help in explanations of diagnoses to patients and also to help in surgical planning and intervention. With technology being increasingly integrated in life, digital 3D models can be easily accessible through a browser app. Their spatial data makes them a good option for stereoscopic displays and augmented/virtual reality (AR/VR) which are thriving fields currently. All the 3D devices work by using similar principles to how the eyes view reality. The body perceives depth through our binocular vision. The spacing of the eyes means that each eye views reality at different angles. This disparity created is analysed and calculated in the brain to create depth. The muscles in the eye work to create vergence. Stereoscopic TV shows multiple images through different angled images either through multiple lenses or polarised lens, while VR/AR head-mounted displays (HMD) show different angled image for each eye to allow the brain to recreate the 3D scene. Augmented reality is the overlay of virtual graphics onto real scenery creating the appearance that they coexist in the same space. Whilst for virtual reality the entire scenery is completely virtual creating a more immersive experience.The parnter company for this project, Holoxica, has designed a web app "Holoxar" to view 3D digital models online. The company specialises in holography and in particular true volumetric displays. The initial aim of the project is the integration and evaluation of the web app within a typical clinical setting, i.e. with a PACS database or direct interfacing with medical scanners. The application software should enable the user to manipulate and control the display system with ease and reduce cognitive workload of 3D interpretation. Visual neuroscience psychology and learning factors will be taken into consideration to improve the app. The benefits will be assessed in different medical scenarios of teaching, diagnosis, and surgery planning and intervention. The secondary aim of the project is to translate what is learnt to a true volumetric display that is in on-going development.