Development of novel visualization techniques for medical images using a holographic volumetric display

在过去的20年里，技术和医学成像的快速发展同时导致了对放射图像的临床需求的增加。诸如X射线计算机断层扫描（CT）和磁共振成像（MRI）的成像模态产生高保真三维（3D）数据集。这些图像数据通常作为一系列切片显示在二维屏幕上，并且依赖于观看者的专业知识来进行解释。立体显示器的使用可以提供显著的益处，因为这些提供大脑通常必须概念化的深度信息，从而减少其工作量。真正的体积显示器正在研究和开发中，但计算机生成的数字模型显示器可以生产与当前的技术。数字3D模型可以很容易地从来自医疗扫描仪的扫描数据集创建。它们可用于提高学生的解剖学理解，帮助向患者解释诊断，并帮助手术计划和干预。随着技术与生活的日益融合，数字3D模型可以通过浏览器应用程序轻松访问。其空间数据使其成为立体显示和增强/虚拟现实（AR/VR）的良好选择，这些都是目前蓬勃发展的领域。所有3D设备的工作原理都与眼睛观察现实的原理相似。身体通过双眼视觉感知深度。眼睛的间距意味着每只眼睛从不同的角度看待现实。这种差异在大脑中进行分析和计算，以创建深度。眼睛里的肌肉工作来产生聚散。立体电视通过多个透镜或偏振透镜通过不同角度的图像显示多个图像，而VR/AR头戴式显示器（HMD）为每只眼睛显示不同角度的图像，以允许大脑重新创建3D场景。增强现实是将虚拟图形叠加到真实的场景上，使它们在同一空间中共存。而对于虚拟现实，整个场景是完全虚拟的，创造了一个更身临其境的体验。该项目的合作伙伴公司Holoxica设计了一个网络应用程序“Holoxar”，可以在线查看3D数字模型。该公司专门从事全息技术，特别是真正的体积显示。该项目的最初目标是在典型的临床环境中集成和评估Web应用程序，即与PACS数据库或与医疗扫描仪直接接口。应用软件应使用户能够轻松操纵和控制显示系统，并减少3D解释的认知工作量。将考虑视觉神经科学心理学和学习因素来改进应用程序。将在教学，诊断和手术规划和干预的不同医疗场景中评估其益处。该项目的第二个目的是将学到的知识转化为正在开发的真正的体积显示。

The rapid development of technology and medical imaging concurrently over the last 20 years has resulted in an increase in the clinical demand for radiological images. Imaging modalities such as X-ray Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) produce high-fidelity three-dimensional (3D) datasets. These image data are conventionally displayed on a two-dimensional screen as a series of slices and there is reliance on the expertise of the viewer for interpretation. The use of stereoscopic displays may offer significant benefit as these provides depth information that the brain usually has to conceptualise, thus reducing its workload. True volumetric displays are in research and development but the computer generated digital models for display can be produced with current technology. The digital 3D models can be readily created from scan datasets derived from medical scanners. They can be used to improve anatomical understanding for students, to help in explanations of diagnoses to patients and also to help in surgical planning and intervention. With technology being increasingly integrated in life, digital 3D models can be easily accessible through a browser app. Their spatial data makes them a good option for stereoscopic displays and augmented/virtual reality (AR/VR) which are thriving fields currently. All the 3D devices work by using similar principles to how the eyes view reality. The body perceives depth through our binocular vision. The spacing of the eyes means that each eye views reality at different angles. This disparity created is analysed and calculated in the brain to create depth. The muscles in the eye work to create vergence. Stereoscopic TV shows multiple images through different angled images either through multiple lenses or polarised lens, while VR/AR head-mounted displays (HMD) show different angled image for each eye to allow the brain to recreate the 3D scene. Augmented reality is the overlay of virtual graphics onto real scenery creating the appearance that they coexist in the same space. Whilst for virtual reality the entire scenery is completely virtual creating a more immersive experience.The parnter company for this project, Holoxica, has designed a web app "Holoxar" to view 3D digital models online. The company specialises in holography and in particular true volumetric displays. The initial aim of the project is the integration and evaluation of the web app within a typical clinical setting, i.e. with a PACS database or direct interfacing with medical scanners. The application software should enable the user to manipulate and control the display system with ease and reduce cognitive workload of 3D interpretation. Visual neuroscience psychology and learning factors will be taken into consideration to improve the app. The benefits will be assessed in different medical scenarios of teaching, diagnosis, and surgery planning and intervention. The secondary aim of the project is to translate what is learnt to a true volumetric display that is in on-going development.