Novel display, visualization and interaction paradigms for enhanced understanding of complex, multidimensional medical images

新颖的显示、可视化和交互范例，可增强对复杂、多维医学图像的理解

• 批准号: RGPIN-2017-06722
• 负责人: Kersten, Marta
• 金额: $ 1.82万
• 依托单位: Concordia University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=750112
• 关键词: Novel; display; visualization; interaction; paradigms

Over the last decade, significant advances have been made in the fields of display technologies, computer graphics and interaction devices. This progress has opened up new possibilities for visualizing and interacting with data and has necessitated new paradigms that allow for intuitive understanding of computer-rendered images using state-of-the-art technologies. The following research program entails the development of new visualization techniques for complex multidimensional data and novel methods for viewing, displaying and interacting with 3D data in augmented and virtual reality environments. The main source of data used to test the developed techniques will come from the field of image-guided surgery. In image-guided surgery a navigation system guides the surgeon by displaying the position of real surgical tools with respect to a 3D anatomical virtual model of the patient anatomy. This is not unlike a car's GPS (global positioning system), which relates a car's position in real space to a virtual representation of it on a map. A recent survey of image-guided surgery systems showed that there has been a lack of focus on how to best visualize, display and interact with anatomical patient data. The result of this is that new technologies have had a very limited impact on clinical practice. For example, clinicians continue to rely on 2D planar reconstructions of 3D anatomy even though these do not translate well to interventional tasks that require a 3D understanding of the anatomy. Rather than using projective methods and new display technologies, clinicians continue to rely on computer monitors, which require them to look away from the patient for guidance thereby disrupting the surgical workflow. Furthermore, surgeons do not directly interact with image-guided surgery systems but require the presence of technicians in the operating room to make adjustments to visualization or view parameters. Similarly, diagnosis and treatment planning rely on 2D planar images rather than the use of novel display techniques and volumetric visualization methods. To address these limitations, the purpose of the proposed research is to develop novel methods that take advantage of the most current graphics cards, display hardware and interaction technologies in order to enhance medical image interpretation for improved diagnosis, planning and surgical treatment. Although focused on the clinical domain, the algorithms and solutions developed through this research program will be applicable to other domains such as art and museology, heritage, gaming, and aviation, and in general to the fields of data visualization, human-computer interaction and human-factors engineering. This program will not only provide news ways of visualizing and interacting with complex multidimensional data but also investigate the capabilities of the human visual system in understanding computer-generated images.

在过去的十年中，在显示技术、计算机图形和交互设备领域中已经取得了显著的进步。这一进展为数据的可视化和互动开辟了新的可能性，并需要新的范式，使人们能够直观地理解使用最先进技术的计算机渲染图像。以下研究计划需要开发复杂多维数据的新可视化技术，以及在增强和虚拟现实环境中查看，显示和与3D数据交互的新方法。 用于测试所开发技术的主要数据来源将来自图像引导手术领域。在图像引导手术中，导航系统通过显示真实的手术工具相对于患者解剖结构的3D解剖虚拟模型的位置来引导外科医生。这与汽车的GPS（全球定位系统）没有什么不同，它将汽车在真实的空间中的位置与地图上的虚拟表示联系起来。最近对图像引导手术系统的调查表明，缺乏对如何最好地可视化、显示和与解剖患者数据交互的关注。其结果是，新技术对临床实践的影响非常有限。例如，临床医生继续依赖于3D解剖结构的2D平面重建，即使这些不能很好地转化为需要对解剖结构的3D理解的介入任务。临床医生继续依赖计算机显示器，而不是使用投影方法和新的显示技术，这要求他们将目光从患者身上移开以获得指导，从而扰乱了手术工作流程。此外，外科医生不直接与图像引导手术系统交互，而是需要技术人员在手术室中对可视化或视图参数进行调整。同样，诊断和治疗计划依赖于2D平面图像，而不是使用新的显示技术和体积可视化方法。为了解决这些局限性，拟议研究的目的是开发新的方法，利用最新的图形卡，显示硬件和交互技术，以提高医学图像的解释，改善诊断，规划和手术治疗。虽然专注于临床领域，但通过该研究计划开发的算法和解决方案将适用于其他领域，如艺术和博物馆学，遗产，游戏和航空，以及数据可视化，人机交互和人因工程等领域。该计划不仅将提供可视化和与复杂多维数据交互的新方法，还将研究人类视觉系统在理解计算机生成图像方面的能力。