Full Parallax Enhanced Depth Full Color Three-Dimensional Visualization System

描述(申请人提供)：体积三维(3D)显示技术具有广泛的医学应用，例如在计算机断层扫描(CT)、磁共振成像(MRI)、正电子发射断层扫描(PET)和超声(US)中[1-12]。在神经科学中，脑研究产生的数据是多样化、海量和复杂的，因为这些数据具有高度的互联性和高维性。用于神经科学数据可视化的工具，例如多尺度3D成像能力，[13-31]可以为神经科学数据分析提供一个框架。这对于在医务人员培训、电话会议和治疗中实现数字协作环境尤其重要，因为它提供了复杂的时空大脑反应模式的可视化；大脑的生理和解剖数据的3D虚拟表示对于推进医疗诊断和治疗也是必不可少的，目的诸如术前规划、术中成像、精神障碍的诊断和药物开发。它是脑生理数据采集、处理和体绘制的有效工具。例如，可以首先从MRI扫描创建用于脑体积的3D网格，并使用该3D网格来提供参考坐标系以及用于使用EEG和fMRI结果将大脑活动区域绘制为3D图形对象的规则网格的解剖信息。这些对象的诸如颜色和大小的属性将随着活动的所选属性而共同变化，并且该表示将被叠加到受试者的MRI数据的体积渲染上以形成场景的解剖背景。用户可以在这个虚拟大脑中导航，并将其作为一个整体或部分进行可视化。这使用户能够在场景中体验到临场感(“在场”)，并观察到大脑活动在其原始时空关系中的动态。一种新的可视化工具，能够实时融合和显示大脑活动信息(EEG、fMRI等)因此是必要的。为了满足这种需求，物理光学公司(POC)提出开发一种新的全视差、增强深度、全色、三维(FED-COLOR-3D)可视化系统，该系统基于整体成像原理和新型液晶光学器件的使用，以实现自动(自动立体+多视角+多用户)3D可视化系统。它为裸眼观察者提供了具有全视差的全彩色和3D图像。在第一阶段，我们将与加州大学圣地亚哥分校(UCSD)认知科学系的Irina Gorodnitsky博士合作，开发并展示FED-COLOR-3D在实际医疗环境中的可行性，以协助手术前评估和规划，导致FED-COLOR-3D系统在第二阶段的一系列选定医疗应用中的开发、测试和评估。该项目的成功完成将提高目前3D系统的技术能力，以3D实时虚拟呈现大脑的生理和解剖数据。 与公众健康相关：拟议的全视差、增强深度、全色、三维(FED-COLOR-3D)可视化系统是基于集成成像原理的重大技术改进，并新颖地使用液晶光学设备来实现自动(自动立体+多视角+多用户)3D可视化系统。FED-COLOR-3D将用于大脑生理和解剖数据的3D实时虚拟显示，为裸眼观察者提供具有水平和垂直视差的全色3D图像。FED-COLOR-3D系统将提供神经科学数据分析、共享和可视化神经科学图像的框架，以及大脑生理和解剖数据的3D虚拟表示，用于术前规划的可视化，手术中的实时成像，用于精神障碍诊断的3D可视化，以及用于电话会议和医疗培训的复杂时空大脑反应模式的可视化。

DESCRIPTION (provided by applicant): Volumetric three-dimensional (3D) display technology has wide medical applications, such as in computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), and ultrasound (US) [1-12]. In neuroscience, data generated by brain research are diverse, vast, and complex because of the high level of interconnectedness of the data, and their high dimensionality. Tools for neuroscience data visualization, such as multiscale 3D imaging capabilities, [13-31] can provide a framework for neuroscience data analysis. This is especially important in realizing a digital collaborative environment in medical personnel training, teleconferencing, and treatments, as it provides visualization of complex spatiotemporal brain response patterns; 3D virtual representation of the brain's physiological and anatomical data is also essential to advance medical diagnostics and treatment [14-21, 32-44], for purposes such as presurgical planning, imaging during surgery, diagnosis of mental disorders, and drug development. It is an effective tool for brain physiological data acquisition, processing, and volumetric rendering. For example, a 3D mesh for the brain volume can be first created from an MRI scan and used to provide the reference coordinate system along with the anatomical information for mapping areas of brain activity as a regular grid of 3D graphical objects using the EEG and fMRI results. The properties such as color and size of these objects would co-vary with the selected properties of the activity, and this representation would be superimposed onto a volumetric rendering of the subject9s MRI data to form the anatomical background of the scene. The user can navigate in this virtual brain and visualize it as a whole or some of its parts. This allows the user to experience a sense of presence in the scene ("being there") and to observe the dynamics of brain's activity in its original spatiotemporal relations. A new visualization tool capable of real-time fusing and displaying brain activity information (EEG, fMRI, etc.) is thus needed. To address the needs, Physical Optics Corporation (POC) proposes to develop a new Full-parallax, Enhanced-Depth, full-Color, 3-Dimensional (FED-COLOR-3D) visualization system based on an integral imaging principle and novel use of liquid crystal optical devices to achieve an automultiscopic (autostereoscopic + multiperspective + multiuser) 3D visualization system. It provides bare-eyed observers with full color and 3D images that have full parallax. In Phase I, we will collaborate with Dr. Irina Gorodnitsky from the Cognitive Science Department of the University of California, San Diego (UCSD) to develop and demonstrate the feasibility of FED-COLOR-3D's in a practical medical environment to assist in pre-surgical evaluation and planning, leading to the development, testing and evaluation of the FED- COLOR-3D system in a range of selected medical applications during Phase II. Successful completion of this project will advance the technical capabilities of current 3D systems for 3D real-time virtual representation of the brain's physiological and anatomical data. PUBLIC HEALTH RELEVANCE: The proposed Full-parallax, Enhanced-Depth, full-COLOR, 3-Dimensional (FED-COLOR-3D) visualization system represents significant technical improvements based on an integral imaging principle and novel use of liquid crystal optical devices to achieve an automultiscopic (autostereoscopic + multiperspective + multiuser) 3D visualization system. The FED-COLOR-3D will be used for 3D real-time virtual display of the brain's physiological and anatomical data to provide bare-eyed observers with full-color 3D images with both horizontal and vertical parallaxes. The FED-COLOR-3D system will provide a framework for neuroscience data analysis, sharing and visualizing neuroscientific images, and a 3D virtual representation of the brain's physiological and anatomical data for visualization in presurgical planning, real-time imaging during surgery, 3D visualization for diagnosis of mental disorders, and visualization of complex spatiotemporal brain response patterns for teleconferencing and medical training.