Full Parallax Enhanced Depth Full Color Three-Dimensional Visualization System

全视差增强景深全彩三维可视化系统

• 批准号: 8251487
• 负责人: Fang A Zhang
• 金额: $ 15万
• 依托单位: PHYSICAL OPTICS CORPORATION
• 依托单位国家: 美国
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-08-15 至 2014-02-14
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8251487
• 关键词: 3-Dimensional; Address; Area; Brain; California; Cerebrum; Clinical; Cognitive; Cognitive Science; Color; Complex; Computer software; Data; Data Analyses; Development; Devices; Diagnostic; Electroencephalogram; Electronics; Environment; Evaluation; Eye; Functional Magnetic Resonance Imaging; Goals; Government; Health Personnel; Image; Imagery; Lead; Magnetic Resonance Imaging; Maps; Medical; Neurosciences; Operative Surgical Procedures; Optics; Patient Education; Pattern; Performance; Persons; Phase; Physiological; Positioning Attribute; Positron-Emission Tomography; Process; Property; Published Comment; Research; Scientist; Signal Transduction; Stream; System; Technology; Three-Dimensional Image; Three-Dimensional Imaging; Time; Training; Ultrasonography; Universities; X-Ray Computed Tomography; base; brain research; brain volume; commercialization; computer generated; data acquisition; design; digital; drug development; evaluation/testing; experience; improved; instrument; liquid crystal; meetings; mental disorder diagnosis; novel; operation; prototype; response; scale up; spatiotemporal; stereoscopic; tool; virtual

DESCRIPTION (provided by applicant): Volumetric three-dimensional (3D) display technology has wide medical applications, such as in computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), and ultrasound (US) [1-12]. In neuroscience, data generated by brain research are diverse, vast, and complex because of the high level of interconnectedness of the data, and their high dimensionality. Tools for neuroscience data visualization, such as multiscale 3D imaging capabilities, [13-31] can provide a framework for neuroscience data analysis. This is especially important in realizing a digital collaborative environment in medical personnel training, teleconferencing, and treatments, as it provides visualization of complex spatiotemporal brain response patterns; 3D virtual representation of the brain's physiological and anatomical data is also essential to advance medical diagnostics and treatment [14-21, 32-44], for purposes such as presurgical planning, imaging during surgery, diagnosis of mental disorders, and drug development. It is an effective tool for brain physiological data acquisition, processing, and volumetric rendering. For example, a 3D mesh for the brain volume can be first created from an MRI scan and used to provide the reference coordinate system along with the anatomical information for mapping areas of brain activity as a regular grid of 3D graphical objects using the EEG and fMRI results. The properties such as color and size of these objects would co-vary with the selected properties of the activity, and this representation would be superimposed onto a volumetric rendering of the subject9s MRI data to form the anatomical background of the scene. The user can navigate in this virtual brain and visualize it as a whole or some of its parts. This allows the user to experience a sense of presence in the scene ("being there") and to observe the dynamics of brain's activity in its original spatiotemporal relations. A new visualization tool capable of real-time fusing and displaying brain activity information (EEG, fMRI, etc.) is thus needed. To address the needs, Physical Optics Corporation (POC) proposes to develop a new Full-parallax, Enhanced-Depth, full-Color, 3-Dimensional (FED-COLOR-3D) visualization system based on an integral imaging principle and novel use of liquid crystal optical devices to achieve an automultiscopic (autostereoscopic + multiperspective + multiuser) 3D visualization system. It provides bare-eyed observers with full color and 3D images that have full parallax. In Phase I, we will collaborate with Dr. Irina Gorodnitsky from the Cognitive Science Department of the University of California, San Diego (UCSD) to develop and demonstrate the feasibility of FED-COLOR-3D's in a practical medical environment to assist in pre-surgical evaluation and planning, leading to the development, testing and evaluation of the FED- COLOR-3D system in a range of selected medical applications during Phase II. Successful completion of this project will advance the technical capabilities of current 3D systems for 3D real-time virtual representation of the brain's physiological and anatomical data. PUBLIC HEALTH RELEVANCE: The proposed Full-parallax, Enhanced-Depth, full-COLOR, 3-Dimensional (FED-COLOR-3D) visualization system represents significant technical improvements based on an integral imaging principle and novel use of liquid crystal optical devices to achieve an automultiscopic (autostereoscopic + multiperspective + multiuser) 3D visualization system. The FED-COLOR-3D will be used for 3D real-time virtual display of the brain's physiological and anatomical data to provide bare-eyed observers with full-color 3D images with both horizontal and vertical parallaxes. The FED-COLOR-3D system will provide a framework for neuroscience data analysis, sharing and visualizing neuroscientific images, and a 3D virtual representation of the brain's physiological and anatomical data for visualization in presurgical planning, real-time imaging during surgery, 3D visualization for diagnosis of mental disorders, and visualization of complex spatiotemporal brain response patterns for teleconferencing and medical training.

描述（申请人提供）：体积三维（3D）显示技术具有广泛的医学应用，如计算机断层扫描（CT）、磁共振成像（MRI）、正电子发射断层扫描（PET）和超声（US）[1-12]。在神经科学中，由于数据的高度互联性和高维性，大脑研究产生的数据是多样的、庞大的和复杂的。神经科学数据可视化工具，如多尺度三维成像能力[13-31]可以为神经科学数据分析提供框架。这对于实现医疗人员培训、远程会议和治疗中的数字协作环境尤其重要，因为它提供了复杂时空大脑反应模式的可视化；大脑生理和解剖数据的3D虚拟表示对于推进医学诊断和治疗也至关重要[14- 21,32 -44]，可用于手术前计划、手术期间成像、精神障碍诊断和药物开发等目的。它是脑生理数据采集、处理和体绘制的有效工具。例如，脑容量的3D网格可以首先从MRI扫描中创建，并用于提供参考坐标系统，以及使用EEG和fMRI结果将大脑活动区域映射为3D图形对象的规则网格的解剖信息。这些物体的颜色和大小等属性将与活动的选定属性共同变化，并且这种表示将叠加到受试者的MRI数据的体积渲染上，以形成场景的解剖背景。用户可以在这个虚拟大脑中导航，并将其作为一个整体或某些部分可视化。这让用户体验到在场景中的存在感（“在那里”），并在其原始时空关系中观察大脑活动的动态。因此，需要一种新的可视化工具，能够实时融合和显示大脑活动信息（EEG， fMRI等）。为此，物理光学公司（Physical Optics Corporation， POC）提出了一种基于集成成像原理和新型液晶光学器件的全视差、增强深度、全彩色、三维（FED-COLOR-3D）可视化系统，以实现自动多视（自立体+多视角+多用户）三维可视化系统。它为裸眼观察者提供全彩色和具有全视差的3D图像。在第一阶段，我们将与加州大学圣地亚哥分校（UCSD）认知科学系的Irina Gorodnitsky博士合作，开发和演示FED-COLOR-3D在实际医疗环境中的可行性，以协助术前评估和计划，从而在第二阶段期间在一系列选定的医疗应用中开发，测试和评估FED-COLOR-3D系统。该项目的成功完成将提高当前3D系统的技术能力，以实现大脑生理和解剖数据的3D实时虚拟表示。