Novel Static Screen Volumetric 3D Display for Medical Image Visualization

描述（由申请人提供）：针对NIH SBIR PAR-07-160“生物医学计算科学与技术创新倡议”，由Xigen LLC于2008年8月5日与约翰霍普金斯医学院放射肿瘤科合作提交的新型静态屏幕体积3D医学图像可视化第一阶段提案，项目总结：医学成像技术的最新进展已经导致患者高分辨率3D和4D图像的可用性。这些图像本质上是3D的，然而所有传统的显示器都使用平面2D屏幕，缺乏重要的深度线索。虽然使用2D显示器的渲染软件在呈现成像模式的3D方面非常有效，但它们通常是不够的。这一基本限制极大地限制了临床医生了解3D解剖和治疗方案复杂性的能力，从而影响了治疗过程的安全性、速度、准确性和有效性。与传统的2D显示相比，本文提出的“体积3D显示”具有真正的3D显示体积，并将显示的3D图像中的每个3D“体素”物理地放置在真正的3D （x, y, z）空间位置。每个体素，类似于2D图像中的像素，从该位置发光，在观众眼中形成真正的3D图像。体积三维显示技术为人类视觉系统感知三维物体提供了生理和心理深度线索，被认为是解决医学图像真正三维可视化以及许多其他图像显示问题的“圣杯”。在过去的十年里，这个SBIR的首席研究员一直致力于开发最先进的体积3D显示技术。虽然我们之前的开发取得了很大的成功，但这种类型的体积显示系统的主要限制之一是它的3D显示体积是由一个大尺寸的移动屏幕产生的，该屏幕以600~1800 RPM的速度不断旋转。移动屏幕的结构极大地复杂化了显示系统的设计、生产、使用和维护，使得它在日常使用中非常精致和脆弱，并且对于广泛采用的医学图像可视化来说非常昂贵。Xigen LLC最近取得了技术突破，开发了革命性的三维立体显示新概念，完全消除了任何移动屏幕。所提出的静态屏幕体积三维显示技术的独特优势包括：z无移动屏幕；三维体素寻址的内在并行机制；z高空间分辨率；z全彩显示易于实现z精细体素尺寸（亚毫米级）；z显示体积无盲点，显示体积可任意形状。z系统结构设计简洁大方；z不需要特殊的观看眼镜或任何特殊的眼镜来观看3D图像；没有与移动屏幕相关的图像抖动影响；低成本和低维护。我们已经进行了相当多的初步可行性研究，以核实拟议的概念和实施战略的有效性。我们提出这个SBIR方案是为了构建一个高分辨率的原型硬件版本和开发相关的软件平台。公共卫生相关性：第一阶段SBIR工作的主要目标是证明具有前所未有的静态屏幕高分辨率体积3D显示能力的新型体积3D显示概念的可行性。我们已经进行了相当多的初步可行性研究，以核实拟议的概念和实施战略的有效性。我们提出SBIR方案是为了构建一个高分辨率的原型硬件版本，并开发相关的软件平台，以演示其在医学图像可视化中的应用。这项SBIR工作的主要创新包括：z将激光亚表面雕刻技术引入动态体积3D显示；z“体素列”概念，将晶体块和2D图像投影转换为可寻址的动态体积3D显示设备，带有静态屏幕；z“时间分割”和“衍射轮”的概念，促进超高分辨率图像投影从单一的DMD投影系统的高分辨率立体3D显示。我们一期项目的具体目标包括：目标1：与临床专家合作，定义3D晶体需求；目标2：设计并搭建3D-Crystal屏幕的高分辨率原型；目标3：设计并构建一个高分辨率的图像投影引擎；目标4：开发3D- crystal体积三维显示系统的图像处理和控制软件；目标5：对体积3D显示原型进行广泛测试；目标6：与约翰霍普金斯大学的成像专家合作，展示体积三维显示在医学图像可视化方面的优势；目标7：在一期样机经验的基础上，对3d晶体显示器进行“临床可测试”版本的优化设计，并准备二期工作计划。第二阶段的后续计划应该为我们提供足够的资源来设计，构建和测试临床可测试的功能性高分辨率体积3D显示器版本。提出的真正的3D显示技术为许多医学图像可视化应用增加了一个维度（字面上和比喻上）。它不是要取代传统的2D显示和3D渲染可视化系统，而是要增强它们，为观看者提供独特的功能和灵活性，以明确地可视化3D复杂信息。如果成功，这一突破性的努力将对医学研究产生重大影响，并将彻底改变目前在医学图像可视化、临床诊断、放射治疗计划、重建和矫正手术、医学教育、培训和医学研究方面的许多实践。关键词医学成像，图像可视化，图像处理，三维显示，体积，静态屏幕

DESCRIPTION (provided by applicant): Novel Static Screen Volumetric 3D Display for Medical Image Visualization Phase I proposal in response to NIH SBIR PAR-07-160 "Innovations in Biomedical Computational Science and Technology Initiative", Submitted by Xigen LLC on 08/05/2008, in collaboration with Department of Radiation Oncology, Johns Hopkins Medical Institute Project Summary Recent advances in medical imaging technology have led to the availability of high resolution 3D and 4D images of patients. These images are inherently of 3D nature, yet all conventional displays use flat 2D screens that lack important depth cues. While rendering software using 2D display monitors are quite effective in presenting 3D aspects of the imaging modalities, they are often inadequate. This fundamental restriction greatly limits the capability of clinicians to perceive the complexity of the 3D anatomy and treatment plan, therefore affects the safety, speed, accuracy, and effectiveness of the treatment procedures. In contrast to conventional 2D display, the "volumetric 3D display" we proposed herein possesses a true 3D display volume, and places physically each 3D "voxel" in the displayed 3D images at the true 3D (x, y, z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of viewers. The volumetric 3D display technology provides both physiological and psychological depth cues to human visual system to perceive 3D objects and is considered as the Holy Grail solution to true 3D visualization of medical image, as well as many other image display problems. For the past ten years, the principal investigator of this SBIR has been working on developing the state-of- the-art volumetric 3D display technologies. Although our previous development achieved a high success, one of the major limitation of this type of volumetric display systems is that its 3D display volume is generated by a large size moving screen that rotates constantly at the speed of 600~1800 RPM. The structure of a moving screen dramatically complicates the design, production, use, and maintenance of the display system, making it very delicate and fragile for daily uses and expensive for widespread adoption for medical image visualizations. Xigen LLC has recently made a technology breakthrough and developed a revolutionary new concept of volumetric 3D display, which totally eliminates any moving screen. The unique advantages of the proposed static screen volumetric 3D display technology include: z No moving screen; z Inherent parallel mechanism for 3D voxel addressing; z High spatial resolution; z Full color display is easy to implement z Fine voxel size (at a sub-millimeter level); z No blind spot on the display volume and the display volume can be of arbitrary shape. z Simple and elegant system structure design; z No special viewing glasses or any special eyewear is needed to view the 3D images; z No image jitter affect that is associated with moving screen; z Low-cost and low-maintenance. We have already performed considerable preliminary feasibility studies to verify the validity of the proposed concept and implementation strategy. We propose this SBIR program to build a high resolution version of prototype hardware and develop associated software platform. PUBLIC HEALTH RELEVANCE: The primary objective of this Phase I SBIR effort is to demonstrate the feasibility of a novel volumetric 3D display concept with the unprecedented static screen high resolution volumetric 3D display capability. We have already performed considerable preliminary feasibility studies to verify the validity of the proposed concept and implementation strategy. We propose this SBIR program to build a high resolution version of prototype hardware and develop associated software platform to demonstrate its application for medical image visualization. The major innovations of this SBIR effort include: z Introduction of the Laser Sub-surface Engraving technology into the dynamic volumetric 3D display; z The "voxel column" concept that converts the crystal block and a 2D image projection into an addressable dynamic volumetric 3D display device, with a static screen; z The "Time Division" and "Diffraction Wheel" concepts that facilitate the ultra-high-resolution image projection from single DMD projection system for the high-resolution volumetric 3D display. Specific aims of our Phase 1 program include: Aim 1: Working with clinical experts to define the 3D Crystal requirements; Aim 2: Design and build a high resolution prototype of the 3D-Crystal screen; Aim 3: Design and build a high resolution image projection engine; Aim 4: Develop image processing and control software for the 3D-Crystal volumetric 3D display system; Aim 5: Perform extensive tests on the volumetric 3D display prototype; Aim 6: Collaborate with imaging experts at Johns Hopkins to demonstrate advantages of volumetric 3D display for medical image visualization; Aim 7: Develop optimal design of "clinically-testable" version of 3D-Crystal display based on the Phase 1 prototype experience, and prepare for Phase 2 work plan. The Phase 2 follow-on program should afford us with sufficient resources to design, build and test a clinically-testable version of functional high resolution volumetric 3D display. The proposed true 3D display technology adds one more dimension (literally and figuratively) to many medical image visualization applications. It is not meant to replace traditional 2D display and 3D rendering visualization systems, but rather to augment them, giving the viewers the unique power and flexibility to unambiguously visualize 3D complex information. If succeed, this ground breaking effort will have a significant impact on medical research and will revolutionize many current practices in medical image visualization, clinical diagnosis, radiation therapy planning, reconstructive and corrective surgery, medical education, training, and medical research. . Key Words Medical imaging, image visualization, image processing, three dimensional display, volumetric, static screen.