True 3D Display for IGRI

描述（由申请人提供）：我们周围的物理世界是三维的（3D），然而大多数现有的平面屏幕显示系统只能处理缺乏三维（深度）信息的二维（2D）平面图像。这一基本限制极大地限制了人类感知和理解现实世界事物复杂性的能力。与传统的主要基于二维平面屏幕的医学图像可视化不同，本文提出的“真三维显示”具有物理的三维显示体，并将显示的3D图像中的每个3D“体素”放置在真正的3D （x, y, z）空间位置。每个体素，类似于2D图像中的像素，从该位置发光，在观众眼中形成真正的3D图像。真正的三维显示技术为人类视觉系统感知三维物体提供了生理和心理深度线索，被认为是解决医学图像真正三维可视化等许多显示问题的“圣杯”。Xigen LLC最近取得了技术突破，开发了一种革命性的概念，即“混合多视图/体积（HyMV）”3D显示，能够在体积显示模式和多视图3D显示模式下提供真正的3D显示能力，同时相互叠加，或根据用户控制以单独的模式显示。体积三维图像提供了显示的三维物体之间的真实三维测量和空间关系，而多视图三维图像提供了显示的三维物体的照片质量纹理表面属性。通过将这两种3D显示模式无缝集成到单个3D显示系统中，提出的HyMV技术提供了前所未有的真正3D显示能力：体积3D显示能够显示体素的真正3D位置，以及各种表面属性（遮挡，发光，反射，阴影等），这对于许多高图像质量的医学可视化应用至关重要。我们建议对提出的新概念进行彻底的研究，进行设计和权衡，建立一个功能原型，并评估其用于癌症治疗的图像引导辐射干预的技术功效。公共卫生相关性：这项第一阶段SBIR工作的主要目标是证明具有前所未有的混合volumetric/Multiplan 3D显示能力的新型体积3D显示概念的可行性。我们计划建立和测试一个功能原型，集中精力展示这一突破性创新的几个关键功能。我们总结了HyMV 3D显示系统的独特优势：-首次在单一系统中实现相干体和多视图3D显示；-保留3D空间体素和3D测量能力，同时产生具有逼真表面属性（闪光，阴影，遮挡等）的照片级3D图像；-在3D显示中提供体积模式，多视图模式和同时多视图/体积模式，适合各种可视化和3D测量应用；-高空间分辨率，全彩显示很容易实现使用最新的DMD设备。-不需要特殊的观看眼镜或任何特殊的眼镜来观看3D图像；-系统结构设计简洁大方。这项SBIR工作的主要创新包括：-在单一系统中无缝集成多视图和体积显示的新颖概念；-新颖的混合旋转屏幕设计，可适应两种显示方式；-紧凑便携的整体系统设计；-新颖的真3D用户界面设备设计，允许与显示的真3D图像进行交互；-集成真正的3D体积/多视图显示硬件/软件定制的IGRI应用。后续二期项目将对该技术应用的介入疗效和临床结果进行临床研究。第三阶段计划将进行独特的真正3D显示产品的产品化和商业化。除了图像引导的放射治疗干预之外，真正的3D显示技术的应用是巨大的，包括医学成像（如图像引导治疗、临床诊断、程序训练、模拟、治疗前计划和临床假设验证）、军事（如空中交通管制、飞行员训练、战场可视化、远程医疗）和商业（如3D电视、虚拟现实、广告、计算机辅助设计、科学计算）的各个领域。电子游戏，体育场显示器等)3D显示器将提供一个新的现实主义水平，并从字面上为我们现有的信息显示工具集添加一个新的维度。XIGEN LLC.专利信息1 NIH SBIR PA 07-042

DESCRIPTION (provided by applicant): The physical world around us is three-dimensional (3D), yet most existing display systems with flat screens can handle only two-dimensional (2D) flat images that lack the third dimension (depth) information. This fundamental restriction greatly limits the capability of human being in perceiving and understanding the complexity of real world objects. In contrast to conventional medical image visualization that are primarily based on 2D flat screen, the "true 3D display" we proposed herein possesses a physical 3D display volume, and places each 3D "voxel" in the displayed 3D images at the true 3D (x, y, z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of viewers. The true 3D display technology provides both physiological and psychological depth cues to human visual system to perceive 3D objects and is considered as the Holy Grail solution to true 3D visualization of medical image, and many other display problems. Xigen LLC has recently made a technology breakthrough and developed a revolutionary concept of the "hybrid multiview/volumetric (HyMV)" 3D display that is able to provide true 3D displaying capability in both the volumetric display mode and the multiview 3D display mode, simultaneously overlaying on each other, or displayed in separate modes as controlled by uses. The volumetric 3D images provide true 3D measurement of and spatial relationship among the displayed 3D objects, while the multiview 3D images provide photo-quality textured surface properties of the displayed 3D objects. By seamlessly integrating these two 3D display modes into a single 3D display system, the proposed HyMV technology offers an unprecedented true 3D display capability never available before: a volumetric 3D display capable of showing both true 3D positions of voxels, as well as various surface properties (occlusion, shining, reflection, shadow, etc) that are essential to many high image quality medical visualization applications. We propose this SBIR effort to perform thorough investigation of the proposed novel concept, carry out design and tradeoffs, build a functional prototype, and assess its technical efficacy for image-guided radiaotion intervention for cancer treatment. Proprietary Information of XIGEN LLC. 0 NIH SBIR PA 07-042 PUBLIC HEALTH RELEVANCE: The primary objective of this Phase I SBIR effort is to demonstrate the feasibility of a novel volumetric 3D display concept with the unprecedented hybrid volumetric/Multiplan 3D display capability. We plan to build and test a functional prototype, focusing our effort in demonstrating several key capabilities of this breakthrough innovation. We now summarize unique advantages of the proposed HyMV 3D display system: - For the first time, achieve coherent volumetric and multiview 3D display in single system; - Preserve 3D spatial voxels and 3D measurement capability while producing photo-quality 3D images with realistic surface properties (shining, shadow, occlusion, etc); - Offer volumetric mode, multiview mode and simultaneous multiview/volumetric mode in 3D display, suited for various visualization and 3D measurement applications; - High spatial resolution, full color display is easy to implement using the latest DMD devices. - No special viewing glasses or any special eyewear is needed to view the 3D images; - Simple and elegant system structure design. The major innovations of this SBIR effort include: - Novel concept to seamlessly integrate multiview and volumetric displays in single system; - Novel design of hybrid rotating screen, accommodating both display modes; - Compact and portable overall system design; - Novel true 3D user interface device design allowing for interaction with displayed true 3D images; - Integrated true 3D volumetric/multiview display hardware/software tailored for IGRI applications. The follow-on Phase 2 program will afford us to perform clinical study on the interventional efficacy and clinical outcomes of the technology applications. The Phase 3 program will carry out productization and commercialization of the unique true 3D display product. Beyond the image-guided radiotherapy intervention, applications of true 3D display technology are enormous, including various areas of medical imaging (e.g., image guided therapy, clinical diagnosis, procedure training, simulation, pre-treatment planning, and clinical hypothesis validation), military (e.g. air traffic control, pilot training, battlefield visualization, telemedicine) and commercial (e.g., 3D TV, virtual reality, advertizing, computer aided design, scientific computing, video games, stadium displays, etc.) The 3D display will provide a new level of realism and literally add a new dimension to information display tool set we now have. Proprietary Information of XIGEN LLC. 1 NIH SBIR PA 07-042