True 3D Display for IGRI

描述（由申请人提供）：我们周围的物理世界是三维（3D）的，然而大多数现有的具有平面屏幕的显示系统只能处理缺乏第三维（深度）信息的二维（2D）平面图像。这一基本限制极大地限制了人类对真实的世界对象复杂性的感知和理解能力。与主要基于2D平面屏幕的常规医学图像可视化相比，我们在本文中提出的“真3D显示器”拥有物理3D显示体积，并且将所显示的3D图像中的每个3D“体素”放置在真3D（x，y，z）空间位置处。每个体素类似于2D图像中的像素，从该位置发射光以在观看者的眼睛中形成真实的3D图像。真三维显示技术为人类视觉系统提供生理和心理深度线索来感知三维物体，被认为是解决医学图像真三维可视化和许多其他显示问题的圣杯。Xigen LLC最近取得了技术突破，并开发了一种革命性的“混合多视图/体积（HyMV）”3D显示器概念，能够在体积显示模式和多视图3D显示模式下提供真正的3D显示能力，同时相互叠加，或根据用户控制以单独的模式显示。体积3D图像提供所显示的3D对象的真实3D测量和所显示的3D对象之间的空间关系，而多视图3D图像提供所显示的3D对象的照片质量纹理化表面特性。通过将这两种3D显示模式无缝集成到单个3D显示系统中，所提出的HyMV技术提供了前所未有的真3D显示能力：能够显示体素的真3D位置以及对许多高图像质量医学可视化应用至关重要的各种表面属性（遮挡、发光、反射、阴影等）的体积3D显示。我们提出了这个SBIR的努力进行彻底的调查所提出的新概念，进行设计和权衡，建立一个功能原型，并评估其技术疗效的图像引导放射介入治疗癌症。XIGEN LLC的专有信息。0 NIH SBIR PA 07-042公共卫生相关性：该第I阶段SBIR工作的主要目标是证明具有前所未有的混合体积/多平面3D显示能力的新型体积3D显示概念的可行性。我们计划构建和测试一个功能原型，重点展示这一突破性创新的几个关键功能。我们现在总结所提出的HyMV 3D显示系统的独特优势：-首次在单个系统中实现相干体积和多视图3D显示; -在产生具有逼真表面特性的照片质量3D图像的同时，保留3D空间体素和3D测量能力- 在3D显示中提供体积模式、多视图模式和同时多视图/体积模式，适用于各种可视化和3D测量应用;- 使用最新的DMD器件，可轻松实现高空间分辨率、全彩色显示。- 不需要特殊的观察眼镜或任何特殊的眼镜来观看3D图像; -简单而优雅的系统结构设计。SBIR的主要创新包括：-在单一系统中无缝集成多视图和体积显示器的新概念; -混合旋转屏幕的新设计，适应两种显示模式; -紧凑和便携的整体系统设计; -允许与显示的真实3D图像交互的新颖的真实3D用户界面设备设计;- 为IGRI应用量身定制的集成真3D立体/多视图显示硬件/软件。后续的II期项目将使我们能够对该技术应用的介入疗效和临床结局进行临床研究。第三阶段计划将进行独特的真3D显示产品的产品化和商业化。除了图像引导的放射治疗介入之外，真3D显示技术的应用是巨大的，包括医学成像的各个领域（例如，图像引导治疗、临床诊断、过程训练、模拟、治疗前计划和临床假设验证）、军事（例如空中交通管制、飞行员训练、战场可视化、远程医疗）和商业（例如，3D电视、虚拟现实、动画、计算机辅助设计、科学计算、视频游戏、体育场显示器等）3D显示将提供一个新的现实主义水平，并从字面上添加一个新的层面，以信息显示工具集，我们现在有。XIGEN LLC的专有信息。1 NIH SBIR PA 07-042

DESCRIPTION (provided by applicant): The physical world around us is three-dimensional (3D), yet most existing display systems with flat screens can handle only two-dimensional (2D) flat images that lack the third dimension (depth) information. This fundamental restriction greatly limits the capability of human being in perceiving and understanding the complexity of real world objects. In contrast to conventional medical image visualization that are primarily based on 2D flat screen, the "true 3D display" we proposed herein possesses a physical 3D display volume, and places each 3D "voxel" in the displayed 3D images at the true 3D (x, y, z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of viewers. The true 3D display technology provides both physiological and psychological depth cues to human visual system to perceive 3D objects and is considered as the Holy Grail solution to true 3D visualization of medical image, and many other display problems. Xigen LLC has recently made a technology breakthrough and developed a revolutionary concept of the "hybrid multiview/volumetric (HyMV)" 3D display that is able to provide true 3D displaying capability in both the volumetric display mode and the multiview 3D display mode, simultaneously overlaying on each other, or displayed in separate modes as controlled by uses. The volumetric 3D images provide true 3D measurement of and spatial relationship among the displayed 3D objects, while the multiview 3D images provide photo-quality textured surface properties of the displayed 3D objects. By seamlessly integrating these two 3D display modes into a single 3D display system, the proposed HyMV technology offers an unprecedented true 3D display capability never available before: a volumetric 3D display capable of showing both true 3D positions of voxels, as well as various surface properties (occlusion, shining, reflection, shadow, etc) that are essential to many high image quality medical visualization applications. We propose this SBIR effort to perform thorough investigation of the proposed novel concept, carry out design and tradeoffs, build a functional prototype, and assess its technical efficacy for image-guided radiaotion intervention for cancer treatment. Proprietary Information of XIGEN LLC. 0 NIH SBIR PA 07-042 PUBLIC HEALTH RELEVANCE: The primary objective of this Phase I SBIR effort is to demonstrate the feasibility of a novel volumetric 3D display concept with the unprecedented hybrid volumetric/Multiplan 3D display capability. We plan to build and test a functional prototype, focusing our effort in demonstrating several key capabilities of this breakthrough innovation. We now summarize unique advantages of the proposed HyMV 3D display system: - For the first time, achieve coherent volumetric and multiview 3D display in single system; - Preserve 3D spatial voxels and 3D measurement capability while producing photo-quality 3D images with realistic surface properties (shining, shadow, occlusion, etc); - Offer volumetric mode, multiview mode and simultaneous multiview/volumetric mode in 3D display, suited for various visualization and 3D measurement applications; - High spatial resolution, full color display is easy to implement using the latest DMD devices. - No special viewing glasses or any special eyewear is needed to view the 3D images; - Simple and elegant system structure design. The major innovations of this SBIR effort include: - Novel concept to seamlessly integrate multiview and volumetric displays in single system; - Novel design of hybrid rotating screen, accommodating both display modes; - Compact and portable overall system design; - Novel true 3D user interface device design allowing for interaction with displayed true 3D images; - Integrated true 3D volumetric/multiview display hardware/software tailored for IGRI applications. The follow-on Phase 2 program will afford us to perform clinical study on the interventional efficacy and clinical outcomes of the technology applications. The Phase 3 program will carry out productization and commercialization of the unique true 3D display product. Beyond the image-guided radiotherapy intervention, applications of true 3D display technology are enormous, including various areas of medical imaging (e.g., image guided therapy, clinical diagnosis, procedure training, simulation, pre-treatment planning, and clinical hypothesis validation), military (e.g. air traffic control, pilot training, battlefield visualization, telemedicine) and commercial (e.g., 3D TV, virtual reality, advertizing, computer aided design, scientific computing, video games, stadium displays, etc.) The 3D display will provide a new level of realism and literally add a new dimension to information display tool set we now have. Proprietary Information of XIGEN LLC. 1 NIH SBIR PA 07-042