True 3D Display for IGRI

描述(申请人提供)：我们周围的物理世界是三维的(3D)，但大多数现有的平板显示系统只能处理缺乏三维(深度)信息的二维(2D)平面图像。这种根本性的限制极大地限制了人类感知和理解现实世界物体的复杂性的能力。与主要基于2D平板屏幕的传统医学图像可视化不同，我们在此提出的“真3D显示”具有物理3D显示体积，并将所显示的3D图像中的每个3D“体素”放置在真3D(x，y，z)空间位置。每个体素，类似于2D图像中的一个像素，从该位置发射光，在观看者眼中形成真正的3D图像。真三维显示技术为人类视觉系统感知三维物体提供了生理和心理的深度线索，被认为是解决医学图像真三维可视化等诸多显示问题的圣杯。Xigen LLC最近取得了一项技术突破，开发了革命性的“混合式多视角/体积(HyMV)”3D显示器概念，能够在体积显示模式和多视角3D显示模式下提供真正的3D显示能力，同时相互重叠，或者根据用户的控制以不同的模式显示。体积3D图像提供所显示的3D对象之间的真实3D测量和空间关系，而多视点3D图像提供所显示的3D对象的照片质量纹理表面属性。通过将这两种3D显示模式无缝集成到单个3D显示系统中，建议的HyMV技术提供了前所未有的真实3D显示能力：能够显示体素的真实3D位置以及对许多高图像质量医学可视化应用至关重要的各种表面属性(遮挡、光亮、反射、阴影等)的体积3D显示。我们提出了这项SBIR工作，以对所提出的新概念进行彻底的调查，进行设计和权衡，建立功能原型，并评估其在图像引导的放射治疗癌症治疗中的技术有效性。西根有限责任公司专有信息。0 NIH SBIR PA 07-042公共卫生相关性：这项第一阶段SBIR工作的主要目标是展示一种具有前所未有的混合体积/多平面3D显示能力的新型体积3D显示概念的可行性。我们计划建造和测试一个功能原型，重点展示这一突破性创新的几个关键能力。我们现在总结一下建议的HyMV 3D显示系统的独特优势：-首次在单一系统中实现连贯的体积和多视角3D显示；-保留3D空间体素和3D测量能力，同时产生具有真实表面属性(光泽、阴影、遮挡等)的照片质量3D图像；-在3D显示中提供体积模式、多视角模式和同时的多视图/体积模式，适合各种可视化和3D测量应用；-高空间分辨率、全色显示易于使用最新的DMD设备实现。-观看3D图像不需要特殊的观看眼镜或任何特殊的眼镜；-简单典雅的系统结构设计。这项SBIR工作的主要创新包括：-在单一系统中无缝集成多视角和体积显示器的新概念；-适应两种显示模式的混合旋转屏幕的新颖设计；-紧凑和便携的整体系统设计；-允许与所显示的真3D图像交互的新型真3D用户界面设备设计；-为IGRI应用量身定制的集成真3D体积/多视角显示硬件/软件。后续的第二阶段计划将为我们提供对技术应用的干预效果和临床结果的临床研究。第三阶段计划将对独特的真3D显示产品进行产品化和商业化。除了图像引导的放射治疗干预，真3D显示技术的应用是巨大的，包括医学成像的各个领域(例如，图像引导治疗、临床诊断、过程训练、模拟、治疗前规划和临床假设验证)、军事(例如，空中交通管制、飞行员训练、战场可视化、远程医疗)和商业(例如，3D电视、虚拟现实、广告、计算机辅助设计、科学计算、视频游戏、体育场展示等)。3D显示将提供一个新的真实感水平，并从字面上为我们现有的信息显示工具集增加一个新的维度。西根有限责任公司专有信息。1 NIH SBIR PA 07-042

DESCRIPTION (provided by applicant): The physical world around us is three-dimensional (3D), yet most existing display systems with flat screens can handle only two-dimensional (2D) flat images that lack the third dimension (depth) information. This fundamental restriction greatly limits the capability of human being in perceiving and understanding the complexity of real world objects. In contrast to conventional medical image visualization that are primarily based on 2D flat screen, the "true 3D display" we proposed herein possesses a physical 3D display volume, and places each 3D "voxel" in the displayed 3D images at the true 3D (x, y, z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of viewers. The true 3D display technology provides both physiological and psychological depth cues to human visual system to perceive 3D objects and is considered as the Holy Grail solution to true 3D visualization of medical image, and many other display problems. Xigen LLC has recently made a technology breakthrough and developed a revolutionary concept of the "hybrid multiview/volumetric (HyMV)" 3D display that is able to provide true 3D displaying capability in both the volumetric display mode and the multiview 3D display mode, simultaneously overlaying on each other, or displayed in separate modes as controlled by uses. The volumetric 3D images provide true 3D measurement of and spatial relationship among the displayed 3D objects, while the multiview 3D images provide photo-quality textured surface properties of the displayed 3D objects. By seamlessly integrating these two 3D display modes into a single 3D display system, the proposed HyMV technology offers an unprecedented true 3D display capability never available before: a volumetric 3D display capable of showing both true 3D positions of voxels, as well as various surface properties (occlusion, shining, reflection, shadow, etc) that are essential to many high image quality medical visualization applications. We propose this SBIR effort to perform thorough investigation of the proposed novel concept, carry out design and tradeoffs, build a functional prototype, and assess its technical efficacy for image-guided radiaotion intervention for cancer treatment. Proprietary Information of XIGEN LLC. 0 NIH SBIR PA 07-042 PUBLIC HEALTH RELEVANCE: The primary objective of this Phase I SBIR effort is to demonstrate the feasibility of a novel volumetric 3D display concept with the unprecedented hybrid volumetric/Multiplan 3D display capability. We plan to build and test a functional prototype, focusing our effort in demonstrating several key capabilities of this breakthrough innovation. We now summarize unique advantages of the proposed HyMV 3D display system: - For the first time, achieve coherent volumetric and multiview 3D display in single system; - Preserve 3D spatial voxels and 3D measurement capability while producing photo-quality 3D images with realistic surface properties (shining, shadow, occlusion, etc); - Offer volumetric mode, multiview mode and simultaneous multiview/volumetric mode in 3D display, suited for various visualization and 3D measurement applications; - High spatial resolution, full color display is easy to implement using the latest DMD devices. - No special viewing glasses or any special eyewear is needed to view the 3D images; - Simple and elegant system structure design. The major innovations of this SBIR effort include: - Novel concept to seamlessly integrate multiview and volumetric displays in single system; - Novel design of hybrid rotating screen, accommodating both display modes; - Compact and portable overall system design; - Novel true 3D user interface device design allowing for interaction with displayed true 3D images; - Integrated true 3D volumetric/multiview display hardware/software tailored for IGRI applications. The follow-on Phase 2 program will afford us to perform clinical study on the interventional efficacy and clinical outcomes of the technology applications. The Phase 3 program will carry out productization and commercialization of the unique true 3D display product. Beyond the image-guided radiotherapy intervention, applications of true 3D display technology are enormous, including various areas of medical imaging (e.g., image guided therapy, clinical diagnosis, procedure training, simulation, pre-treatment planning, and clinical hypothesis validation), military (e.g. air traffic control, pilot training, battlefield visualization, telemedicine) and commercial (e.g., 3D TV, virtual reality, advertizing, computer aided design, scientific computing, video games, stadium displays, etc.) The 3D display will provide a new level of realism and literally add a new dimension to information display tool set we now have. Proprietary Information of XIGEN LLC. 1 NIH SBIR PA 07-042