Novel Full-Color High Frame Rate 3D Projector for Multiview 3D Displays

用于多视图 3D 显示的新型全彩高帧率 3D 投影仪

• 批准号: 8704935
• 负责人: Jason Geng
• 金额: $ 14.9万
• 依托单位: XIGEN, LLC
• 依托单位国家: 美国
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-09-01 至 2015-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8704935
• 关键词: 4D Imaging; Address; Advertising; Automobile Driving; Biomedical Research; Categories; Cellular Structures; Clinical; Color; Computer software; Data; Development; Devices; Diagnosis; Dimensions; Electronics; Endoscopes; Endoscopy; Evaluation; Feedback; Funding; Future; Generations; Genomics; Government; Grant; Gray unit of radiation dose; Healthcare; Hospitals; Human; Human body; Image; Imagery; Intervention; Lasers; Lead; Life; Light; Magnetic Resonance Imaging; Maintenance; Marketing; Mechanics; Medical; Medical Imaging; Medicine; Microscope; Microscopy; Military Personnel; Molecular; Monitor; Nature; Operative Surgical Procedures; Ophthalmology; Optics; Organ; Outcome Assessment; Ownership; Performance; Phase; Play; Positron-Emission Tomography; Process; Production; Qualifying; Rage; Resolution; Robotics; Role; Scanning; Scheme; Shapes; Small Business Innovation Research Grant; Solutions; Source; Speed; Sports; Spottings; System; Techniques; Technology; Telemedicine; Testing; Three-Dimensional Image; Time; Training and Education; Validation; Visual; Work; base; clinical application; clinical practice; commercialization; computer generated; cost; cost effective; design; digital; evaluation/testing; experience; image guided intervention; image guided radiation therapy; image visualization; imaging modality; improved; interest; light intensity; meetings; new technology; novel; novel strategies; product development; prototype; success; tool; treatment planning; two-dimensional; virtual

DESCRIPTION (provided by applicant): The physical world around us is three-dimensional (3D), yet most existing display systems can handle only two-dimensional (2D) images that lack the third dimension (depth) information. This fundamental restriction greatly limits human being's capability of perceiving and understanding the complexity of real world objects and high dimensional data. Uses of true 3D displays in biomedical research would lead to efficient, effective and accurate visualization and interaction on high dimensional cell structure, molecular, genomic medicine, and image data. Uses of true 3D display to clinical applications, such as image guided radiation therapy (IGRT), could eliminate the directional bias during the diagnosis, planning and interventions. Other examples of 3D applications include ophthalmology, endoscopy, bio-analysis, microscopy, & robotic surgeries. There are three classes of true 3D display technologies, namely multiview, volumetric, and computer generated hologram (CGH) displays. This SBIR project deals with multiview 3D display. Many multiview 3D display systems were developed, but all uses multi projectors. These systems could produce impressive visual results, BUT they are very expensive due to costs of multiple (up to 256) projectors. Xigen team takes an entirely new approach to the multiview 3D display design. Instead of relying on multiple projectors, we use single projector and clever opto-mechanical scanning mechanism to produce multiple virtual projectors for generating multiviews. This revolutionary single projector multiview (SPM) technique promises to reduce cost and complexity of a 3D display to a level comparable with that of existing 2D display. There are many technical challenges in the SPM design and implementation. We are not able to address all the technical issues in a single SBIR project. Instead, in this SBIR, we will focus on a criticl technical challenge for the SPM display, namely the high-frame-rate (HFR) image projector. To achieve high degree of 3D fidelity, large number of views is needed, requiring HFR. For example, at a standard 24Hz of 3D image refreshing rate, a sequential 128-view 3D display would need 128x24=3,072 Hz grey-scale (8-bit) images. To the best of our knowledge, no single projector exists that can achieve such a HFR, at any cost. Therefore, the primary objective of this SBIR proposed herein is to develop the novel HFR projector technology to facilitate the full color HFR multiview 3D display. Phase 1 specific aims are: Aim 1: Design and test a single color high frame rage (HFR) projector 1.1. Design intensity filter wheel (IFW) and explore electronic control technique for LIM. 1.2. Synchronize LIM with DLP's timing to produce 8-bit grey scale image. Aim 2: Design a full-color (24-bit) HFR projector 2.1. Select light source. 2.2. Design the TIR prism and projection optics. 2.3. Integrate three-chip DLPs into the assembly, alignment etc. Aim 3: Build a prototype of the HFR full-color projector 3.1. HFR projector integration. 3.2. Perform tests and evaluations on the prototype. Aim 4: Integrate HFR projector into a multiview 3D display testbed for evaluation 4.1. Integrate the HFR projector into a multiview 3D display testbed available at Xigen. 4.2. Preliminary evaluation of 3D display for clinical applications, prepare Phase 2 plan. HFR projector is a platform technology that can benefit other types of 3D displays as well: both volumetric and holographic 3D display requires HFR projector to achieve high resolution full color 3D display. Thus the success of this SBIR would significantly advance the state-of-the-art of the entire true 3D display field. The true 3D display is a fundamentally new technology platform that facilitates a broad range 3D/4D visualization applications in biomedical research and clinical applications. With the high performance (24-bit full-color with over 3,072Hz frame rate) and low-cost solution proposed in this SBIR, the true 3D display technology could serve as a viable tools to provide a new level of realism and add a new dimension (literally and figuratively) to the visualization tool available for biomedical research and clinical practices. It has broad impact on various aspects of healthcare practices, ranging from 3D/4D image visualization, image guided intervention, telemedicine, surgical replays, microscope/endoscope visualization, education, training, etc.

描述（由申请人提供）：我们周围的物理世界是三维（3D）的，但大多数现有显示系统只能处理缺乏三维（深度）信息的二维（2D）图像。这种根本性的限制极大地限制了人类感知和理解现实世界对象和高维数据的复杂性的能力。 在生物医学研究中使用真正的 3D 显示器将实现高维细胞结构、分子、基因组医学和图像数据的高效、有效和准确的可视化和交互。将真正的 3D 显示应用于临床应用，例如图像引导放射治疗 (IGRT)，可以消除诊断、计划和干预期间的方向偏差。 3D 应用的其他示例包括眼科、内窥镜检查、生物分析、显微镜和机器人手术。 真正的 3D 显示技术分为三类，即多视图、体积和计算机生成全息图 (CGH) 显示。该 SBIR 项目涉及多视图 3D 显示。许多多视图 3D 显示系统被开发出来，但都使用多投影仪。这些系统可以产生令人印象深刻的视觉效果，但由于多台（最多 256 台）投影仪的成本，它们非常昂贵。 Xigen 团队采用了全新的多视图 3D 显示设计方法。我们不依赖多个投影仪，而是使用单个投影仪和巧妙的光机扫描机制来生成多个虚拟投影仪来生成多视图。这种革命性的单投影机多视图 (SPM) 技术有望将 3D 显示器的成本和复杂性降低到与现有 2D 显示器相当的水平。 SPM的设计和实现存在许多技术挑战。我们无法解决单个 SBIR 项目中的所有技术问题。相反，在本次 SBIR 中，我们将重点关注 SPM 显示器的关键技术挑战，即高帧率 (HFR) 图像投影仪。为了实现高度的 3D 保真度，需要大量视图，这就需要 HFR。例如，在标准 24Hz 3D 图像刷新率下，连续 128 视图 3D 显示器将需要 128x24=3,072 Hz 灰度（8 位）图像。据我们所知，目前还没有任何一台投影机能够不惜任何代价实现如此高的频率。因此，本文提出的 SBIR 的主要目标是开发新颖的 HFR 投影仪技术，以促进全彩 HFR 多视图 3D 显示。第一阶段的具体目标是： 目标 1：设计和测试单色高帧频 (HFR) 投影仪 1.1。设计强度滤光轮（IFW）并探索LIM电子控制技术。 1.2.将 LIM 与 DLP 时序同步以生成 8 位灰度图像。 目标 2：设计全彩（24 位）HFR 投影仪 2.1。选择光源。 2.2.设计 TIR 棱镜和投影光学器件。 2.3.将三芯片 DLP 集成到组装、对准等中。目标 3：构建 HFR 全彩投影仪 3.1 的原型。 HFR 投影仪集成。 3.2.对原型进行测试和评估。 目标 4：将 HFR 投影仪集成到多视图 3D 显示测试台中以进行评估 4.1。将 HFR 投影仪集成到 Xigen 提供的多视图 3D 显示测试台中。 4.2.初步评估3D显示的临床应用，制定二期计划。 HFR 投影仪是一种平台技术，也可以使其他类型的 3D 显示器受益：体积和全息 3D 显示都需要 HFR 投影仪来实现高分辨率全彩 3D 显示。因此，该 SBIR 的成功将显着推进整个真 3D 显示领域的最先进技术。 真正的 3D 显示是一个全新的技术平台，可促进生物医学研究和临床应用中广泛的 3D/4D 可视化应用。凭借本 SBIR 中提出的高性能（24 位全彩，帧速率超过 3,072Hz）和低成本解决方案，真正的 3D 显示技术可以作为一种可行的工具，提供新水平的真实感，并为可用于生物医学研究和临床实践的可视化工具添加新维度（字面上和比喻上）。它对医疗保健实践的各个方面产生了广泛的影响，包括 3D/4D 图像可视化、图像引导干预、远程医疗、手术回放、显微镜/内窥镜可视化、教育、培训等。