Novel Full-Color High Frame Rate 3D Projector for Multiview 3D Displays

描述（由申请人提供）：我们周围的物理世界是三维的（3D），然而大多数现有的显示系统只能处理缺乏三维（深度）信息的二维（2D）图像。这一基本限制极大地限制了人类感知和理解现实世界对象和高维数据的复杂性的能力。在生物医学研究中使用真正的3D显示器将导致高维细胞结构、分子、基因组医学和图像数据的高效、有效和准确的可视化和交互。将真正的3D显示应用于临床，如图像引导放射治疗（IGRT），可以消除诊断、计划和干预过程中的方向性偏差。3D应用的其他例子包括眼科、内窥镜、生物分析、显微镜和机器人手术。真正的3D显示技术有三类，即多视图、体积和计算机生成全息图（CGH）显示。这个SBIR项目涉及多视图3D显示。开发了许多多视图3D显示系统，但都使用多投影仪。这些系统可以产生令人印象深刻的视觉效果，但由于多个（多达256个）投影仪的成本，它们非常昂贵。Xigen团队采用了一种全新的方法来设计多视图3D显示。我们不再依赖于多台投影机，而是利用单台投影机和智能的光机械扫描机制来产生多个虚拟投影机，从而产生多视图。这种革命性的单投影仪多视图（SPM）技术有望将3D显示的成本和复杂性降低到与现有2D显示相当的水平。在SPM的设计和实现中存在许多技术挑战。我们无法在一个SBIR项目中解决所有的技术问题。相反，在本SBIR中，我们将重点关注SPM显示的关键技术挑战，即高帧率（HFR）图像投影仪。为了实现高度的3D保真度，需要大量的视图，这就需要HFR。例如，在标准的24Hz 3D图像刷新率下，连续的128视图3D显示将需要128x24= 3072 Hz的灰度（8位）图像。据我们所知，没有一个投影仪存在，可以实现这样的高分辨率，不惜任何代价。因此，本文提出的SBIR的主要目标是开发新的HFR投影机技术，以促进全彩HFR多视图3D显示。第一阶段的具体目标是：目标1：设计并测试单色高帧频（HFR）投影仪1.1。设计强度滤波轮（IFW），探索LIM的电子控制技术。1.2. 同步LIM与DLP的时序产生8位灰度图像。目标2：设计一个全彩色（24位）HFR投影仪2.1。选择光源。2.2. 设计TIR棱镜和投影光学元件。2.3. 将三芯片dlp集成到组装、对准等方面。目标3：构建HFR全彩投影仪3.1的原型。HFR投影仪集成。3.2. 对原型进行测试和评估。目标4：将HFR投影机集成到多视图3D显示测试平台中进行评估4.1。将HFR投影仪集成到Xigen提供的多视图3D显示测试平台中。对3D显示的临床应用进行初步评估，制定二期计划。HFR投影机是一种平台技术，可以使其他类型的3D显示受益：体积和全息3D显示都需要HFR投影机来实现高分辨率全彩3D显示。因此，这个SBIR的成功将显著推进整个真正3D显示领域的最新技术。真正的3D显示是一个全新的技术平台，促进了生物医学研究和临床应用中广泛的3D/4D可视化应用。凭借该SBIR提出的高性能（24位全彩，帧率超过3,072Hz）和低成本解决方案，真正的3D显示技术可以作为一种可行的工具，提供新的真实感水平，并为生物医学研究和临床实践的可视化工具增加一个新的维度（从表面上和象征意义上）。它对医疗保健实践的各个方面都有广泛的影响，包括3D/4D图像可视化、图像引导干预、远程医疗、手术回放、显微镜/内窥镜可视化、教育、培训等。

DESCRIPTION (provided by applicant): The physical world around us is three-dimensional (3D), yet most existing display systems can handle only two-dimensional (2D) images that lack the third dimension (depth) information. This fundamental restriction greatly limits human being's capability of perceiving and understanding the complexity of real world objects and high dimensional data. Uses of true 3D displays in biomedical research would lead to efficient, effective and accurate visualization and interaction on high dimensional cell structure, molecular, genomic medicine, and image data. Uses of true 3D display to clinical applications, such as image guided radiation therapy (IGRT), could eliminate the directional bias during the diagnosis, planning and interventions. Other examples of 3D applications include ophthalmology, endoscopy, bio-analysis, microscopy, & robotic surgeries. There are three classes of true 3D display technologies, namely multiview, volumetric, and computer generated hologram (CGH) displays. This SBIR project deals with multiview 3D display. Many multiview 3D display systems were developed, but all uses multi projectors. These systems could produce impressive visual results, BUT they are very expensive due to costs of multiple (up to 256) projectors. Xigen team takes an entirely new approach to the multiview 3D display design. Instead of relying on multiple projectors, we use single projector and clever opto-mechanical scanning mechanism to produce multiple virtual projectors for generating multiviews. This revolutionary single projector multiview (SPM) technique promises to reduce cost and complexity of a 3D display to a level comparable with that of existing 2D display. There are many technical challenges in the SPM design and implementation. We are not able to address all the technical issues in a single SBIR project. Instead, in this SBIR, we will focus on a criticl technical challenge for the SPM display, namely the high-frame-rate (HFR) image projector. To achieve high degree of 3D fidelity, large number of views is needed, requiring HFR. For example, at a standard 24Hz of 3D image refreshing rate, a sequential 128-view 3D display would need 128x24=3,072 Hz grey-scale (8-bit) images. To the best of our knowledge, no single projector exists that can achieve such a HFR, at any cost. Therefore, the primary objective of this SBIR proposed herein is to develop the novel HFR projector technology to facilitate the full color HFR multiview 3D display. Phase 1 specific aims are: Aim 1: Design and test a single color high frame rage (HFR) projector 1.1. Design intensity filter wheel (IFW) and explore electronic control technique for LIM. 1.2. Synchronize LIM with DLP's timing to produce 8-bit grey scale image. Aim 2: Design a full-color (24-bit) HFR projector 2.1. Select light source. 2.2. Design the TIR prism and projection optics. 2.3. Integrate three-chip DLPs into the assembly, alignment etc. Aim 3: Build a prototype of the HFR full-color projector 3.1. HFR projector integration. 3.2. Perform tests and evaluations on the prototype. Aim 4: Integrate HFR projector into a multiview 3D display testbed for evaluation 4.1. Integrate the HFR projector into a multiview 3D display testbed available at Xigen. 4.2. Preliminary evaluation of 3D display for clinical applications, prepare Phase 2 plan. HFR projector is a platform technology that can benefit other types of 3D displays as well: both volumetric and holographic 3D display requires HFR projector to achieve high resolution full color 3D display. Thus the success of this SBIR would significantly advance the state-of-the-art of the entire true 3D display field. The true 3D display is a fundamentally new technology platform that facilitates a broad range 3D/4D visualization applications in biomedical research and clinical applications. With the high performance (24-bit full-color with over 3,072Hz frame rate) and low-cost solution proposed in this SBIR, the true 3D display technology could serve as a viable tools to provide a new level of realism and add a new dimension (literally and figuratively) to the visualization tool available for biomedical research and clinical practices. It has broad impact on various aspects of healthcare practices, ranging from 3D/4D image visualization, image guided intervention, telemedicine, surgical replays, microscope/endoscope visualization, education, training, etc.