Novel Full-Color High Frame Rate 3D Projector for Multiview 3D Displays

描述(申请人提供)：我们周围的物理世界是三维的(3D)，然而大多数现有的显示系统只能处理缺乏三维(深度)信息的二维(2D)图像。这种基本的限制极大地限制了人类感知和理解现实世界对象和高维数据的复杂性的能力。在生物医学研究中使用真3D显示将导致在高维细胞结构、分子、基因组医学和图像数据上进行高效、有效和准确的可视化和交互。将真三维显示应用于临床，如图像引导放射治疗(IGRT)，可以消除诊断、规划和干预过程中的方向性偏差。3D应用的其他例子包括眼科、内窥镜、生物分析、显微镜和机器人手术。真3D显示技术有三类，即多视点显示、体积显示和计算生成全息(CGH)显示。此SBIR项目处理多视图3D显示。开发了许多多视角3D显示系统，但都使用多个投影仪。这些系统可以产生令人印象深刻的视觉效果，但由于多台(多达256台)投影仪的成本，它们非常昂贵。西根团队采用了一种全新的方法来进行多视角3D显示设计。我们不依赖于多个投影仪，而是使用单投影仪和巧妙的光机扫描机制来生成多个虚拟投影仪来生成多视图。这种革命性的单投影仪多视角(SPM)技术承诺将3D显示器的成本和复杂性降低到与现有2D显示器相当的水平。在SPM的设计和实现中存在许多技术挑战。我们不能在一个SBIR项目中解决所有的技术问题。相反，在此SBIR中，我们将重点介绍SPM显示器的一个关键技术挑战，即高帧频(HFR)图像投影仪。要实现高度的3D保真度，需要大量的视图，这就需要HFR。例如，在标准24赫兹的3D图像刷新率下，顺序的128视点3D显示器将需要128×24=3,072赫兹灰阶(8位)图像。据我们所知，没有一台投影机可以不惜一切代价实现这样的高频辐射。因此，本文提出的SBIR的主要目标是开发新的HFR投影仪技术，以促进全彩色HFR多视角3D显示。第一阶段的具体目标是：目标1：设计和测试单色高帧范围(HFR)投影仪1.1。设计强度滤轮(IFW)，探索直线电机电控技术。1.2.使LIM与DLP的定时同步，以产生8位灰度级图像。目标2：设计一款全彩(24位)HFR投影仪2.1。选择光源。2.2.设计了TIR棱镜和投影光学系统。2.3.将三芯片DLP集成到组装、对准等中。目标3：建立HFR全彩色投影仪的原型3.1。HFR投影仪集成。3.2.对原型进行测试和评估。目标4：将HFR投影仪集成到多视角3D显示试验台中进行评估4.1。将HFR投影仪集成到西根提供的多视角3D显示试验台中。4.2.初步评估3D显示在临床中的应用，编制二期计划。HFR投影仪是一种平台技术，也可以受益于其他类型的3D显示器：体积和全息3D显示都需要HFR投影仪来实现高分辨率全彩色3D显示。因此，SBIR的成功将极大地推动整个真3D显示领域的最先进水平。True 3D Display是一个全新的技术平台，它促进了生物医学研究和临床应用中广泛的3D/4D可视化应用。凭借该SBIR中提出的高性能(24位全彩色，帧速率超过3,072 Hz)和低成本解决方案，真3D显示技术可以作为一种可行的工具，提供新的真实感水平，并为可用于生物医学研究和临床实践的可视化工具增加新的维度(字面上和形象上)。它对医疗实践的各个方面都有广泛的影响，从3D/4D图像可视化、图像引导干预、远程医疗、手术回放、显微镜/内窥镜可视化、教育、培训等。

DESCRIPTION (provided by applicant): The physical world around us is three-dimensional (3D), yet most existing display systems can handle only two-dimensional (2D) images that lack the third dimension (depth) information. This fundamental restriction greatly limits human being's capability of perceiving and understanding the complexity of real world objects and high dimensional data. Uses of true 3D displays in biomedical research would lead to efficient, effective and accurate visualization and interaction on high dimensional cell structure, molecular, genomic medicine, and image data. Uses of true 3D display to clinical applications, such as image guided radiation therapy (IGRT), could eliminate the directional bias during the diagnosis, planning and interventions. Other examples of 3D applications include ophthalmology, endoscopy, bio-analysis, microscopy, & robotic surgeries. There are three classes of true 3D display technologies, namely multiview, volumetric, and computer generated hologram (CGH) displays. This SBIR project deals with multiview 3D display. Many multiview 3D display systems were developed, but all uses multi projectors. These systems could produce impressive visual results, BUT they are very expensive due to costs of multiple (up to 256) projectors. Xigen team takes an entirely new approach to the multiview 3D display design. Instead of relying on multiple projectors, we use single projector and clever opto-mechanical scanning mechanism to produce multiple virtual projectors for generating multiviews. This revolutionary single projector multiview (SPM) technique promises to reduce cost and complexity of a 3D display to a level comparable with that of existing 2D display. There are many technical challenges in the SPM design and implementation. We are not able to address all the technical issues in a single SBIR project. Instead, in this SBIR, we will focus on a criticl technical challenge for the SPM display, namely the high-frame-rate (HFR) image projector. To achieve high degree of 3D fidelity, large number of views is needed, requiring HFR. For example, at a standard 24Hz of 3D image refreshing rate, a sequential 128-view 3D display would need 128x24=3,072 Hz grey-scale (8-bit) images. To the best of our knowledge, no single projector exists that can achieve such a HFR, at any cost. Therefore, the primary objective of this SBIR proposed herein is to develop the novel HFR projector technology to facilitate the full color HFR multiview 3D display. Phase 1 specific aims are: Aim 1: Design and test a single color high frame rage (HFR) projector 1.1. Design intensity filter wheel (IFW) and explore electronic control technique for LIM. 1.2. Synchronize LIM with DLP's timing to produce 8-bit grey scale image. Aim 2: Design a full-color (24-bit) HFR projector 2.1. Select light source. 2.2. Design the TIR prism and projection optics. 2.3. Integrate three-chip DLPs into the assembly, alignment etc. Aim 3: Build a prototype of the HFR full-color projector 3.1. HFR projector integration. 3.2. Perform tests and evaluations on the prototype. Aim 4: Integrate HFR projector into a multiview 3D display testbed for evaluation 4.1. Integrate the HFR projector into a multiview 3D display testbed available at Xigen. 4.2. Preliminary evaluation of 3D display for clinical applications, prepare Phase 2 plan. HFR projector is a platform technology that can benefit other types of 3D displays as well: both volumetric and holographic 3D display requires HFR projector to achieve high resolution full color 3D display. Thus the success of this SBIR would significantly advance the state-of-the-art of the entire true 3D display field. The true 3D display is a fundamentally new technology platform that facilitates a broad range 3D/4D visualization applications in biomedical research and clinical applications. With the high performance (24-bit full-color with over 3,072Hz frame rate) and low-cost solution proposed in this SBIR, the true 3D display technology could serve as a viable tools to provide a new level of realism and add a new dimension (literally and figuratively) to the visualization tool available for biomedical research and clinical practices. It has broad impact on various aspects of healthcare practices, ranging from 3D/4D image visualization, image guided intervention, telemedicine, surgical replays, microscope/endoscope visualization, education, training, etc.