Advanced Endoscopic Display Technology

描述（由申请人提供）：内镜可视化对微创手术（MIS）程序和各种临床诊断至关重要。然而，目前内窥镜成像技术在某些程序和应用中的一个已知限制是视野有限。为了更好地理解手术领域，它是非常可取的，并且在某些程序中非常重要，能够全景地观察。在先前NIH的支持下，InterScience, Inc.开发了一种“C-View”内窥镜系统，该系统能够在单个2D图像平面上捕获比半球（3@立体角）更大的视场。然而，由于该内窥镜系统为单个2D图像平面提供了非常宽的3D视场，因此在传统2D显示器上显示全景视场中的物体时，会受到固有的桶形失真的影响。这项SBIR工作的目标是开发兼容的显示技术，可以将这种内窥镜收集的全景图像呈现给临床医生。在第一阶段的努力下，为实现这一目标采取了两种办法。一种是通过基于创新光学系统的投影，在一个半球形以上的3D屏幕上再现兼容的全景图像。第二种方法是在头戴式2D显示器中显示一小部分全景图像，通过跟踪头部运动来显示不同视角的不同部分。结合宽视场内窥镜和拟议的沉浸式显示系统，它将允许临床医生在沉浸式虚拟现实环境中定位内窥镜所处的位置。这种内窥镜成像和显示系统将使临床诊断和MIS受益匪浅。在第一阶段的努力中，我们已经成功地开发了概念和设计，并演示了初步的台式投影系统。第二阶段的工作将侧重于两种拟用于临床应用的沉浸式显示技术的先进开发、实施和测试。第二阶段的重点是优化光学设计，开发兼容软件，集成软件制作两种不同的原型，并与临床医生合作进行相应的实验测试和评估。提出的增强型内窥镜显示技术将为包括机器人手术应用在内的微创手术（MIS）的所有应用提供增强的可视化和沉浸式显示机会。开发工作集中在标准显示器和头戴式显示器配置上。

DESCRIPTION (provided by applicant): Endoscopic visualization is of primary importance for minimally invasive surgery (MIS) procedures and various clinical diagnoses. However, a known limitation of current endoscopic imaging technology for some procedures and applications is the limited field of view. For better comprehension of the operating field, it is highly desirable and in some procedures critically important, to be able to view panoramically. Under previous NIH support, InterScience, Inc. has developed a "C-View" endoscope system which is able to capture a field of view larger than a hemisphere (3@ steradian solid angle) onto a single 2D image plane. However, because this endoscopic system delivers a very wide 3D field of view to a single 2D image plane, objects in the panoramic field of view suffer from the inherent barrel distortion when displayed on a traditional 2D display. The objective of this SBIR effort is to develop compatible display technologies that can present the panoramic image collected by such an endoscope to the clinician. Under the Phase I effort, two approaches have been pursued to achieve this. One is to optically recreate compatible panoramic images on a more than hemispherical 3D screen by the projection based on an innovative optical system. The second approach is to display a small portion of the panoramic image in a head-mounted 2D display, and the different portion with different angle of view can be displayed by tracking the head motion. With a combination of a wide-field-of-view endoscope and the proposed immersive display system, it will allow clinicians to situate in an immersive virtual reality environment as exactly what the endoscope locates. Clinical diagnoses and MIS will greatly benefit from such an endoscopic imaging and displaying system. During the Phase I effort, we have successfully developed the concepts and designs, and demonstrated a preliminary bench top projection system. This Phase II effort will focus on the advanced developments, implementations and tests of the two proposed immersive display technologies for clinical applications. The specific Phase II emphasis is to optimize the optical designs, develop compatible software, fabricate the two different prototypes with software integrated, as well as conduct corresponding experimental tests and evaluations in collaboration with medical clinicians PUBLIC HEALTH RELEVANCE: The proposed enhanced endoscopic display technology will provide enhanced visualization and immersive display opportunities for all applications of minimally invasive surgery (MIS) including robotic surgery applications. The development effort is concentrated on a standard display and a head mounted display configuration.