Advanced Endoscopic Display Technology

描述（由申请人提供）：内窥镜可视化对于微创手术（MIS）程序和各种临床诊断至关重要。然而，当前内窥镜成像技术对于某些程序和应用的已知限制是有限的视场。为了更好地理解手术区域，非常希望能够进行解剖学观察，在某些手术中这一点至关重要。在以前的NIH支持下，InterScience，Inc.已经开发了一种“C-View”内窥镜系统，其能够将大于半球（3 °立体角）的视场捕获到单个2D图像平面上。然而，因为该内窥镜系统将非常宽的3D视场传递到单个2D图像平面，所以当在传统2D显示器上显示时，全景视场中的对象遭受固有的桶形失真。该SBIR努力的目标是开发兼容的显示技术，该显示技术可以将由这种内窥镜收集的全景图像呈现给临床医生。在第一阶段的努力下，为实现这一目标采取了两种办法。一种是通过基于创新光学系统的投影，在半球形以上的3D屏幕上光学再现兼容的全景图像。第二种方法是在头戴式2D显示器中显示全景图像的一小部分，并且可以通过跟踪头部运动来显示具有不同视角的不同部分。通过将宽视场内窥镜和拟议的沉浸式显示系统相结合，它将允许临床医生在沉浸式虚拟现实环境中准确地定位内窥镜。这样的内窥镜成像和显示系统将极大地有益于临床诊断和MIS。在第一阶段的工作中，我们已经成功地开发了概念和设计，并展示了初步的台式投影系统。第二阶段的工作将集中在两个拟议的沉浸式显示技术的临床应用的先进开发，实施和测试。具体的第二阶段重点是优化光学设计，开发兼容的软件，用集成的软件制造两种不同的原型，以及与临床医生合作进行相应的实验测试和评估。拟议的增强型内窥镜显示技术将为微创手术（MIS）的所有应用提供增强的可视化和沉浸式显示机会包括机器人手术应用。开发工作集中在标准显示器和头戴式显示器配置上。

DESCRIPTION (provided by applicant): Endoscopic visualization is of primary importance for minimally invasive surgery (MIS) procedures and various clinical diagnoses. However, a known limitation of current endoscopic imaging technology for some procedures and applications is the limited field of view. For better comprehension of the operating field, it is highly desirable and in some procedures critically important, to be able to view panoramically. Under previous NIH support, InterScience, Inc. has developed a "C-View" endoscope system which is able to capture a field of view larger than a hemisphere (3@ steradian solid angle) onto a single 2D image plane. However, because this endoscopic system delivers a very wide 3D field of view to a single 2D image plane, objects in the panoramic field of view suffer from the inherent barrel distortion when displayed on a traditional 2D display. The objective of this SBIR effort is to develop compatible display technologies that can present the panoramic image collected by such an endoscope to the clinician. Under the Phase I effort, two approaches have been pursued to achieve this. One is to optically recreate compatible panoramic images on a more than hemispherical 3D screen by the projection based on an innovative optical system. The second approach is to display a small portion of the panoramic image in a head-mounted 2D display, and the different portion with different angle of view can be displayed by tracking the head motion. With a combination of a wide-field-of-view endoscope and the proposed immersive display system, it will allow clinicians to situate in an immersive virtual reality environment as exactly what the endoscope locates. Clinical diagnoses and MIS will greatly benefit from such an endoscopic imaging and displaying system. During the Phase I effort, we have successfully developed the concepts and designs, and demonstrated a preliminary bench top projection system. This Phase II effort will focus on the advanced developments, implementations and tests of the two proposed immersive display technologies for clinical applications. The specific Phase II emphasis is to optimize the optical designs, develop compatible software, fabricate the two different prototypes with software integrated, as well as conduct corresponding experimental tests and evaluations in collaboration with medical clinicians PUBLIC HEALTH RELEVANCE: The proposed enhanced endoscopic display technology will provide enhanced visualization and immersive display opportunities for all applications of minimally invasive surgery (MIS) including robotic surgery applications. The development effort is concentrated on a standard display and a head mounted display configuration.