CPS: Small: Virtually Transparent Epidermal Imagery

这项研究的目的是开发一种能够将活体手术区域直接实时高清显示在患者皮肤上的网络物理系统。这个系统将给外科医生做X光检查？视觉体验，因为它们直接透过皮肤，并消除空间瓶颈和在微创手术中由腹腔镜造成的额外疤痕。方法是开发微型摄像机：不占用手术工具所需的空间，不会给患者造成额外的疤痕，并传输无线高清视频图像。虚拟视景生成系统将所有摄像机的全景视频投影到患者S身上的正确位置，并进行几何和颜色失真补偿。将研究一种外科医生-摄像机-交互系统，使外科医生能够通过手势识别和手指跟踪来控制视点。将开发通过体内/体外介质进行零延迟高清晰度无线视频传输的新技术。还将对图像视点对齐和实时失真补偿进行研究。这一结果将是微创外科领域潜在的范式转变。这项拟议的工作使数百万能够通过一个腹部切口进行的手术受益，因为它为外科医生提供了几乎透明的皮肤，他们将享受到开腔手术的所有视觉好处，而不会给患者带来所有相关风险。这项研究的目标是非常？亲身实践？并立即适用于能够激发青年、少数族裔学生和其他人对科学、医学和工程职业的兴趣的外展活动。

The objective of this research is to develop a cyber-physical system capable of displaying the in vivo surgical area directly onto patients' skin in real-time high definition. This system will give surgeons an ?x-ray? vision experience, since they see directly through the skin, and remove a spatial bottleneck and additional scarring caused by laparoscopes in minimally invasive surgery. The approach is to develop micro-cameras that: occupy no space required by surgical tools, produce no additional scarring to the patient, and transfer wireless high-definition video images. A virtual view generating system will project the panoramic videos from all cameras to the right spot on the patient?s body with geometry and color distortion compensation. A surgeon-camera-interaction system will be investigated to allow surgeons to control viewpoint with gesture recognition and finger tracking. Novel techniques will be developed for zero-latency high-definition wireless video transfer through the in vivo/ex vivo medium. Image viewpoint alignment and distortion compensation in real time will also be investigated. The results will be a potential paradigm shift in minimally invasive surgery. The proposed work benefits the millions of surgeries capable of being performed through a single incision in the abdomen by providing virtually transparent skin to surgeons who will enjoy all the visual benefits of open-cavity surgery without all the associated risks to the patient. The goals of this research are extremely ?hands-on? and immediately applicable to outreach activities that can excite youth, minority students, and others about the science, medicine a and engineering careers.