Development of an augmented reality recontrolled robot for medical applications

近年来，增强现实(AR)和机器人辅助手术(RAS)在外科手术的临床进步中发挥了关键作用。RAS系统，如达芬奇外科系统，在改善手术复杂的运动和效率方面取得了巨大成功，同时还进行了基于无痛麻醉的手术。另一方面，AR提供了通过图形用户界面显示手术图像的能力。AR技术已被证明在各种外科手术中取得了成功，早期结果显示，情况感知和视觉偏差得到了改善。为了提高灵活性和图像清晰度，开展按需激活等功能的研究势在必行。虽然关于上述概念的工作仍在进行中，但它将被证明是世界各地临床医生的无价资产。在这项研究计划中，我们的目标是(I)检讨RAS中AR技术的最新水平，以及市面上可供AR准备的外科系统的潜在发展，以及(Ii)与一些本地医院和机械工程行业合作，制作和测试AR技术的原型，以协助外科医生进行详细的外科手术。

Augmented reality (AR) and robotic-assisted surgery (RAS) have played a pivotal role in clinical advancement of surgeries in recent years. RAS systems such as the DaVinci Surgical System have achieved great success in improving surgical intricacy of motion and efficiency, in parallel with painless anaesthetic-based procedures. AR, on the other hand, provides the ability to display surgery imagery via a graphic user interface. The AR technology has proved successful for various surgical procedures and early results show improved situation awareness and visual deviation. It is imperative to carry out research on features such as activation on demand to improve dexterity and image clarity. Although work is still active on the above concepts, it shall prove to be an invaluable asset to clinicians worldwide. In this research project, we aim to (i) review the state-of-the-art of AR technology in RAS and the potential developments on AR-ready surgical systems available on the market, and (ii) work with some local hospitals as well as mechanical engineering industries to prototype and test an AR technology which can help surgeons in executing detailed surgical operations.