Using smartphone-delivered stereoscopic vision in microsurgery: a feasibility study
Using smartphone-delivered stereoscopic vision in microsurgery: a feasibility study
复制标题
在显微外科手术中使用智能手机提供的立体视觉：可行性研究
作者：
D. Ho
背景许多外科专业越来越多地寻求机器人辅助手术，以改善病人的结果。进行机器人辅助手术的外科医生需要实时手术视图。眼科机器人可以带来新的玻璃体视网膜治疗，例如视网膜血管插管，甚至将基因递送到靶向视网膜细胞。本研究探讨了智能手机提供的立体视觉显微surgical use.MethodsA立体相机，连接到笔记本电脑，被用来捕捉从双目手术显微镜的3D视图的可行性。Wi-Fi连接用于将笔记本电脑显示器无线直播到智能手机屏幕上。最后，一个虚拟现实（VR）耳机，它作为一个立体镜，被用来容纳智能手机。耳机佩戴者，然后融合这些图像，以实现立体perception.ResultsUsing智能手机提供的3D视觉，作者成功地进行了模拟白内障摘除手术，尽管时间延迟为0.354 s ± 0.038。据作者所知，这是第一个模拟眼科手术通过智能手机提供的立体vision.ConclusionsMicroscopic输出在3D与最小的时间延迟可以很容易地实现与智能手机和VR耳机。将外科医生与手术显微镜分离是实现远程存在所必需的，这是远程机器人技术的重要步骤。在手术室空间受到关注的情况下，头戴式显示器可能比3D电视更方便。这种3D直播技术可用于教学和指导环境，显微手术可以通过本地Wi-Fi网络立体地实时传输到智能手机上。当连接到互联网时，显微手术可以现场直播，世界各地的观众可以看到外科医生戴着VR头盔的视图。
BackgroundMany surgical specialties are increasingly looking towards robot-assisted surgeries to improve patient outcome. Surgeons conducting robot-assisted operations require real-time surgical view. Ophthalmic robots can lead to novel vitreoretinal treatments, such as cannulating retinal vessels or even gene delivery to targeted retinal cells. This study investigates the feasibility of smartphone-delivered stereoscopic vision for microsurgical use.MethodsA stereo-camera, connected to a laptop, was used to capture the 3D view from a binocular surgical microscope. Wi-Fi connection was used to live-stream the laptop display onto the smartphone screen wirelessly. Finally, a Virtual Reality (VR) headset, which acts as a stereoscope, was used to house the smartphone. The headset wearer then fused these images to achieve stereoscopic perception.ResultsUsing smartphone-delivered 3D vision, the author performed a simulated cataract extraction operation successfully, despite a time lag of 0.354 s ± 0.038. To the author’s knowledge, this is the first simulated ophthalmic operation performed via smartphone-delivered stereoscopic vision.ConclusionsMicroscopic output in 3D with minimal time lag can be readily achievable with smartphones and VR headsets. Uncoupling the surgeon from the operating microscope is required to achieve tele-presence, an essential step in tele-robotics. Where operating theatre space is a concern, head-mounted displays may be more convenient than 3D televisions. This 3D live-casting technique can be used in teaching and mentoring settings, where microsurgeries can be live-streamed stereoscopically onto smartphones via local Wi-Fi network. When connected to the internet, microsurgeries can be broadcasted live and viewers worldwide can see the surgeon’s view wearing their VR headsets.