Perspective correction for interactive projection during surgery

点击翻译按钮获取中文摘要

Surgeons need better computer interfaces to interact with medical images during surgery. To navigate through a set of medical images and manipulate them (zoom, pan, scroll, etc.), surgeons are currently constrained to use a traditional mouse and keyboard in the control room just outside the sterile surgical field. In each interaction with these unsterile devices, the surgeon has to either (1) "scrub out" to enter the control room and "scrub back in" afterwards or (2) verbally instruct a technologist to operate the workstation. Scrubbing in and out of the sterile field is time-consuming and involves contamination risks and issuing instructions to an assistant removes direct control from the surgeon. NZ Technologies Inc. (NZTech) has been developing a novel medical device, called 'Touchless Interaction with Picture and Archiving Communication Systems (PACS) in Sterile Operations' (TIPSO). TIPSO employs real-time optical 3D sensing of the environment to enable surgeons to manipulate the images by using hand gestures and motions in a fully sterile manner - directly from the OR. An adaptive light projection module enables surgeons to intuitively interact with a 'virtual tactile' menu that is projected over the surgery bed. It is enhanced with a visual feedback mechanism such that the surgeon receives intuitive confirmation of these manipulation actions. This grant aims to develop a new homographic correction model for pre-adjusting the projected graphic contents in such a way that they appears undistorted from the perspective of the surgeon. This model will compensate for deformations and irregularities on the projection surface. The technology developed as a result of this project mitigates the possibility of infection and avoids delays in therapeutic plan formulation, thereby improving patient safety and decreasing healthcare costs and related complications. This solution facilitates a more intuitive and efficient image manipulation workflow in a surgery environment, while also becoming an important stepping stone in refining the existing human-machine interaction paradigms that form the forefront of machine vision research today.