Free Viewpoint Video System for MIS Training

点击翻译按钮获取中文摘要

The proposed research project aims at developing a Hapto-Audio-Visual Environment (HAVE) to optimize medical training experience, especially as it pertains to Minimally Invasive Surgical (MIS) procedures. Presently, MIS training is a long and expensive process, especially at its earliest stage because one must minimize the risks to the patient which arise from mistakes due to the poor fine-motor coordination of trainees. These issues are compounded by the fact that time in the operating room is at a premium, and junior and senior residents negotiate with each other for the opportunity to learn and perfect these difficult surgical procedures. The main goal of this project is to create a collaborative training environment in which residents can learn surgery, remotely and in real-time, from real operations performed by training surgeons. By recording every delicate move as well as voice intonations and visuals of a well-trained surgical team during a procedure, it is possible for junior residents to be trained by remote experts in real-time over a high-speed network, or after-the-fact in playback mode through a multi-modal interface capable of replicating those moves through an ambidextrous playback station and free viewpoint stereo display system. In order to reach this goal, we are planning to build a new OR-compatible multi-camera system that will allow us to digitize a scene and then play back the procedure from an arbitrary viewpoint using a disparity-based view interpolation technique.