Multi-modat, gaze-centred, augmented reality interfaces for ultrasound machines

点击翻译按钮获取中文摘要

Medical ultrasound is a widely used imaging modality because it is accessible, real-time, and has no harmful effects on patients. Many procedures such as needle biopsies are guided by medical ultrasound. These procedures often require two hands to perform.We propose to use eye gaze tracking using cameras pointed at the operator's eyes in order to remove the need for using one's hands during machine operation. With eye gaze tracking, we can determine where the operator looks and this can, in turn, be used to control the machine settings in a natural manner.In order to accurately track the eyes and work in a 3D display environment, we will first utilize a medical robot system that has a 3D stereo console. An interface to ultrasound machines used with medical robots will be designed and implemented. We will use the design experience gained with the medical robot system to design a second interface with a flat panel display that will work with any ultrasound machine, where eye gaze tracking is more challenging. We will make use of this second interface to project "augmented reality" images acquired from the same patient before the ultrasound examination. We will evaluate our results in controlled experiments. Throughout the project, we will work with local Canadian companies to design, implement and test these techniques. The result will be an entirely new type of interface that will revolutionize ultrasound machine use, new intellectual property, and new product avenues for our Canadian partners.