Novel human computer interaction methods and algorithms for medical applications

点击翻译按钮获取中文摘要

***Efficient and effective human-computer interaction is essential for real-time medical applications. My program of research is to develop image processing algorithms and human computer interaction (HCI) techniques, with the long-term applied goal of expanding the role of smartphones into mobile healthcare applications. In the short-term, I will perform research in two distinct, complementary research areas: image analysis algorithms and eye tracking. Two important medical areas will provide context and data for this fundamental research: dermatology (skin) image analysis, and laparoscopic (keyhole) surgery training. With wearable eye trackers and augmented reality displays integrated into smartphones, these research areas will merge, by developing eye tracking and pupil responses as novel interaction controls for smartphone apps.****Image Analysis: Mole images acquired with a magnifying dermoscope attached to a smartphone camera can show several textural features just below the skin surface, not visible to the naked eye. Sophisticated dermoscopy image analysis algorithms will be developed and extended for application in a mole imaging smartphone app, to provide detailed quantitative analysis about these textural features. Image registration algorithms will be developed to identify changes in skin lesions over time. Interactive functions will be investigated to allow users to identify where the image is taken on the body and to monitor changes over time.****Eyegaze tracking: In laparoscopic surgery training, the surgeon looks at the surgery scene through a remote monitor display, and computer simulators are often used to teach novices expert strategies for eye-hand coordination. Eyegaze responses can differentiate novices and experts in surgery training, and I plan to develop new training methods based on so-called "gaze training", which encourages novices to adapt the eyegaze strategies of experts during eye-hand coordination tasks. Surgery training simulators will be developed for smartphones enhanced with eye tracking and hand motion sensors, employing novel interaction methods based on eyegaze glances, blinks and fixations. Furthermore, pupil responses, which provide insights into the physiological state of the user, can be used to monitor the state of the user while performing surgery simulations.****This research will advance and merge the fields of image analysis and human computer interaction.**** **