Novel human computer interaction methods and algorithms for medical applications

高效的人机交互对于实时医疗应用是至关重要的。我的研究计划是开发图像处理算法和人机交互(HCI)技术，长期的应用目标是将智能手机的作用扩展到移动医疗应用中。在短期内，我将在两个截然不同、相辅相成的研究领域进行研究：图像分析算法和眼睛跟踪。两个重要的医学领域将为这项基础研究提供背景和数据：皮肤科(皮肤)图像分析和腹腔镜(锁孔)手术培训。随着可穿戴眼球跟踪器和增强现实显示屏集成到智能手机中，这些研究领域将合并，开发眼球跟踪和瞳孔反应作为智能手机应用程序的新型交互控制。 图像分析：用智能手机摄像头上的皮肤镜放大镜获取的黑痣图像可以显示出几个肉眼看不到的皮肤表面下的纹理特征。复杂的皮肤镜图像分析算法将被开发并扩展到鼹鼠成像智能手机应用程序中，以提供对这些纹理特征的详细定量分析。图像配准算法将被开发来识别随着时间的推移皮肤病变的变化。将研究互动功能，使用户能够识别图像在身体上的位置，并监控随着时间的推移而发生的变化。 眼睛跟踪：在腹腔镜手术培训中，外科医生通过远程监视器显示器查看手术场景，计算机模拟器经常用于向新手传授眼手协调的专家策略。在手术训练中，眼神反应可以区分新手和专家，我计划在所谓的“凝视训练”的基础上开发新的训练方法，鼓励新手在眼手协调任务中适应专家的眼神策略。手术训练模拟器将为智能手机开发，增强了眼睛跟踪和手部运动传感器，采用基于眼神扫视、眨眼和注视的新颖交互方法。此外，提供对用户的生理状态的洞察的瞳孔响应可用于在执行手术模拟时监视用户的状态。 这项研究将推进和融合图像分析和人机交互领域。

Efficient and effective human-computer interaction is essential for real-time medical applications. My program of research is to develop image processing algorithms and human computer interaction (HCI) techniques, with the long-term applied goal of expanding the role of smartphones into mobile healthcare applications. In the short-term, I will perform research in two distinct, complementary research areas: image analysis algorithms and eye tracking. Two important medical areas will provide context and data for this fundamental research: dermatology (skin) image analysis, and laparoscopic (keyhole) surgery training. With wearable eye trackers and augmented reality displays integrated into smartphones, these research areas will merge, by developing eye tracking and pupil responses as novel interaction controls for smartphone apps. Image Analysis: Mole images acquired with a magnifying dermoscope attached to a smartphone camera can show several textural features just below the skin surface, not visible to the naked eye. Sophisticated dermoscopy image analysis algorithms will be developed and extended for application in a mole imaging smartphone app, to provide detailed quantitative analysis about these textural features. Image registration algorithms will be developed to identify changes in skin lesions over time. Interactive functions will be investigated to allow users to identify where the image is taken on the body and to monitor changes over time. Eyegaze tracking: In laparoscopic surgery training, the surgeon looks at the surgery scene through a remote monitor display, and computer simulators are often used to teach novices expert strategies for eye-hand coordination. Eyegaze responses can differentiate novices and experts in surgery training, and I plan to develop new training methods based on so-called “gaze training”, which encourages novices to adapt the eyegaze strategies of experts during eye-hand coordination tasks. Surgery training simulators will be developed for smartphones enhanced with eye tracking and hand motion sensors, employing novel interaction methods based on eyegaze glances, blinks and fixations. Furthermore, pupil responses, which provide insights into the physiological state of the user, can be used to monitor the state of the user while performing surgery simulations. This research will advance and merge the fields of image analysis and human computer interaction.