Complex Surgical Skill Acquisition Using Audio/Visuo/Haptic Interfaces

学习复杂的外科任务需要新手外科医生与专业外科医生和外科团队合作。为了高效协作，这些合作伙伴必须构建一个通用参考框架(CFR)。CFR是共享情况的表示，通过学习者和团队之间的信息交换不断更新。CFR使教师和学生能够相互理解，并在一个共同的框架内组织他们的行动。当团队合作伙伴交换信息并分享理解的迹象以开发他们的CFR时，就会发生接地过程。根据任务的不同，合作伙伴可能会使用不同的交流渠道(语音、视觉和触觉)来发展他们的CFR。这项发现基金的主要目标是探索如何通过创建最佳的CFR来使用视听触觉虚拟界面来学习复杂的手术技能。对于精细运动技能，我们将继续探索什么是你感觉是什么我感觉(WYFIWIF)的概念，对于协作技能，我们将探索如何使用代理触觉的协同虚拟环境(CVE)来学习多个参与者之间的复杂交互，如手术团队。在这两种情况下，主要的假设是，通过在CFR中结合音频-视觉-触觉感知，可以更有效和现实地提高手术技能的传授。

Learning complex surgical tasks requires that novice surgeons collaborate with expert surgeons and a surgical team. To collaborate efficiently, these partners must construct a Common Frame-of-Reference (CFR). The CFR is a representation of the shared situation, which is updated continuously by an information exchange between the learner and the team. The CFR allows the teachers and the learner to understand each other and to organize their action in a common framework. A grounding process occurs when the team partners exchange information and share signs of understanding to develop their CFR. Depending on the task, the partners may use different communication channels (voice, vision, and haptics) to develop their CFR. The main goal of this discovery grant is to explore how audio-visuo-haptic virtual interfaces can be used to learn complex surgical skills by creating an optimal CFR. For fine motor skills, we will continue the exploration of the concept of What-You-Feel-Is-What-I-Feel (WYFIWIF) and for collaborative skills we will explore how Collaborative Virtual Environment (CVE) using proxy-haptics can be used to learn complex interactions between multiple participants like a surgical team. In both cases, the main hypothesis is that by combining audio-visuo-haptic perceptions in a CFR one can improve surgical skills transfer more efficiently and realistically.