Meaningful Assessment of Robotic Surgical Style using the Wisdom of Crowds
Meaningful Assessment of Robotic Surgical Style using the Wisdom of Crowds
复制标题
DOI：
10.1007/s11548-018-1738-2
复制
发表时间：
2018-07-01
影响因子：
3
通讯作者：
Fey, A. Majewicz
中科院分区：
文献类型：
--
作者：
Ershad, M.;Rege, R.;Fey, A. Majewicz
外科技能的定量评估是外科培训的一个重要方面；然而，建议的度量标准有时很难解释，并且可能无法捕获定义专家的风格特征。本研究提出了一种评估手术技能的方法，基于与风格形容词相关的指标，并评估了这种方法区分专业水平的能力。我们招募了来自不同专业水平的受试者在手术模拟器上执行训练任务。受全球机器人技能评估工具的启发，开发了基于机器人手术重要技能的对比形容词对词典。为了验证在外科手术技能评估中使用风格形容词的有效性，人群工作者对受试者执行任务的姿势视频以及任务视频进行了评分。通过与众包形容词分配评级的相关性，使用运动学和生理学测量发现与每个形容词相关的度量。为了评估所选指标在区分专业水平方面的能力，使用这些指标对两个分类器进行了训练和测试。所有形容词的群体分配评分与专业水平显著相关。结果表明，朴素贝叶斯分类器表现最好，在分类为四、三、两级专业知识时，准确率分别为、、、和。该方法能有效地将可理解的专业形容词与受训人员的文体运动和生理反应相关联。
Quantitative assessment of surgical skills is an important aspect of surgical training; however, the proposed metrics are sometimes difficult to interpret and may not capture the stylistic characteristics that define expertise. This study proposes a methodology for evaluating the surgical skill, based on metrics associated with stylistic adjectives, and evaluates the ability of this method to differentiate expertise levels.We recruited subjects from different expertise levels to perform training tasks on a surgical simulator. A lexicon of contrasting adjective pairs, based on important skills for robotic surgery, inspired by the global evaluative assessment of robotic skills tool, was developed. To validate the use of stylistic adjectives for surgical skill assessment, posture videos of the subjects performing the task, as well as videos of the task were rated by crowd-workers. Metrics associated with each adjective were found using kinematic and physiological measurements through correlation with the crowd-sourced adjective assignment ratings. To evaluate the chosen metrics' ability in distinguishing expertise levels, two classifiers were trained and tested using these metrics.Crowd-assignment ratings for all adjectives were significantly correlated with expertise levels. The results indicate that naive Bayes classifier performs the best, with an accuracy of , , , and when classifying into four, three, and two levels of expertise, respectively.The proposed method is effective at mapping understandable adjectives of expertise to the stylistic movements and physiological response of trainees.