Exploring Eye-tracking Technology as an Assessment Tool for Point-of-care Ultrasound Training
Exploring Eye-tracking Technology as an Assessment Tool for Point-of-care Ultrasound Training
复制标题
DOI：
10.1002/aet2.10508
复制
发表时间：
2021-04-01
影响因子：
1.8
通讯作者：
Chenkin, Jordan
中科院分区：
文献类型：
--
作者：
Lee, Wei Feng;Chenkin, Jordan
目的：眼球跟踪技术已经成为几个医学专业潜在有用的学习者评估工具。在普通外科和麻醉学领域，它已被证明可以可靠地区分程序技能的不同专业水平。在放射学领域，它已被证明是诊断测试解释的有效评估工具。目前的治疗点超声能力评估方法仍然是一个挑战，因为它们需要教师的大量直接观察时间。本研究的目的是确定眼动跟踪技术是否能准确区分新手和专家在解释眼袋夹，特别是在创伤超声(FAST)扫描中的聚焦评估。方法：邀请来自同一学术急诊科的医学生、住院医生和急诊医生的方便样本参与。参与者既有Pocus的新手，也有专家。每个参与者都完成了一份基线问卷，并观看了16个快速超声波检查的视频剪辑，同时他们的凝视模式被商业上可以买到的眼球跟踪设备记录下来。主要结果是对感兴趣区的总注视时间(AOI)。次要结果包括注视的总时间、平均注视次数和第一次注视的平均持续时间。结果：15名新手和15名专家完成了这项研究。就整体凝视时间而言，专家的凝视时间明显长于新手(75.8秒+/-16.2秒对56.6秒/-12.8秒，p=0.001)。类似地，专家对人工耳声指数的注视速度明显更快，并且有更高的注视次数(8.5秒+/-4.0秒比15.1+/-6.8秒，p=0.003；170+/-30秒比143秒+/-28秒，p=0.016)。平均第一次注视时间差异无统计学意义(0.42+/-0.12秒vs.0.39+/-0.09秒，P=0.467)。结论：眼动跟踪技术可以通过快速检查视频片段上的注视模式来区分专家和新手。AOI上的总凝视时间可能是一个有用的指标，有助于评估Pocus图像解释的能力。此外，对凝视模式的评估可能有助于教育工作者找出口译错误的原因。未来的研究需要在更大的队列中进一步验证这些指标。
Objectives: Eye-tracking technology has emerged as a potentially useful learner assessment tool in several medical specialties. In the fields of general surgery and anesthesiology, it has been shown to reliably differentiate between different levels of expertise in procedural skills. In the field of radiology, it has been shown to be a valid assessment tool for diagnostic test interpretation. Current methods of competency assessment in point-of-care ultrasound (POCUS) remain a challenge, because they require significant direct observation time by an instructor. The purpose of this study was to determine if eye-tracking technology can accurately distinguish between novice and experts in the interpretation of POCUS clips, specifically of the focused assessment using sonography in trauma (FAST) scan.Methods: A convenience sample of medical students, residents, and emergency physicians from a single academic emergency department were invited to participate. Participants included both novices and experts in POCUS. Each participant completed a baseline questionnaire and viewed 16 video clips of a FAST ultrasound examination while their gaze patterns were recorded by a commercially available eye-tracking device. The primary outcome was total gaze time on the area of interest (AOI). Secondary outcomes included total time to fixation, mean number of fixations, and mean duration of first fixation on the AOI.Results: Fifteen novices and 15 experts completed this study. For total gaze time on the AOI, experts fixated their gaze significantly longer than novices (75.8 +/- 16.2 seconds vs. 56.6 +/- 12.8 seconds, p = 0.001). Similarly, experts were significantly faster to fixate on the AOI and had a higher fixation count on the AOI (8.5 +/- 4.0 seconds vs. 15.1 +/- 6.8 seconds, p = 0.003; and 170 +/- 30 vs. 143 +/- 28 seconds, p = 0.016). There were no differences on the mean duration of first fixation on the AOI (0.42 +/- 0.12 seconds vs. 0.39 +/- 0.09 seconds, p = 0.467).Conclusion: Eye-tracking technology shows the potential to differentiate between experts and novices by their gaze patterns on video clips of FAST examinations. The total gaze time on the AOI may be a useful metric to help in the assessment of competency in POCUS image interpretation. In addition, the evaluation of gaze patterns may help educators identify causes of interpretation errors. Future studies are needed to further validate these metrics in a larger cohort.