Automated pharyngeal phase detection and bolus localization in videofluoroscopic swallowing study: Killing two birds with one stone?
Automated pharyngeal phase detection and bolus localization in videofluoroscopic swallowing study: Killing two birds with one stone?
复制标题
DOI：
10.1016/j.cmpb.2022.107058
复制
发表时间：
2022-10
影响因子：
6.1
通讯作者：
Steele, Catriona M.
中科院分区：
文献类型：
--
作者：
Bandini, Andrea;Smaoui, Sana;Steele, Catriona M.
关键词：
The videofluoroscopic swallowing study (VFSS) is a gold-standard imaging technique for assessing swallowing, but analysis and rating of VFSS recordings is time consuming and requires specialized training and expertise. Researchers have recently demonstrated that it is possible to automatically detect the pharyngeal phase of swallowing and to localize the bolus in VFSS recordings via computer vision approaches, fostering the development of novel techniques for automatic VFSS analysis. However, training of algorithms to perform these tasks requires large amounts of annotated data that are seldom available. In this paper, we demonstrate that the challenges of pharyngeal phase detection and bolus localization can be solved together using a single approach. We propose a deep-learning framework that jointly tackles pharyngeal phase detection and bolus localization in a weakly-supervised manner, requiring only the initial and final frames of the pharyngeal phase as ground truth annotations for the training. Our approach stems from the observation that bolus presence in the pharynx is the most prominent visual feature upon which to infer whether individual VFSS frames belong to the pharyngeal phase. We conducted extensive experiments with multiple convolutional neural networks (CNNs) on a dataset of 1245 bolus-level clips from 59 healthy subjects. We demonstrated that the pharyngeal phase can be detected with an F1-score higher than 0.9. Moreover, by processing the class activation maps of the CNNs, we were able to localize the bolus with promising results, obtaining correlations with ground truth trajectories higher than 0.9, without any manual annotations of bolus location used for training purposes. Once validated on a larger sample of participants with swallowing disorders, our framework will pave the way for the development of intelligent tools for VFSS analysis to support clinicians in swallowing assessment.
登录
查看更多内容
DOI：
10.3390/diagnostics11020300
发表时间：
2021-02-13
期刊：
Diagnostics (Basel, Switzerland)
影响因子：
--
作者：
Lee KS;Lee E;Choi B;Pyun SB
通讯作者：
Pyun SB
影响因子：
2.6
作者：
Martin-Harris, Bonnie;Brodsky, Martin B.;Michel, Yvonne;Castell, Donald O.;Schleicher, Melanie;Sandidge, John;Maxwell, Rebekah;Blair, Julie
通讯作者：
Blair, Julie
影响因子：
7.5
作者：
Lee, Joon;Steele, Catriona M.;Chau, Tom
通讯作者：
Chau, Tom
影响因子：
3.7
作者：
Kim, Won-Seok;Zeng, Pengcheng;Paik, Nam-Jong
通讯作者：
Paik, Nam-Jong
影响因子：
1.7
作者：
Flowers, Heather L.;Silver, Frank L.;Martino, Rosemary
通讯作者：
Martino, Rosemary