Placental vessel-guided hybrid framework for fetoscopic mosaicking
Placental vessel-guided hybrid framework for fetoscopic mosaicking
复制标题
胎盘血管引导的胎儿镜镶嵌混合框架
DOI：
10.1080/21681163.2022.2154278
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Bano S
中科院分区：
文献类型：
--
作者：
Bano S
胎儿镜激光光凝术用于治疗双胎输血综合征;然而，由于手术视野有限、胎盘位置异常、胎儿镜的可操作性有限以及液体浑浊和闭塞导致的可见性差而难以可视化术中手术环境，因此该手术受阻。胎儿镜视频拼接可以创建胎儿镜术中环境的扩大视野图像，这可以支持外科医生在胎儿镜手术期间定位血管闭塞。然而，经典的手工特征匹配方法在体内胎儿镜视频上失败。现有的关于胎儿镜镶嵌的最先进的方法依赖于血管的存在，并且当视图中不存在血管时失败。我们提出了一种血管引导的混合胎儿镜镶嵌框架，该框架从基于胎盘血管的配准和基于深度学习的密集匹配方法中相互受益，以优化整体性能。基于血管的外观一致性和光度误差最小化来实现选择机制，以选择最佳的成对变换。使用扩展的胎儿镜检查胎盘数据集，我们通过实验证明了所提出的框架的鲁棒性，超过了最先进的方法，即使在无血管，低纹理或低照明的非平面胎儿镜视图中。
Fetoscopic laser photocoagulation is used to treat twin-to-twin transfusion syndrome; however, this procedure is hindered because of difficulty in visualising the intraoperative surgical environment due to limited surgical field-of-view, unusual placenta position, limited manoeuvrability of the fetoscope and poor visibility due to fluid turbidity and occlusions. Fetoscopic video mosaicking can create an expanded field-of-view image of the fetoscopic intraoperative environment, which could support the surgeons in localising the vascular anastomoses during the fetoscopic procedure. However, classical handcrafted feature matching methods fail on in vivo fetoscopic videos. An existing state-of-the-art method on fetoscopic mosaicking relies on vessel presence and fails when vessels are not present in the view. We propose a vessel-guided hybrid fetoscopic mosaicking framework that mutually benefits from a placental vessel-based registration and a deep learning-based dense matching method to optimise the overall performance. A selection mechanism is implemented based on vessels’ appearance consistency and photometric error minimisation for choosing the best pairwise transformation. Using the extended fetoscopy placenta dataset, we experimentally show the robustness of the proposed framework, over the state-of-the-art methods, even in vessel-free, low-textured, or low illumination non-planar fetoscopic views.
登录
查看更多内容
影响因子：
3.6
作者：
Pereira-Prado, Vanesa;Martins-Silveira, Felipe;Sicco, Estafania;Hochmann, Jimena;Isiordia-Espinoza, Mario Alberto;Gonzalez, Rogelio Gonzalez;Pandiar, Deepak;Bologna-Molina, Ronell
通讯作者：
Bologna-Molina, Ronell
DOI：
10.1117/1.jmi.5.2.021217
发表时间：
2018-04
期刊：
Journal of medical imaging (Bellingham, Wash.)
影响因子：
--
作者：
Tella-Amo M;Peter L;Shakir DI;Deprest J;Stoyanov D;Iglesias JE;Vercauteren T;Ourselin S
通讯作者：
Ourselin S
影响因子：
2.4
作者：
Tella-Amo, Marcel;Peter, Loic;Ourselin, Sebastien
通讯作者：
Ourselin, Sebastien
影响因子：
3.2
作者：
Gaisser, Floris;Peeters, Suzanne H. P.;Oepkes, Dick
通讯作者：
Oepkes, Dick