Enhanced visualisation for minimally invasive surgery
Enhanced visualisation for minimally invasive surgery
复制标题
DOI：
10.1007/s11548-011-0631-z
复制
发表时间：
2012-05-01
影响因子：
3
通讯作者：
Yang, Guang-Zhong
中科院分区：
文献类型：
--
作者：
Totz, Johannes;Fujii, Kenko;Yang, Guang-Zhong
用于微创手术的内窥镜提供有限的视野，因此需要高度的空间意识和定向。研究人员尝试用先前观察到的图像扩展这个小的、受限的视图，通常被称为图像拼接或动态视图扩展。对于微创内窥镜，基于slam的方法已显示出潜在的价值，但尚未解决有效的可视化技术。实时内窥镜视频馈送扩展了先前观察到的镜头。为此，提出了一种突出实际相机图像与之前观测到的历史数据之间差异的方法。旧的视频数据被淡化为灰度，以模拟人类的周边视觉。在纹理合成的帮助下去除高光，以避免分散视觉线索。该方法通过详细的用户研究在体内和幻影序列上进一步评估，以检查用户在可视化扩展视野时识别时间运动轨迹的能力，这一特征对增强空间意识和方向具有实用价值。有效地整合了历史数据和实时视频之间的差异。使用由平面参数化生成的单一纹理域进行视图扩展。高光可以通过纹理合成去除，而不会引入明显的伪影。该方法对内窥镜摄像机的运动轨迹进行隐式编码，有利于场景的全局感知和时间演化。动态视图扩展通过在相机视野之外建立参考点，为导航和定向提供了更多的上下文。有效整合视觉线索对于简洁的视觉化是至关重要的。
Endoscopes used in minimally invasive surgery provide a limited field of view, thus requiring a high degree of spatial awareness and orientation. Attempts at expanding this small, restricted view with previously observed imagery have been made by researchers and is generally known as image mosaicing or dynamic view expansion. For minimally invasive endoscopy, SLAM-based methods have been shown to have potential values but have yet to address effective visualisation techniques.The live endoscopic video feed is expanded with previously observed footage. To this end, a method that highlights the difference between actual camera image and historic data observed earlier is proposed. Old video data is faded out to grey scale to mimic human peripheral vision. Specular highlights are removed with the help of texture synthesis to avoid distracting visual cues. The method is further evaluated on in vivo and phantom sequences by a detailed user study to examine the ability of the user in discerning temporal motion trajectories while visualising the expanded field of view, a feature that is of practical value for enhancing spatial awareness and orientation.The difference between historic data and live video is integrated effectively. The use of a single texture domain generated by planar parameterisation is demonstrated for view expansion. Specular highlights can be removed through texture synthesis without introducing noticeable artefacts. The implicit encoding of motion trajectory of the endoscopic camera visualised by the proposed method facilitates both global awareness and temporal evolution of the scene.Dynamic view expansion provides more context for navigation and orientation by establishing reference points beyond the camera's field of view. Effective integration of visual cues is paramount for concise visualisation.