Toward Automated Video Quality Assessment of Ultrasound

超声自动化视频质量评估

• 批准号: 2431522
• 金额: --
• 依托单位: University of Oxford
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2431522
• 关键词: Toward; Automated; Video; Quality; Assessment

Project ContextTraditionally the literature on medical image analysis considers image-based diagnostics (interpreting a captured image). Ultrasound image analysis is different as there is less focus on the image, and more on video processing. Ultrasound imaging is also an interactive real-time imaging technique where video can be cheaply re-taken. Human experts quickly learn how to retake a video if it is sub-optimal or not "fit-for-purpose". Computers are yet to be able to mimic this human capability. This project seeks to investigate deep learning-based video analysis algorithms to advance automated ultrasound video quality assessment towards a generalisable solution more akin to human-like expert behaviour.Aims and ObjectivesWe have two large real-world datasets available for this research which will allow us to look at ultrasound video quality assessment from different perspectives. The first is the PULSE dataset which is a large-scale multi-modal freehand datasets of ultrasound video, gaze tracking data, and probe motion data acquired while sonographers perform fetal screening scans. The second dataset is from a basic pregnancy ultrasound study where sonographers have acquired data at two sites following a simple scanning protocol consisting of pre-defined linear sweeps (called the CALOPUS ultrasound protocol (CUP)).We will use the PULSE multi-modal dataset to study the criteria that human experts use to determine video quality in practice. This will provide insight into the computational criteria that will need to be embedded in a general deep learning model of video QA. We will use the CALOPUS dataset to define the training and test data for the developed video QA models. We will start with simple requirements like "the video is good quality if the fetal head is present". We will then move on to more general requirements such as "the video is good quality if all anatomical structures are clear enough". However, we do not want to build a bespoke solution for every task as this is tedious to do, so our deep learning designs will need to be increasingly "intelligent" and will aim to utilise some of the latest computer vision ideas in their design so that ideally manual annotation is not needed for training (self-supervision), models learn to be generalisable to new unseen tasks (domain adaptation) and they are ideally explainable. The doctoral research will thus progressively explore developing and testing a family of deep learning-based ultrasound video quality assessment methods that are more general.Novelty and ImpactThis research will advance understanding of automated video analysis algorithms with a domain focus on healthcare imaging. Automated ultrasound video quality assessment would be a transformational technology to simplify ultrasound and make it an accessible technology for a wider range of clinical professionals in high-income and low-and-middle-income countries.Alignment with EPSRC ThemesThis project falls within the EPSRC healthcare technologies, ICT and artificial intelligence and robotics research areas

项目背景传统上，有关医学图像分析的文献考虑基于图像的诊断（解释捕获的图像）。超声图像分析则不同，它较少关注图像，而更多关注视频处理。超声成像也是一种交互式实时成像技术，可以廉价地重新拍摄视频。如果视频不理想或不“适合目的”，人类专家很快就会学会如何重新拍摄视频。计算机还无法模仿人类的这种能力。该项目旨在研究基于深度学习的视频分析算法，以推进自动化超声视频质量评估，形成更类似于人类专家行为的通用解决方案。目的和目标我们有两个大型现实世界数据集可用于这项研究，这将使我们能够从不同的角度看待超声视频质量评估。第一个是 PULSE 数据集，它是超声检查人员执行胎儿筛查扫描时获取的超声视频、注视跟踪数据和探头运动数据的大规模多模式徒手数据集。第二个数据集来自一项基本的妊娠超声研究，其中超声检查人员遵循由预定义线性扫描组成的简单扫描协议（称为 CALOPUS 超声协议 (CUP)）在两个站点获取数据。我们将使用 PULSE 多模态数据集来研究人类专家在实践中用于确定视频质量的标准。这将深入了解需要嵌入视频 QA 的通用深度学习模型中的计算标准。我们将使用 CALOPUS 数据集来定义开发的视频 QA 模型的训练和测试数据。我们将从简单的要求开始，例如“如果胎头存在，则视频质量良好”。然后我们将转向更一般的要求，例如“如果所有解剖结构足够清晰，则视频质量良好”。然而，我们不想为每项任务构建定制的解决方案，因为这样做很乏味，因此我们的深度学习设计需要越来越“智能”，并致力于在设计中利用一些最新的计算机视觉思想，以便理想情况下不需要手动注释进行训练（自我监督），模型学习可推广到新的未见过的任务（领域适应），并且理想情况下它们是可解释的。因此，博士研究将逐步探索开发和测试一系列更通用的基于深度学习的超声视频质量评估方法。新颖性和影响这项研究将增进对医疗成像领域自动视频分析算法的理解。自动超声视频质量评估将是一项变革性技术，可简化超声检查，使其成为高收入和中低收入国家更广泛的临床专业人员可使用的技术。与 EPSRC 主题保持一致该项目属于 EPSRC 医疗保健技术、ICT 以及人工智能和机器人研究领域