Adaptive information processing in hybrid imaging on the cloud

背景：混合成像被定义为将两种或两种以上的成像技术融合成一种单一的成像形式。理想情况下，这种新形式是协同的，也就是说，比各部分的总和更强大。混合成像已经从简单地融合两种模式发展成为一个独立的研究领域。在过去的十年中，非常广泛的混合成像模式已经成为常规可用。典型的例子包括PET（正电子发射断层扫描）-MRI（磁共振成像），PET- ct（计算机断层扫描）和多源雷达声呐图像。为了充分发挥混合成像的潜力，必须将各种专业知识结合在一起。以PET- mr - ct为例：传统的PET是由核医学的人类专家进行解读；CT和MRI是由不同的放射学专家来解释的。混合PET-MRI给人类的感知带来了重大挑战。这在心脏PET-MR和实时声纳雷达等动态混合成像时尤其如此。虽然图像提供了补充信息，但缺乏基于计算机的智能工具来有效地处理这些大量数据。这为自适应信息处理平台的研究带来了重要的机遇。动机：我们的研究动机是：i)在过去的十年里，混合图像采集越来越多，这对人类的感知是非常具有挑战性的。混合图像的特殊性要求研究人员应用特定的方法进行分析，而不是扩展现有的图像处理方法。ii)从互模态中提取的信息包含有价值的见解，这些见解往往需要进一步分析。例如，心脏CT和MRI图像可以输出重要信息，用于医学诊断疾病，并跟踪和监测疾病的进展和治疗，PET可以输出肌肉分子水平，可用于跟踪肌肉内的代谢；(3)结合配准与分割方法的动机是观察配准与分割之间的相互关系以及不同模式之间的相互关系。目的：主要的长期目标是开发和评估用于混合成像的综合自适应信息处理计算机软件平台。该系统在实践中能够大大减少目前的工作量，进一步提高准确率；第二个目标是建立一个可公开访问的混合成像数据库，用于基准测试，以帮助研究界并改善混合图像分析研究的当前状态。近期目标：1)研究开发智能PET-MRI-CT图像处理软件系统，包括图像融合、综合分割配准和信息提取系统；2)研究开发多种基于信息的关注焦点机制，从混合图像分割和配准中生成感兴趣区域（ROI）供进一步分析；3)采集共享混合图像数据库50例。意义：据我们所知，这是首次尝试创建混合成像综合信息处理系统。提出的短期目标：PET-MR-CT信息处理系统利用研究所现有的领先设备，结合集团的技术优势，融合集团传承的用户知识。所提出的方法利用了集团目前正在开发的尖端技术，并与该领域的其他领先技术相融合，朝着多学科综合研究计划迈进。

Background: Hybrid imaging is defined as the fusion of two or more imaging technologies into a single form of imaging. Ideally, this new form is synergistic-that is, more powerful than the sum of its parts. Hybrid imaging has grown from simply fusing two modalities into an independent research area. In the last decade, very wide ranges of hybrid imaging modalities have been becoming routinely available. Typical example would include PET (Positron Emission Tomography)-MRI (Magnetic Resonance Imaging), PET-CT (Computed Tomography), and multiple source radar-sonar images. To realize the full potential of hybrid imaging, diverse kinds of expertise must be brought together. Taking PET-MR-CT for an example: Traditionally PET is interpreted by human expert from nuclear medicine; CT and MRI are interpreted by different human experts from radiology. Hybrid PET-MRI brings significant challenges for human perceptions. This is especially true when dynamic hybrid imaging such as cardiac PET-MR and real time sonar-Radar. While the images provide complementary information, there is lack of computer based intelligence tools to handle this huge amount of data efficiently. This brings significant research opportunities for adaptive information processing platform. Motivation: Our research is motivated by: i) Within the last decade, there has been a growing increase of hybrid image acquisition, which is very challenging for human perception. The specialty of the hybrid images has required that the researcher apply particular methods to analysis rather than extend existing image processing methods. ii) Information extracted from the mutual modality contains valuable insight, which often requires further analysis. As an example, Cardiac CT and MRI images can output important information that can be used to medically diagnose disease, as well as track and monitor the progression of disease and therapy and PET can output muscle on molecular level, which can be used to track metabolism within muscle; and iii) the integrated registration and segmentation methods is motivated by the observation of the reciprocity between registration and segmentation and reciprocity between different modalities. OBJECTIVES: The main long term objective is to develop and evaluate an comprehensive adaptive information processing computer software platform for hybrid imaging. The system is able greatly reduce the current workload in the practice, further improve the accuracy; The secondary objective is to establish a publicly accessible hybrid imaging database for benchmarking to help the research community and to improve the current state-of-art of research in hybrid image analysis. Short term objectives: 1) Research and develop an intelligent PET-MRI-CT image processing software system, which covers image fusion, integrated segmentation and registration and information extraction system; 2) Research and develop multiple information based focus-of-attention mechanisms for generating region of interest (ROI) from the hybrid images segmentation and registration for further analysis; 3) Collect and share 50 cases of hybrid image database. SIGNIFICANCE: To the best of our knowledge, this is the first attempt to create a comprehensive information processing system for hybrid imaging. The proposed short term objective: PET-MR-CT information processing system leverage the existing leading facility in the institute, combined with the technical strengths of the group, fused with the user knowledge inherited in the group. The proposed methodology leverages the cutting edge techniques currently being developed in the group and fused with other leading technologies in the field, move towards a multidisciplinary, integrated research program.