Late fusion of heterogeneous methods for multimedia image retrieval
Late fusion of heterogeneous methods for multimedia image retrieval
复制标题
DOI：
10.1145/1460096.1460125
复制
发表时间：
2008-10
期刊：
影响因子：
--
通讯作者：
H. Escalante;Carlos A. Hernández;L. Sucar;M. Montes-y-Gómez
中科院分区：
文献类型：
--
作者：
H. Escalante;Carlos A. Hernández;L. Sucar;M. Montes-y-Gómez
独立检索方法的后期融合是一种更简单的方法，也是一种广泛使用的方法，用于将视觉和文本信息结合起来进行搜索。通常，每种检索方法都基于单个模态，或者甚至当每种模态考虑几种方法时，所有方法都使用相同的信息进行索引/查询。后者降低了考虑融合的文档的多样性和互补性，因此融合方法的性能较差。在本文中，我们研究了多个异构的方法在带注释的集合中的图像检索的组合。异质性被认为是在i）的模态，其中的方法是基于，ii）在他们用于索引/查询的信息和iii）在方法的个人性能。考虑融合的不同设置，包括加权、全局、每模态和分层。我们报告的实验结果，在一个图像检索基准，表明所提出的组合优于显着的任何个人的方法，我们认为。检索性能与ImageCLEF 2007中获得的最佳性能相当。一个有趣的结果是，即使是表现不佳的方法（单独）也会对融合策略非常有用。此外，与文献中报道的工作相反，通过对基于文本的方法分配较低的权重，获得了更好的结果。本文的主要贡献是实验性的，报告了一些有趣的发现，激发了对不同主题的进一步研究。
Late fusion of independent retrieval methods is the simpler approach and a widely used one for combining visual and textual information for the search process. Usually each retrieval method is based on a single modality, or even, when several methods are considered per modality, all of them use the same information for indexing/querying. The latter reduces the diversity and complementariness of documents considered for the fusion, as a consequence the performance of the fusion approach is poor. In this paper we study the combination of multiple heterogeneous methods for image retrieval in annotated collections. Heterogeneousness is considered in terms of i) the modality in which the methods are based on, ii) in the information they use for indexing/querying and iii) in the individual performance of the methods. Different settings for the fusion are considered including weighted, global, per-modality and hierarchical. We report experimental results, in an image retrieval benchmark, that show that the proposed combination outperforms significantly any of the individual methods we consider. Retrieval performance is comparable to the best performance obtained in the context of ImageCLEF2007. An interesting result is that even methods that perform poor (individually) resulted very useful to the fusion strategy. Furthermore, opposed to work reported in the literature, better results were obtained by assigning a low weight to text-based methods. The main contribution of this paper is experimental, several interesting findings are reported that motivate further research on diverse subjects.